Home security monitoring method, device, equipment, medium and program product

Abstract

The invention relates to the technical field of home security, and discloses a home security monitoring method, device, equipment, medium and program product, which are applied to household appliances, the household appliances are integrated into a cabin in advance, and an unmanned aerial vehicle is deployed in the cabin, and the method comprises the following steps: acquiring an alarm signal of preset security monitoring equipment to a current monitoring event; generating a monitoring instruction according to the alarm signal, and sending the monitoring instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle performs image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; and acquiring image information acquired by the unmanned aerial vehicle, and performing all-directional monitoring based on the image information until the current monitoring event is ended. By integrating the unmanned aerial vehicle on the household appliance, dynamic monitoring can be realized within a certain range, monitoring dead angles are avoided, the reliability of home security is improved, and a safer home environment is provided for a user.

Description

Technical Field

[0001] The present invention relates to the technical field of home security, and particularly to a monitoring method, device, equipment, medium and program product for home security. Background Art

[0002] With the increasing development of smart furniture, the Internet of Things enables various devices in the home to be interconnected and communicate with each other. Integrating security devices with other smart home devices realizes the interconnection and intelligent management of devices. For example, devices such as smart locks, cameras, and sensors can be uniformly controlled and managed through the Internet of Things platform.

[0003] However, currently, home security mainly relies on cameras, sensors, etc. to achieve static monitoring within a fixed range, which cannot meet complex actual scenarios. Taking a smart lock with security monitoring attributes as an example, it is usually completed by integrating a camera on the smart lock. However, the camera integrated on the smart lock can only observe the front situation outside the door. If there is someone hiding behind and following, or dangerous items hidden behind, the camera of the smart lock cannot observe. Additionally, due to the limitation of the field of view angle, there must be blind spots, such as directly below the door, the side, etc. The existence of dead corners and blind spots poses certain challenges to home security and cannot provide a safer living environment for users. Summary of the Invention

[0004] In view of this, the present invention provides a monitoring method, device, equipment, medium and program product for home security to solve the problem of monitoring dead corners in home security.

[0005] In a first aspect, the present invention provides a monitoring method for home security, which is applied to a home appliance device. The home appliance device is pre-integrated with a cabin, and a drone is deployed inside the cabin. The method includes: obtaining an alarm signal of a preset security monitoring device for a current monitoring event; generating a monitoring instruction according to the alarm signal, and sending the monitoring instruction to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; obtaining the image information collected by the drone, and performing omnidirectional monitoring based on the image information until the current monitoring event ends.

[0006] The monitoring method for home security provided by the present invention, after the home appliance device obtains the alarm signal of the preset security monitoring device for the current monitoring event, generates a monitoring instruction and sends it to the drone, so that the drone collects image information in the first preset monitoring area corresponding to the alarm signal, and performs omnidirectional monitoring based on the image information until the current monitoring event ends. By integrating a drone on the home appliance device, the present invention can achieve dynamic monitoring within a certain range, avoid the occurrence of monitoring dead corners, improve the reliability of home security, and provide a safer living environment for users.

[0007] In an alternative embodiment, a monitoring instruction is generated according to the alarm signal and sent to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal, including: entering the monitoring mode based on the alarm signal, and judging whether to enter the warning mode according to the alarm signal in the monitoring mode; if entering the warning mode, judging whether the drone is enabled; if the drone is enabled, generating a first monitoring instruction and sending the first monitoring instruction to the drone, so that the drone performs image acquisition within a first range in the first preset monitoring area; judging whether to enter the warning mode according to the alarm signal and the acquired image information in the warning mode; if entering the warning mode, generating a second monitoring instruction and sending the second monitoring instruction to the drone, so that the drone performs cruise flight and image acquisition within a second range in the first preset monitoring area and issues an alarm signal, where the second range is larger than the first range.

[0008] By setting security monitoring modes at different levels, the present invention can flexibly handle the monitoring status according to the actual monitoring situation, upgrade from the ordinary monitoring mode to the warning mode, dispatch the drone to perform monitoring within a smaller range, and then upgrade to the warning mode, so that the drone performs monitoring within a larger range, gradually increasing the current monitoring range and monitoring intensity, and gradually increasing the deterrent effect on the intrusion target, thereby achieving the effect of driving away and avoiding property losses and personal injuries.

[0009] In an alternative embodiment, generating a first monitoring instruction and sending the first monitoring instruction to the drone, so that the drone performs image acquisition within a first range in the first preset monitoring area, including: obtaining the position information of the drone and determining the position where the drone is located according to the position information; if the drone is at the preset hovering position corresponding to the first preset monitoring area, generating a first sub-monitoring instruction and sending the first sub-monitoring instruction to the drone, so that the drone performs image acquisition within a first range at the preset hovering position; if the drone is in the cabin, generating a second sub-monitoring instruction and sending the second sub-monitoring instruction to the drone, so that the drone flies out of the cabin to the first preset monitoring area and performs image acquisition within a first range at the best monitoring angle in the first preset monitoring area.

[0010] By performing image acquisition within different perspectives when the drone is in different positions, the present invention can provide different monitoring perspectives for users. At the same time, the drone can provide a higher monitoring perspective to supplement the monitoring blind spots of household electrical appliances.

[0011] In an optional embodiment, determining whether to enter an alert mode based on an alarm signal includes: determining whether a current monitoring event is upgraded based on the duration of the alarm signal or the corresponding first distance interval; if the duration exceeds a preset time threshold, or the first distance interval is lower than the first preset distance threshold, determining that the current monitoring event is upgraded, and entering an alert mode; determining whether to enter a warning mode based on the alarm signal and the collected image information includes: determining whether the current monitoring time is upgraded again based on the risk type corresponding to the alarm signal and / or the risk level corresponding to the image information; if the risk type is a preset high risk type, or the risk level is a high risk level, determining that the current monitoring event is upgraded again, and entering a warning mode.

[0012] The present invention makes event upgrade judgments of different levels based on the current alarm signal or image information, and can perform corresponding analysis based on the current actual situation to fully determine whether the current monitoring event will pose a threat to the user's property safety or personal safety. If there is a possibility of causing a threat, the monitoring intensity and monitoring scope will be further increased to avoid property or personal loss.

[0013] In an optional embodiment, the all-round monitoring process also includes: acquiring a wireless signal emitted by the drone, and determining a second distance interval between the drone and the household appliance according to the strength of the wireless signal; judging the distance range in which the second distance interval is located, wherein the distance ranges are, from small to large, the first distance range, the second distance range, and the third distance range; if the second distance interval is within the first distance range, determining that the drone is within the monitoring area; if the second distance interval is within the second distance range, generating a return control signal, and sending the return control signal to the drone to make the drone return; if the second distance interval is within the third distance range, determining that the drone is within the lost area, generating an alarm instruction, and sending the alarm instruction to the drone to make the drone send an alarm signal according to the alarm instruction.

[0014] The present invention can determine whether the current drone is at risk of losing control or even being stolen by judging the distance range of the drone. When the drone is about to lose control, the present invention promptly controls the drone to return to the home base to prevent the drone from failing to work normally. When there is a risk of theft, an alarm is issued to deter thieves and protect the drone.

[0015] In an optional embodiment, when determining whether an alarm signal from a security monitoring device is received, it also includes: obtaining a preset home security task, and a preset time interval for the home security task; generating a third monitoring instruction according to the preset time interval, and sending the third monitoring instruction to the drone, so that the drone flies to a second preset monitoring area corresponding to the home security task, and performs image acquisition in the second preset monitoring area; obtaining the acquired image information, and sending the image information to the background server, so that the background server performs security risk analysis based on the image information.

[0016] By setting home security tasks, the present invention can control the drone to intermittently perform home security tasks, and the background server can perform security risk analysis to promptly discover possible risks in the home, so that timely measures can be taken before the risks expand to avoid further losses of property safety or personal safety.

[0017] In a second aspect, the present invention provides a method for monitoring home security, which is applied to a drone, and the drone is deployed in a cabin pre-integrated with home appliances. The method includes: obtaining a monitoring instruction issued by the home appliance according to an alarm signal corresponding to a current monitoring event; performing image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; and sending the acquired image information to the home appliance, so that the home appliance performs all-round monitoring based on the image information until the current monitoring event ends.

[0018] The monitoring method for home security provided by the present invention acquires images in a first preset monitoring area corresponding to the alarm signal through a drone after acquiring the monitoring instruction corresponding to the alarm signal, and feeds back the acquired image information to the home appliance to perform all-round monitoring until the current monitoring event ends. The present invention dynamically monitors the alarm area through a drone, can provide users with an all-round monitoring perspective, make up for the defects of fixed and limited monitoring perspectives of home appliances, improve the reliability of home security, and provide users with a safer home environment.

[0019] In an optional embodiment, image acquisition is performed in a first preset monitoring area corresponding to an alarm signal according to a monitoring instruction, including: obtaining location information, and sending the location information to a home appliance, so that the home appliance determines its location according to the location information; if the home appliance is in a preset hovering position corresponding to the first preset monitoring area, receiving a first sub-monitoring instruction of the home appliance in an alert mode, and performing image acquisition within a first range at the preset hovering position according to the first sub-monitoring instruction; if the home appliance is in a cabin, receiving a second sub-monitoring instruction of the home appliance in the alert mode, and flying out of the cabin to the first preset monitoring area according to the second sub-monitoring instruction, and performing image acquisition within the first range at an optimal monitoring viewing angle within the first preset monitoring area.

[0020] By setting the hovering position, the present invention can provide a stable shooting angle for the drone, eliminating the need for repeated operations of flying the drone out, and making up for the monitoring perspective of home appliances. At the same time, after the drone flies out of the cabin, it can automatically determine the best angle within the shooting area, avoiding monitoring blind spots and providing users with accurate monitoring images.

[0021] In an alternative embodiment, flying out of the cabin to the first preset monitoring area according to the second sub-monitoring instruction and collecting images within the first range at the best monitoring perspective in the first preset monitoring area includes: generating a flight instruction according to the second sub-monitoring instruction and flying out of the cabin to the first preset monitoring area based on the flight instruction; identifying a monitoring target within the first preset monitoring area, and when the monitoring target is determined, determining the best monitoring perspective according to the monitoring target; collecting images within the first range based on the best monitoring perspective.

[0022] By using the drone to identify the target, the present invention can automatically determine the best shooting angle according to the monitored target, avoiding monitoring blind spots and providing users with accurate monitoring images.

[0023] In an alternative embodiment, collecting images in the first preset monitoring area corresponding to the alarm signal according to the monitoring instruction further includes: receiving the second monitoring instruction of the home appliance in the warning mode, performing a patrol flight on the monitoring target according to the second monitoring instruction, collecting images within the second range during the patrol flight, and sending out an alarm signal.

[0024] By using the drone to perform a patrol flight on the monitoring target, the present invention can track the monitoring target. Especially when the monitoring target is an unauthorized person, it can bring a deterrent effect, so as to drive away the unauthorized person and protect the property and personal safety of the user.

[0025] In an alternative embodiment, after receiving the return control signal of the home appliance, it further includes: performing a navigation flight according to the preset position of the cabin until reaching within the preset distance range of the preset position; moving within the preset distance range and determining whether to identify the infrared information emitted by the cabin during the movement; if the infrared information is identified, flying into the cabin according to the infrared information.

[0026] By combining position navigation and infrared information alignment, the present invention can achieve accurate positioning of the drone and its return to the cabin, avoiding the problem that the cabin is relatively small after the combination of the home appliance and the drone, making it impossible to accurately determine the landing position.

[0027] In a third aspect, the present invention provides a monitoring device for home security, which is applied to household appliances. The household appliances are pre-integrated with a cabin, and a drone is deployed inside the cabin. The device includes: a signal acquisition module, configured to acquire an alarm signal of a preset security monitoring device for a current monitoring event; a drone control module, configured to generate a monitoring instruction according to the alarm signal and send the monitoring instruction to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal; and a security monitoring module, configured to acquire the image information collected by the drone and perform all-round monitoring based on the image information until the current monitoring event ends.

[0028] In a fourth aspect, the present invention provides a monitoring device for home security, which is applied to a drone. The drone is deployed in a cabin pre-integrated with household appliances. The device includes: an instruction acquisition module, configured to acquire a monitoring instruction sent by the household appliances according to an alarm signal corresponding to a current monitoring event; an image acquisition module, configured to perform image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; and an image feedback module, configured to send the collected image information to the household appliances, so that the household appliances perform all-round monitoring based on the image information until the current monitoring event ends.

[0029] In a fifth aspect, the present invention provides a computer device, including: a memory and a processor, which are communicatively connected to each other. The memory stores computer instructions, and the processor executes the computer instructions to execute the home security monitoring method according to the first aspect, the second aspect or any corresponding implementation manner thereof.

[0030] In a sixth aspect, the present invention provides a computer-readable storage medium, on which computer instructions are stored. The computer instructions are used to cause a computer to execute the home security monitoring method according to the first aspect, the second aspect or any corresponding implementation manner thereof.

[0031] In a seventh aspect, the present invention provides a computer program product, including computer instructions, which are used to cause a computer to execute the home security monitoring method according to the first aspect, the second aspect or any corresponding implementation manner thereof. Description of the Drawings

[0032] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the specific embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0033] Figure 1Schematic flowchart of the home security monitoring method according to an embodiment of the present invention;

[0034] Figure 2 Schematic structural diagram of the intelligent door lock of the home security monitoring method according to an embodiment of the present invention;

[0035] Figure 3 Schematic diagram of the internal system composition of the intelligent door lock of the home security monitoring method according to an embodiment of the present invention;

[0036] Figure 4 Schematic diagram of in-warehouse and out-warehouse of the home security monitoring method according to an embodiment of the present invention;

[0037] Figure 5 Schematic flowchart of another home security monitoring method according to an embodiment of the present invention;

[0038] Figure 6 Schematic flowchart of the mode judgment of another home security monitoring method according to an embodiment of the present invention;

[0039] Figure 7 Schematic diagram of the hovering position of another home security monitoring method according to an embodiment of the present invention;

[0040] Figure 8 Schematic flowchart of yet another home security monitoring method according to an embodiment of the present invention;

[0041] Figure 9 Schematic flowchart of still another home security monitoring method according to an embodiment of the present invention;

[0042] Figure 10 Block diagram of the structure of the home security monitoring device according to an embodiment of the present invention;

[0043] Figure 11 Block diagram of the structure of another home security monitoring device according to an embodiment of the present invention;

[0044] Figure 12 Schematic diagram of the hardware structure of the computer device according to an embodiment of the present invention. Detailed implementation manners

[0045] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0046] Before using the technical solutions disclosed in the embodiments of the present disclosure, the types, usage scopes, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to users and the authorization of users should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0047] For example, when responding to an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that executes the operations of the technical solutions of the present disclosure based on the prompt message.

[0048] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving an active request from the user may be, for example, in the form of a pop-up window, and the prompt message may be presented in text in the pop-up window. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0049] It can be understood that the above process of notifying and obtaining user authorization is only illustrative and does not limit the implementation manner of the present disclosure. Other manners that meet relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0050] It can be understood that the data involved in the technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of corresponding laws and regulations and related regulations.

[0051] The above active requests from the user include but are not limited to operations such as the user touching security monitoring devices such as intelligent door locks.

[0052] The embodiments of the present invention are applicable to the scenario of combining a drone and household appliances for home security. The embodiments of the present invention provide a monitoring method for home security. By integrating the drone into the household appliance, the household appliance is used to monitor and control the drone to achieve the effect of making up for the monitoring perspective of the household appliance.

[0053] According to the embodiments of the present invention, there is provided an embodiment of a monitoring method for home security. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. And although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0054] In this embodiment, a monitoring method for home security is provided, which can be used for the above-mentioned household appliances, such as intelligent door locks, air conditioners, routers, etc. The household appliance is pre-integrated with a cabin, and a drone is deployed inside the cabin. Figure 1is a flowchart of a home security monitoring method according to an embodiment of the present invention. As Figure 1 shown, the process includes the following steps:

[0055] Step S101, obtaining an alarm signal of a preset security monitoring device for the current monitoring event.

[0056] Specifically, in an embodiment of the present invention, a cabin is deployed on a household appliance device to accommodate a drone, and the cabin is connected to the power interface of the household appliance device, so that the drone can be charged in the cabin. At the same time, in order to monitor a specific area, security monitoring devices such as cameras and sensors need to be set in the specific area, which is specifically determined according to actual monitoring requirements. In an embodiment of the present invention, the household appliance device is only a form of the cabin, and the cabin can be combined with any household appliance device. At the same time, the security monitoring device can be integrated with the household appliance device or installed independently, but it is necessary to ensure that it can communicate with the household appliance device or transmit alarm data to the drone, which is specifically determined according to actual monitoring requirements. For example, when it is necessary to monitor the vicinity of the home entrance door, the cabin can be set on the smart lock, and at the same time, a camera and a radar sensor are deployed on the smart lock to identify the people approaching the entrance door. Or when it is necessary to monitor the windows in the home, a window closing detection sensor and an unclosed alarm can be set at the window to identify the closing state of the window, and the cabin can be set on the household appliance device in the home. The above two situations are only examples and are not limited thereto.

[0057] In an alternative embodiment, taking the example of deploying the cabin and the security detection device on the smart lock at the same time, as Figure 2 shown, the smart lock has a cabin 201 for parking and loading a micro-drone; a fixed handle base 202 for fixing the smart lock to the door; a camera 203 for video monitoring of the external scene; a proximity sensing unit 204 for sensing whether someone is approaching; a password area 205 for entering the door opening password; a panel lock core hole 206 for providing mechanical door opening; and a drone 207. Among them, a processing unit is provided inside the smart lock, and the interaction control with other parts is as Figure 3 shown.

[0058] In some alternative embodiments, the cabin 201 is generally located above the lock and is used for parking and loading micro unmanned aerial vehicles (UAVs). It has a cabin cover that can automatically open and close, and the cabin cover will only open when the UAV needs to enter or exit. The cabin cover can fit well around the UAV body to avoid damage to the UAV caused by vibrations during the opening and closing of the door. The cabin base has a UAV charging system that charges the UAV as long as it is parked until the UAV battery is fully charged. At the same time, for the accurate parking of the UAV, the cabin base also has a positioning device to ensure that the UAV can be correctly inserted into the cabin parking area. The opening and closing of the UAV cabin and the start and stop of charging are all controlled by the processing unit of the intelligent lock, corresponding to Figure 3 the cabin control unit in it. The lock camera 203 is one or more cameras installed on the lock. Under normal conditions, it is in a sleep or low-power state. After the proximity sensor is triggered, it enters the monitoring or normal working state, can video monitor the external scene, capture photos or videos outside the door, and hand over the photos or videos to the processing unit of the intelligent lock, corresponding to Figure 3 the lock camera unit in it. The proximity sensor unit 204 is installed on the front surface of the lock or hidden behind the shell. It is generally ultrasonic, radar, PIR, infrared pair tubes, etc., and is used to detect whether a moving object approaches the warning range of the intelligent lock. The warning range is generally a fan-shaped area centered on the intelligent lock. In the embodiment of the present invention, the warning range is 5m. If it enters this warning range, the lock exits the low-power keep-alive state and the camera 203 starts to work, corresponding to Figure 3 the proximity sensor unit in it.

[0059] In addition, the intelligent lock further includes: a transmission unit that wirelessly connects the UAV and the lock, including image transmission and control instruction transmission. Image transmission requires transmitting high-definition videos or pictures, with a large amount of data, and control instructions only transmit control and commands, with a very small amount of data; a communication unit for connecting to the cloud platform or server for communication functions, including but not limited to connection methods such as wifi or Bluetooth, and is responsible for transmitting the pictures or videos of the processing unit to the cloud. For example, it uses wifi to connect to the router. When working, wifi and the router are in a low-power protection state; other lock units may include power supply, motor, interaction, etc., which are conventional technical means in this field and will not be elaborated here.

[0060] In the embodiment of the present invention, the processing unit of the intelligent lock may include multiple chips or multiple modules, mainly responsible for processing the control information and image information of the intelligent lock. In the embodiment of the present invention, it is composed of a low-power single-chip microcomputer and a high-performance DSP. The low-power single-chip microcomputer is used for working in the low-power sleep scenario of the lock, such as waking up the proximity sensor unit 204 and the low-power keep-alive of the router, etc. The DSP is mainly used for image processing, data packaging, protocol stack processing, etc. The DSP is in the off state under low power.

[0061] In an alternative embodiment, in practical applications, the proximity sensing unit 204 of the intelligent door lock detects whether there is anyone approaching in front of the door. Under normal circumstances, if the user returns home, the proximity sensing unit 204 can also detect someone approaching, but the user will complete the door opening operation within a certain period of time. Therefore, the unlocking time can be preset, and no alarm signal is generated for the current monitoring event within the unlocking time. For example, the unlocking time is set to 15 s, but this is not limiting. When the unlocking time is exceeded, it is determined that the person in front of the door at this time may be an unrelated person, and the proximity sensing unit 204 sends the alarm signal to the processing unit of the intelligent door lock, and the processing unit performs subsequent processing.

[0062] Step S102: Generate a monitoring instruction according to the alarm signal, and send the monitoring instruction to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal.

[0063] Specifically, in the embodiment of the present invention, after receiving the alarm signal, the processing unit generates a monitoring instruction, and sends the monitoring instruction to the drone through the transmission unit. In actual operation, the monitoring instruction can be directly sent from the intelligent door lock to the drone through the wireless connection between the drone and the intelligent door lock, or through the wireless connection between the cabin and the intelligent door lock. After the intelligent door lock sends the monitoring instruction to the cabin, the cabin forwards the monitoring instruction to the drone, which is not limited herein. After receiving the monitoring instruction, the drone flies to the first preset monitoring area corresponding to the alarm signal, and starts the camera deployed on the drone to perform image acquisition. As Figure 4 shown, the monitoring area of the intelligent door lock is within the range in front of the door. When a person approaches and triggers the alarm, the drone changes from the in-cabin state to the out-of-cabin state, and performs image acquisition on the approaching person within a certain height range of the entrance door. It can be seen that at this time, compared with the intelligent door lock, the drone has a higher monitoring perspective and can make up for the monitoring blind area of the intelligent door lock.

[0064] In some alternative embodiments, for home security monitoring, the monitoring area generally corresponds to the installation position of the security detection device. For example, if the security detection device is installed near the window to monitor the window, the monitoring area is near the window, and the drone needs to fly from the cabin to near the window for image acquisition; if the security detection device is installed in the kitchen to monitor the kitchen, the monitoring area is the kitchen, and the drone needs to fly from the cabin to the kitchen for image acquisition. The specific situation is determined according to the actual monitoring requirements, which is not limited herein.

[0065] Step S103: Obtain the image information collected by the drone, and perform omnidirectional monitoring based on the image information until the current monitoring event ends.

[0066] Specifically, in the embodiments of the present invention, after the drone performs image acquisition, it sends the image information to the processing unit of the intelligent door lock. The processing unit can then perform an all-round monitoring of the monitoring area based on the image information. For example, it can determine the intention of the approaching person through image analysis, generate an alarm signal and send it to the user mobile terminal bound to the intelligent door lock, or upload the image information to the cloud platform or server through the communication unit. The cloud platform or server performs image analysis or interacts with the user mobile terminal to provide the user with an online image information viewing function. This is only an example and is not limited thereto. During this process, the intelligent door lock, the drone, and the security monitoring device are all in an active state, continuously performing all-round monitoring of the monitoring area until the current monitoring event ends. The intelligent door lock, the drone, and the security monitoring device can then re-enter the low-power state. For example, after the approaching person moves away from the monitoring range and the proximity sensing unit 204 cannot detect the approaching person information, the alarm signal is no longer generated. Furthermore, the intelligent door lock ends the control of the drone, and through an instruction, the drone returns to the base. After the drone enters the cabin, it goes into hibernation.

[0067] The monitoring method for home security provided by the present invention, after the home appliance device obtains the alarm signal of the security monitoring device for the current monitoring event, generates a monitoring instruction and sends it to the drone, so that the drone acquires image information in the first preset monitoring area corresponding to the alarm signal, and performs all-round monitoring based on the image information until the current monitoring event ends. By integrating the drone on the home appliance device, the present invention can achieve dynamic monitoring within a certain range, avoid monitoring blind spots, improve the reliability of home security, and provide a safer home environment for users.

[0068] In this embodiment, a monitoring method for home security is provided, which can be used for the above-mentioned home appliance devices, such as intelligent door locks, air conditioners, routers, etc. The home appliance device is pre-integrated with a cabin, and a drone is deployed inside the cabin. Figure 5 It is a flowchart of a monitoring method for home security according to an embodiment of the present invention, as Figure 5 shown. The process includes the following steps:

[0069] Step S501, obtain the alarm signal of the preset security monitoring device for the current monitoring event. For details, please refer to Figure 1 Step S101 of the embodiment shown, which will not be elaborated here.

[0070] Step S502, generate a monitoring instruction according to the alarm signal, and send the monitoring instruction to the drone, so that the drone performs image acquisition in the first preset monitoring area corresponding to the alarm signal according to the monitoring instruction.

[0071] Specifically, the above step S502 includes:

[0072] Step S5021: Enter the monitoring mode based on the alarm signal, and determine whether to enter the alert mode according to the alarm signal in the monitoring mode.

[0073] Specifically, in the embodiment of the present invention, taking an intelligent door lock as an example, three modes are defined for the intelligent door lock: a monitoring mode, an alert mode, and a warning mode. After receiving the alarm signal, the intelligent door lock directly wakes up the camera deployed on the intelligent door lock, thereby entering the monitoring mode, as Figure 6 shown. For example, after the radar of the intelligent door lock is triggered, the lock is awakened, the lock camera starts to work, and the lock enters the monitoring mode. The monitoring mode is the same as the monitoring mode of an ordinary intelligent door lock. At this time, the drone is in the cabin and in a dormant state. The intelligent door lock wakes up the lock through the sensing of the proximity sensor unit to monitor the current monitoring event outside the door. After waking up, the lock camera starts to work and transmits the captured images or videos to the cloud or the server side. At the same time, in order to avoid infringing on the privacy of others, the embodiment of the present invention must ensure that the generation of the alarm signal is triggered passively. For example, a primary judgment is made on the duration of the alarm signal or the corresponding distance interval to determine that the current monitoring target is in a state of lingering in front of the door. At the same time, a monitoring warning can be issued before entering the monitoring mode to remind other people not to linger in front of the door, thereby avoiding the generation of an alarm signal due to other users passing by in front of the door. In the monitoring mode, it is judged whether the current monitoring event is upgraded according to the alarm signal, and then it is determined whether to enter the alert mode, as Figure 6 shown.

[0074] In some optional embodiments, the above step S5021 includes:

[0075] Step a1: Judge whether the current monitoring event is upgraded according to the duration of the alarm signal or the corresponding first distance interval.

[0076] Step a2: If the duration exceeds the preset time threshold, or the first distance interval is lower than the first preset distance threshold, it is determined that the current monitoring event is upgraded, and enter the alert mode.

[0077] Specifically, in the embodiment of the present invention, in the monitoring mode, it is necessary to judge whether the current monitoring event is upgraded. If it is upgraded, enter the warning mode. The lingering time of the monitoring target can be determined according to the duration of the alarm signal. If it exceeds the preset time threshold, it is determined that the current monitoring event is upgraded. For example, if the duration exceeds 5s, it proves that the monitoring target lingers for a long time, and it is determined that the current monitoring event is upgraded, and the intelligent door lock enters the alert mode. Or it can be determined whether the current monitoring event is upgraded according to whether the distance interval of the monitoring target determined by the alarm signal is lower than the preset distance threshold. For example, the distance between the monitoring target and the intelligent door lock is determined by the radar sensor. If it is lower than 2m, it proves that the monitoring target is too close, and it is determined that the current monitoring event is upgraded, and the intelligent door lock enters the warning mode.

[0078] Step S5022, if entering the warning mode, determine whether the drone is enabled.

[0079] Specifically, in the embodiment of the present invention, as Figure 6 shown, after determining to enter the warning mode, it is necessary to start the drone for dynamic monitoring. Therefore, it is necessary to determine whether the drone is currently turned on. If the drone is not turned on, the lock monitoring mode is continuously maintained until the current monitoring event ends.

[0080] Step S5023, if the drone is enabled, generate a first monitoring instruction and send the first monitoring instruction to the drone, so that the drone performs image acquisition within a first range in a first preset monitoring area according to the first monitoring instruction.

[0081] Specifically, in the embodiment of the present invention, in order to provide a stable high-angle monitoring position for the drone, a permanent magnet plate is pre-fixed on the ceiling as a suspension plate, and the specific position is installed by the user according to their own needs, and one or more can be installed. As Figure 7 shown, three suspension plates are set on the ceiling outside the door. At the same time, a suspension device is set on the drone body. After the suspension plate is adsorbed to the suspension device on the drone body, the suspension of the drone is completed, so as to serve as the hovering position of the drone. The corresponding numbers on the suspension plate are used for the suspension positioning of the drone to avoid hanging at incorrect numbered positions. After the drone is hung in place, the four touch keys around the drone suspension device will be pressed, indicating that the hanging is in place. If the drone needs to break free from the suspension, for example, when the battery is low and it needs to be charged in the cabin, at this time, by starting its own power system, it breaks free from the magnetic attraction force and completes the suspension break. In this scenario, the drone can not only be parked in the cabin, but also be suspended at the hovering position. Therefore, when calling the drone for monitoring in the warning mode, it is necessary to first determine whether the drone is currently in the cabin or at the hovering position according to the position information of the drone. In actual operation, the position of the drone can also be determined according to the induction of the cabin or the hovering position.

[0082] In some alternative embodiments, the above step S5023 includes:

[0083] Step b1, obtain the position information of the drone and determine the position where the drone is located according to the position information.

[0084] Step b2, if the drone is at the preset hovering position corresponding to the first preset monitoring area, generate a first sub-monitoring instruction and send the first sub-monitoring instruction to the drone, so that the drone performs image acquisition within a first range at the preset hovering position according to the first sub-monitoring instruction.

[0085] Step b3: If the drone is in the cabin, generate a second sub-monitoring instruction and send the second sub-monitoring instruction to the drone, so that the drone flies out of the cabin to the first preset monitoring area according to the second sub-monitoring instruction and performs image acquisition within the first range at the best monitoring perspective in the first preset monitoring area.

[0086] Specifically, in the embodiment of the present invention, the position information of the drone is obtained. If it is determined according to the position information that the drone is at the hovering position, then this position is the best monitoring perspective selected by the user. Therefore, only the first sub-monitoring instruction needs to be generated. After the first sub-monitoring instruction is sent to the drone, the drone camera is awakened and image acquisition within the first range is performed at the current hovering position. As Figure 7 shown, the drone can hang at the hovering position 1 when the battery is sufficient, and after receiving the first sub-monitoring instruction of the smart door lock, perform image acquisition at the hovering position 1. The size of the first range corresponding to different hovering positions is the same, which is the maximum monitoring range of the drone camera, but the perspectives are different.

[0087] In some alternative embodiments, as Figure 3 shown, if it is determined that the drone is currently in the cabin, a corresponding second sub-monitoring instruction is generated. After the cabin and the drone receive the second sub-monitoring instruction of the smart door lock, the cabin opens the cabin cover, the drone flies out of the cabin, and finds the best monitoring perspective within the monitoring area outside the door, so as to perform image acquisition within the second range at the best monitoring perspective. The second range at this time is the same as the first range, both of which are the maximum monitoring range of the drone camera. The best monitoring perspective can be determined in advance or determined according to the monitoring target recognized within the monitoring area, that is, to ensure that the monitoring target is at the center position of the monitoring screen, which is not limited herein.

[0088] Step S5024: In the warning mode, determine whether to enter the warning mode according to the alarm signal and the collected image information.

[0089] Specifically, in the embodiment of the present invention, if the current monitoring event has not ended in the warning mode and even the degree of danger increases, it is necessary to rise from the warning mode to the warning mode to increase the monitoring intensity and monitoring range.

[0090] In some alternative embodiments, the above step S5024 includes:

[0091] Step c1: Determine whether the current monitoring time is upgraded again according to the risk type corresponding to the alarm signal and / or the risk degree corresponding to the image information;

[0092] Step c2: If the risk type is the preset high-risk type or the risk degree is the high-risk degree, determine that the current monitoring event is upgraded again and enter the warning mode.

[0093] Specifically, in the embodiments of the present invention, it is possible to determine whether the current monitoring event is a high-risk type based on the type of the alarm signal. If it is a high-risk type, it is determined that the current monitoring event is upgraded. For example, an anti-pry switch (or vibration sensor, sound sensor, etc.) is deployed on the intelligent door lock as a security monitoring device. If the alarm signal is a signal of forced unlocking, the current monitoring event is a high-risk type, and it is necessary to determine that the current monitoring event is upgraded. Or, image analysis can be performed based on the image information collected by the drone to determine the behavior of the person, and then the risk level of the current monitoring event can be determined based on the behavior of the person. If the risk level is high, it is determined that the current monitoring event is upgraded. The above various determination methods are used to determine whether the behavior of the person approaching currently will pose a threat to the user's property safety or personal safety, and are specifically determined according to the deployed sensors, etc., which are not limited herein.

[0094] Step S5025, if entering the warning mode, generate a second monitoring instruction and send the second monitoring instruction to the drone, so that the drone performs fly-around and image acquisition within the second range in the first preset monitoring area according to the second monitoring instruction, and emits an alarm signal.

[0095] Specifically, in the embodiments of the present invention, after entering the warning mode, the processing unit generates a second monitoring instruction. After receiving the second monitoring instruction, the drone will automatically perform fly-around, orbiting, and following around the monitoring target within the monitoring area. During this process, the drone can adjust its position in real time through its own navigation system and obstacle avoidance system to maintain the best monitoring perspective on the intruder or event, so as to complete the 360-degree panoramic monitoring in front of the door and provide the user with a full-view window without dead angles. The user can observe the details of each corner of the intrusion. In addition, the second monitoring instruction includes an alarm instruction, where the alarm instruction can be automatically generated by the processing unit of the intelligent door lock or generated according to the user's remote instruction, so that the drone emits a sound and light alarm according to the alarm instruction. In practical applications, it can also be set that after receiving the second monitoring instruction, the drone automatically emits a sound and light alarm during the fly-around process, so as to deter the monitoring target and finally achieve the effect of driving it away; it can also interact with the user remotely, obtain the user's voice information and play it to drive away the monitoring target, which is not limited herein.

[0096] In some alternative embodiments, to prevent the drone from exceeding the control range or being stolen during the patrol flight, the embodiments of the present invention pre-divide the monitoring area into distance ranges to control the drone. The embodiments of the present invention divide three ranges: a normal monitoring range within the first distance range, an out-of-control-imminent range within the second distance range, and an out-of-control range within the third distance range. In practical applications, the image information is transmitted in the form of wifi, and the monitoring instructions are transmitted in the form of Bluetooth. The distance interval between the drone and the smart door lock can be determined by judging the RSSI (Received Signal Strength Indicator) of the drone's Bluetooth signal, and then, based on the distance interval and the minimum range threshold of each distance range, it can be judged whether the drone flies out of the corresponding distance range during the process of accompanying flight or orbiting flight, and whether the drone is lost. Among them, if the second distance interval is within the first distance range, the drone is within the monitoring area and can continue to perform patrol flight or orbiting flight on the monitoring module; if the second distance interval is within the second distance range, it proves that the drone is far away and is about to get out of control, so a return control signal is generated and sent to the drone to make the drone return; if the second distance interval is within the third distance range, it is determined that the drone is in the lost area, and the smart door lock processing unit generates an alarm instruction and sends the alarm instruction to the drone to make the drone send out an alarm signal according to the alarm instruction for sound and light alarm.

[0097] Step S503, obtain the image information collected by the drone, and perform omnidirectional monitoring based on the image information until the current monitoring event ends. For details, please refer to Figure 1 Step S103 of the illustrated embodiment, which will not be elaborated here.

[0098] The monitoring method for home security provided by the present invention enables the home appliance device to generate a monitoring instruction and send it to the drone after receiving the alarm signal of the security monitoring device for the current monitoring event, so that the drone can collect image information in the first preset monitoring area corresponding to the alarm signal and perform omnidirectional monitoring based on the image information until the current monitoring event ends. By integrating the drone on the home appliance device, the present invention can achieve dynamic monitoring within a certain range, avoid monitoring blind spots, improve the reliability of home security, and provide a safer home environment for users.

[0099] In this embodiment, a monitoring method for home security is provided, which can be used for the above-mentioned home appliance devices, such as smart door locks, air conditioners, routers, etc. The home appliance device is pre-integrated with a cabin, and a drone is deployed inside the cabin. Figure 8 is a flowchart of a monitoring method for home security according to an embodiment of the present invention, as Figure 8 shown, and the process includes the following steps:

[0100] Step S801: Obtain a pre-set home security task and the pre-set time interval for the home security task.

[0101] Specifically, in the embodiment of the present invention, when it is necessary to perform security monitoring on a pre-set area in the home, a home security task can be pre-set. For example, when the user is not at home, it is necessary to perform security monitoring on the kitchen at fixed intervals, obtain the image information of the kitchen, and then determine whether there is danger based on the image information. Therefore, even if no alarm signal from the security monitoring device is received, it is necessary to obtain the home security task pre-set by the user and determine the pre-set time interval for the home security task, such as 10 minutes.

[0102] Step S802: Generate a third monitoring instruction at the pre-set time interval and send the third monitoring instruction to the drone, so that the drone flies to the second pre-set monitoring area corresponding to the home security task and performs image acquisition in the second pre-set monitoring area.

[0103] Specifically, in the embodiment of the present invention, the home appliance device intermittently generates a third monitoring instruction according to the pre-set time interval. After the drone receives the third monitoring instruction, it flies to the monitoring area corresponding to the home security task to perform image acquisition. In actual operation, in order to avoid frequent flights of the drone, a hovering position can also be set in the monitoring area corresponding to the home security task. After the user leaves home, control the drone to fly and hang at the hovering position. At this time, the drone does not need to fly repeatedly, and only needs to wake up the camera to perform image acquisition after receiving the monitoring instruction. For example, the drone is hung on the second hanging board in the kitchen and captures a kitchen image every 10 minutes; performs a home security patrol every half an hour, flies around in various positions such as the living room, dining room, and kitchen, and returns to the second hanging board after completion. When there is no task, except for maintaining a low-power Bluetooth connection with the cabin, all other systems of the drone are turned off, including power, image information transmission, camera, etc.

[0104] In some optional embodiments, after the user returns home, to avoid privacy leakage, the drone flies to the first hanging board outside the door and hangs there, focusing on monitoring outside the door. Only after an event is triggered by the smart lock does it enter the state switch.

[0105] Step S803: Obtain the collected image information and send the image information to the background server, so that the background server performs a security risk analysis based on the image information.

[0106] Specifically, in the embodiment of the present invention, the image information collected by the drone is uploaded to the background server through the home appliance device or directly. The background server performs a security sub-item analysis based on the image information to determine the open fire, smoke, etc. in the kitchen, and determine whether there are abnormal situations in each room in the home, etc. Security risk analysis is a conventional technical means in this field and will not be elaborated here.

[0107] In this embodiment, a monitoring method for home security is provided, which can be used for the above-mentioned unmanned aerial vehicle (UAV). Figure 9 It is a flowchart of the monitoring method for home security according to an embodiment of the present invention, as Figure 9 shown. The process includes the following steps:

[0108] Step S901: Obtain a monitoring instruction sent by a home appliance device according to an alarm signal corresponding to a current monitoring event.

[0109] Specifically, in an embodiment of the present invention, the UAV is deployed in a cabin pre-integrated with a home appliance device. The cabin has at least the following functions: ① Charging function. The cabin has a UAV charging interface. After the UAV lands in the cabin, charging management can be performed on the UAV. In addition, in order to correctly align the charging position, the UAV cabin must have a precise positioning device. In an embodiment of the present invention, the UAV cabin uses a small-angle infrared communication method. During the process of the UAV returning to the cabin, it is initially positioned within a distance range of the cabin position through its own navigation system. Within this distance range, it makes small movements. During the movement, it judges whether it can recognize the infrared information sent by the cabin. If the infrared information is recognized, it performs precise positioning according to the infrared information, so that the UAV accurately lands in the cabin, ensuring that the UAV can be charged at the correct position. ② Communication ability, including uplink communication and downlink communication. Uplink communication is the communication with a server or the cloud, which can be connected to the server by wired or wireless means to upload UAV images, videos or other data. Downlink communication is the communication with the UAV. UAV communication can be further divided into image information transmission and control instruction transmission. Image information transmission needs to transmit video and image big data, which is only required during operation and generally uses connection methods such as wifi or 4G that can perform big data transmission. Control instruction transmission generally only transmits control instructions, with a small amount of data and the need to maintain a connection for a long time, and generally uses low-power Bluetooth and other methods. In an embodiment of the present invention, the uplink communication between the cabin and the cloud uses the form of wifi, and the downlink communication for image information transmission with the UAV uses another set of wifi, which only works when image information transmission is required. The control instruction transmission with the UAV uses the method of low-power Bluetooth to maintain a connection at all times and is also in a low-power Bluetooth connection state when there is no action.

[0110] In some alternative embodiments, the drone includes a fuselage, a power system, a flight control system, a communication system, a navigation system, an image acquisition system, etc. Among them, there is a suspension device on the top of the fuselage. After adsorbing to the suspension plate fixed on the ceiling, the drone can be suspended on the ceiling. After successful suspension, the power system of the drone is turned off. By starting the power system, the drone can break free from the suspension and enter the flight mode. In the embodiments of the present invention, there is an iron plate on the fuselage, and there are four touch buttons at the four corners of the iron plate. After being adsorbed by the square permanent magnet suspension plate above the ceiling, the four touch buttons will be pressed down, indicating successful suspension of the drone.

[0111] In some alternative embodiments, the navigation system of the drone in the embodiments of the present invention can locate the accurate landing position of the cabin and also the accurate position of the suspension plate. When positioning the suspension plate fixed on the ceiling, an image positioning method is adopted. During the process of searching for the suspension plate, the drone's camera faces the ceiling, captures the image features of the square suspension plate, and gradually approaches until successful adsorption and suspension. The image features here include the shape and number. When positioning the cabin, an infrared pair tube form is adopted. The drone first roughly locates above the cabin, and then makes a small offset until the small-angle infrared information emitted from the bottom of the locking cabin is captured and correctly analyzed by the drone, and the drone lands in the cabin.

[0112] In some alternative embodiments, the communication system of the drone in the embodiments of the present invention is divided into image information transmission and control instruction transmission. The image information transmission is connected to the cabin, transmits the image to the cabin, and the cabin processes it or uploads it to the cloud or server without processing. When image information transmission is not required, the communication system remains in a sleep power-off or other low-power mode. The control instruction transmission adopts a low-power connection method and always maintains a connection with the cabin as long as it is detached from the cabin. In the embodiments of the present invention, the drone receives the monitoring instructions sent by the home appliance device according to the alarm signal corresponding to the current monitoring event.

[0113] In some alternative embodiments, in the image acquisition system of the drone in the embodiments of the present invention, the drone realizes basic image and video acquisition through its own multi-angle rotatable camera, and can further perform human tracking, flying around an object, graphic image positioning, etc. When the drone is suspended and in a sleep state, the image information transmission is also in a power-off sleep or other low-power state.

[0114] Step S902, perform image acquisition in the first preset monitoring area corresponding to the alarm signal according to the monitoring instruction.

[0115] Specifically, the above step S902 includes:

[0116] Step S9021: Obtain the location information and send the location information to the home appliance device, so that the home appliance device determines its location based on the location information.

[0117] Specifically, in the embodiments of the present invention, four modes are defined for the drone: in - warehouse mode, flight mode, hanging sleep mode, and hanging monitoring mode. When the drone has low battery or the task is completed and it needs to return to the cabin, it enters the in - warehouse mode. Through the hanging plate fixed on the ceiling, the drone hangs itself on the ceiling. When there are no instructions or actions, except for maintaining the low - power command control keep - alive with the cabin, all systems of the drone are shut down and it enters the hanging sleep mode to save power to the greatest extent. It exits the hanging sleep mode only after receiving the command from the cabin.

[0118] In some alternative embodiments, when the home appliance device needs to call the drone for monitoring in the alert mode, the drone obtains its own location information, and the home appliance device determines the location of the drone based on the location information, that is, determines whether the drone is in the in - warehouse mode or the hanging sleep mode at this time.

[0119] Step S9022: If it is at the preset hovering position corresponding to the first preset monitoring area, receive the first sub - monitoring instruction of the home appliance device in the alert mode, and perform image acquisition within the first range at the preset hovering position according to the first sub - monitoring instruction.

[0120] Specifically, in the embodiments of the present invention, when the home appliance device determines that the drone is at the hovering position based on the drone's location and sends the first sub - monitoring instruction, the drone exits the hanging sleep mode and enters the hanging monitoring mode. The drone turns on the camera, establishes a video transmission connection with the home appliance device, and enters the hanging monitoring mode. The hovering position is the best monitoring perspective selected by the user. The drone only needs to wake up the camera and perform image acquisition within the first range at the current hovering position.

[0121] Step S9023: If it is in the cabin, receive the second sub - monitoring instruction of the home appliance device in the alert mode, and fly out of the cabin to the first preset monitoring area according to the second sub - monitoring instruction, and perform image acquisition within the first range at the best monitoring perspective within the first preset monitoring area.

[0122] Specifically, when the home appliance device determines that the drone is inside the cabin based on the drone's location and sends the second sub - monitoring instruction, the drone flies out of the cabin after receiving the second sub - monitoring instruction and flies to the designated monitoring area to monitor the corresponding scene within the monitoring area.

[0123] In some alternative embodiments, the above - mentioned step S9023 includes:

[0124] Step d1: Generate a flight instruction according to the second sub-monitoring instruction, and fly out of the cabin to the first preset monitoring area based on the flight instruction.

[0125] Step d2: Conduct monitoring target recognition within the first preset monitoring area. When the monitoring target is determined, determine the best monitoring perspective according to the monitoring target.

[0126] Step d3: Collect images within the first range based on the best monitoring perspective.

[0127] Specifically, in the embodiment of the present invention, the drone executes operations such as generating flight instructions and navigating flights according to its own power system, flight control system, navigation system, etc., flies out of the cabin to the monitoring area, and conducts monitoring target recognition through the image acquisition system, determines the best monitoring perspective, and maintains the best monitoring perspective for image acquisition. The specific process is a conventional technical means in this field and will not be elaborated here.

[0128] Step S9024: Receive the second monitoring instruction of the household appliance device in the warning mode, conduct cruise flight for the monitoring target according to the second monitoring instruction, collect images within the second range during the cruise flight, and send out an alarm signal.

[0129] Specifically, in the embodiment of the present invention, in some special scenarios, multi-angle orbiting flight or tracking flight tasks are required. Therefore, when the household appliance device determines that the current monitoring event is upgraded again and enters the warning mode, it receives the corresponding second monitoring instruction. If the drone is initially in the in-cabin mode, it determines that the home security system is triggered and invaded through the sensor alarm of the home security system. At this time, the drone takes off out of the cabin, enters the flight mode, flies to the position where the sensor alarm is triggered, and captures the video of the dynamic target. After the video is transmitted back, if the risk of the dynamic target is relatively high, in order to eliminate the risk, the drone continues to track the target for shooting or conducts orbiting flight in the flight mode based on the second sub-monitoring mode, and sends out an audible and visual alarm signal until the target leaves the warning area of the drone. After the target leaves, the drone flies back to the cabin.

[0130] In some optional embodiments, if the drone is initially in the hanging sleep mode, when it is determined that the event is upgraded and enters the hanging monitoring mode, if it is determined that the current monitoring event is upgraded again, the drone enters the flight mode from the hanging monitoring mode according to the second sub-monitoring instruction. When the event is downgraded or ends, the drone enters the hanging sleep mode.

[0131] Step S903: Send the collected image information to the household appliance device so that the household appliance device conducts all-round monitoring based on the image information until the current monitoring event ends. For details, please refer to Figure 1 Step S103 of the illustrated embodiment, which will not be elaborated here.

[0132] The monitoring method for home security provided by the present invention acquires images in a first preset monitoring area corresponding to the alarm signal through a drone after acquiring the monitoring instruction corresponding to the alarm signal, and feeds back the acquired image information to the home appliance to perform all-round monitoring until the current monitoring event ends. The present invention dynamically monitors the alarm area through a drone, can provide users with an all-round monitoring perspective, make up for the defects of fixed and limited monitoring perspectives of home appliances, improve the reliability of home security, and provide users with a safer home environment.

[0133] In this embodiment, a monitoring device for home security is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0134] This embodiment provides a home security monitoring device, which is applied to home appliances, such as Figure 10 As shown, including:

[0135] The signal acquisition module 1001 is used to obtain the alarm signal of the preset security monitoring equipment for the current monitoring event.

[0136] The drone control module 1002 is used to generate a monitoring instruction according to the alarm signal, and send the monitoring instruction to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction.

[0137] The security monitoring module 1003 is used to obtain the image information collected by the drone and perform all-round monitoring based on the image information until the current monitoring event ends.

[0138] In some optional embodiments, the drone control module 1002 includes:

[0139] The first mode determination unit is used to enter the monitoring mode based on the alarm signal, and determine whether to enter the alert mode according to the alarm signal in the monitoring mode.

[0140] The activation judgment unit is used to judge whether the drone is activated if entering the alert mode.

[0141] The first control unit is used to generate a first monitoring instruction if the drone is enabled, and send the first monitoring instruction to the drone, so that the drone collects images within a first range in a first preset monitoring area according to the first monitoring instruction.

[0142] A second mode determination unit, configured to determine whether to enter a warning mode according to an alarm signal and the acquired image information in a warning mode.

[0143] A second control unit, configured to, if entering the warning mode, generate a second monitoring instruction and send the second monitoring instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle performs flight patrol and image acquisition within a second range according to the second monitoring instruction in a first preset monitoring area, and issue an alarm signal, where the second range is greater than the first range.

[0144] In some alternative embodiments, the first mode determination unit includes:

[0145] A first upgrade determination subunit, configured to determine whether the current monitoring event is upgraded according to the duration of the alarm signal or the corresponding first distance interval.

[0146] A first mode determination subunit, configured to, if the duration exceeds a preset time threshold or the first distance interval is lower than a first preset distance threshold, determine that the current monitoring event is upgraded and enter the warning mode.

[0147] In some alternative embodiments, the first control unit includes:

[0148] A position determination subunit, configured to obtain the position information of the unmanned aerial vehicle and determine the position where the unmanned aerial vehicle is located according to the position information.

[0149] A first image acquisition control subunit, configured to, if the unmanned aerial vehicle is at a preset hovering position corresponding to the first preset monitoring area, generate a first sub-monitoring instruction and send the first sub-monitoring instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle performs image acquisition within a first range at the preset hovering position according to the first sub-monitoring instruction.

[0150] A second image acquisition control subunit, configured to, if the unmanned aerial vehicle is in the cabin, generate a second sub-monitoring instruction and send the second sub-monitoring instruction to the unmanned aerial vehicle, so that the unmanned aerial vehicle flies out of the cabin to the first preset monitoring area and performs image acquisition within a first range at the best monitoring perspective within the first preset monitoring area according to the second sub-monitoring instruction.

[0151] In some alternative embodiments, the second mode determination unit includes:

[0152] A second upgrade determination subunit, configured to determine whether the current monitoring time is upgraded again according to the risk type corresponding to the alarm signal and / or the risk level corresponding to the image information.

[0153] A second mode determination subunit, configured to, if the risk type is a preset high-risk type or the risk level is a high-risk level, determine that the current monitoring event is upgraded again and enter the warning mode.

[0154] In some alternative embodiments, the device further includes: a drone protection module, configured to obtain a wireless signal emitted by the drone, and determine a second distance interval between the drone and the home appliance device according to the strength of the wireless signal; determine the distance range in which the second distance interval is located, where the distance ranges are, from small to large, a first distance range, a second distance range, and a third distance range; if the second distance interval is within the first distance range, determine that the drone is in the monitoring area; if the second distance interval is within the second distance range, generate a return control signal and send the return control signal to the drone to cause the drone to return; if the second distance interval is within the third distance range, determine that the drone is in the lost area, generate an alarm instruction, and send the alarm instruction to the drone to cause the drone to emit an alarm signal according to the alarm instruction.

[0155] In some alternative embodiments, the device further includes: a home protection task execution module, configured to obtain a preset home security task and a preset time interval for the home security task; generate a third monitoring instruction at the preset time interval and send the third monitoring instruction to the drone to cause the drone to fly to a second preset monitoring area corresponding to the home security task and perform image acquisition in the second preset monitoring area; obtain the acquired image information and send the image information to the background server to enable the background server to perform security risk analysis based on the image information.

[0156] This embodiment further provides a monitoring device for home security, which is applied to a drone, as Figure 11 shown, and includes:

[0157] An instruction acquisition module 1101, configured to obtain a monitoring instruction issued by a home appliance device according to an alarm signal corresponding to a current monitoring event.

[0158] An image acquisition module 1102, configured to perform image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction.

[0159] An image feedback module 1103, configured to send the acquired image information to the home appliance device to enable the home appliance device to perform omnidirectional monitoring based on the image information until the current monitoring event ends.

[0160] In some alternative embodiments, the image acquisition module 1102 includes:

[0161] A location information acquisition unit, configured to acquire location information and send the location information to the home appliance device to enable the home appliance device to determine its location according to the location information.

[0162] The first image acquisition unit is configured to, if it is at a preset hovering position corresponding to a first preset monitoring area, receive a first sub-monitoring instruction of a household appliance device in a warning mode, and perform image acquisition within a first range at the preset hovering position according to the first sub-monitoring instruction.

[0163] The second image acquisition unit is configured to, if it is in the cabin, receive a second sub-monitoring instruction of the household appliance device in the warning mode, and fly out of the cabin to the first preset monitoring area according to the second sub-monitoring instruction, and perform image acquisition within a first range at the best monitoring perspective within the first preset monitoring area.

[0164] The third image acquisition unit is configured to receive a second monitoring instruction of the household appliance device in a warning mode, perform cruising flight on a monitoring target according to the second monitoring instruction, perform image acquisition within a second range during the cruising flight, and emit an alarm signal.

[0165] In some alternative embodiments, the second image acquisition unit includes:

[0166] A flight control sub-unit, configured to generate a flight instruction according to the second sub-monitoring instruction, and fly out of the cabin to the first preset monitoring area based on the flight instruction.

[0167] A target recognition sub-unit, configured to perform monitoring target recognition within the first preset monitoring area, and when a monitoring target is determined, determine the best monitoring perspective according to the monitoring target;

[0168] An image acquisition sub-unit, configured to perform image acquisition within a first range based on the best monitoring perspective.

[0169] In some alternative embodiments, the device further includes: a return control module, configured to perform navigation flight according to a preset position of the cabin until it reaches within a preset distance range of the preset position; move within the preset distance range, and determine whether infrared information emitted by the cabin is recognized during the movement; if the infrared information is recognized, fly into the cabin according to the infrared information.

[0170] The further function descriptions of the above-mentioned various modules and units are the same as those in the corresponding above-mentioned embodiments, and will not be elaborated here.

[0171] The monitoring device for home security in this embodiment is presented in the form of functional units. Here, the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and a memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.

[0172] The embodiment of the present invention further provides a computer device having the above Figure 10 orFigure 11 The monitoring device for home security as shown

[0173] Please refer to Figure 12 , Figure 12 which is a schematic structural diagram of a computer device provided by an alternative embodiment of the present invention. As Figure 12 shown, the computer device includes: one or more processors 10, a memory 20, and an interface for connecting each component, including a high-speed interface and a low-speed interface. Each component communicates with each other using different buses and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed within the computer device, including instructions stored in the memory or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some alternative embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a set of blade servers, or a multi-processor system). Figure 12 In

[0174]

[0175]

[0176]

[0177] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiments. The memory 20 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the computer device. In addition, the memory 20 can include a high-speed random access memory and can also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 20 can optionally include a memory remotely set relative to the processor 10, and these remote memories can be connected to the computer device through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and their combinations.

[0177] The memory 20 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, hard disk or solid state drive; the memory 20 may further include a combination of the above types of memory.

[0178] The computer device further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected through a bus or other means. Figure 12 Taking connection through the bus as an example.

[0179] The input device 30 can receive input digital or character information, and generate key signal inputs related to the user settings and function controls of the computer device, such as touch screens, keypads, mice, trackpads, touchpads, pointing sticks, one or more mouse buttons, trackballs, joysticks, etc. The output device 40 may include display devices, auxiliary lighting devices (such as LEDs), and tactile feedback devices (such as vibrating motors), etc. The above display devices include but are not limited to liquid crystal displays, light emitting diodes, displays, and plasma displays. In some alternative embodiments, the display device may be a touch screen.

[0180] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented by downloading through a network and originally stored in a remote storage medium or a non-transitory machine-readable storage medium and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid state drive, etc.; further, the storage medium can also include a combination of the above types of memory. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, the processor, or the hardware, the method shown in the above embodiment is implemented.

[0181] A part of the present invention can be applied as a computer program product, such as computer program instructions, which, when executed by a computer, can invoke or provide the methods and / or technical solutions according to the present invention through the operations of the computer. Those skilled in the art should understand that the forms in which computer program instructions exist in a computer-readable medium include but are not limited to source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include but are not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Herein, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible by the computer.

[0182] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall within the scope defined by the appended claims.

Claims

1. A monitoring method for home security, applied to household appliances, characterized in that, The household electrical appliance device is pre-integrated with a cabin, and a drone is deployed inside the cabin. The method includes: Obtaining an alarm signal of a preset security monitoring device for a current monitoring event; Generating a monitoring instruction according to the alarm signal, and sending the monitoring instruction to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; Obtaining the image information collected by the drone, and performing omnidirectional monitoring based on the image information until the current monitoring event ends.

2. The method according to claim 1, wherein The generating a monitoring instruction according to the alarm signal, and sending the monitoring instruction to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction includes: Entering a monitoring mode based on the alarm signal, and determining whether to enter a warning mode according to the alarm signal in the monitoring mode; If entering the warning mode, determining whether the drone is enabled; If the drone is enabled, generating a first monitoring instruction, and sending the first monitoring instruction to the drone, so that the drone performs image acquisition within a first range in the first preset monitoring area according to the first monitoring instruction; Determining whether to enter a warning mode according to the alarm signal and the collected image information in the warning mode; If entering the warning mode, generating a second monitoring instruction, and sending the second monitoring instruction to the drone, so that the drone performs fly-around and image acquisition within a second range in the first preset monitoring area according to the second monitoring instruction, and emits an alarm signal, where the second range is larger than the first range.

3. The method according to claim 2, wherein The generating a first monitoring instruction, and sending the first monitoring instruction to the drone, so that the drone performs image acquisition within a first range in the first preset monitoring area according to the first monitoring instruction includes: Obtaining the position information of the drone, and determining the position where the drone is located according to the position information; If the drone is at a preset hovering position corresponding to the first preset monitoring area, generating a first sub-monitoring instruction, and sending the first sub-monitoring instruction to the drone, so that the drone performs image acquisition within the first range at the preset hovering position according to the first sub-monitoring instruction; If the drone is in the cabin, generating a second sub-monitoring instruction, and sending the second sub-monitoring instruction to the drone, so that the drone flies out of the cabin to the first preset monitoring area according to the second sub-monitoring instruction, and performs image acquisition within the first range at the best monitoring perspective in the first preset monitoring area.

4. The method according to claim 2, wherein The determining whether to enter a warning mode according to the alarm signal includes: Determining whether the current monitoring event is upgraded according to the duration of the alarm signal or a corresponding first distance interval; If the duration exceeds a preset time threshold, or the first distance interval is lower than a first preset distance threshold, determining that the current monitoring event is upgraded, and entering the warning mode; Determining whether to enter the warning mode based on the alarm signal and the acquired image information includes: Judging whether the current monitoring time is upgraded again according to the risk type corresponding to the alarm signal and / or the risk level corresponding to the image information; If the risk type is a preset high-risk type or the risk level is a high-risk level, it is determined that the current monitoring event is upgraded again and the warning mode is entered.

5. The method according to claim 1, characterized in that, During the omnidirectional monitoring process, it also includes: Obtaining the wireless signal sent by the drone and determining the second distance interval between the drone and the home appliance device according to the intensity of the wireless signal; Judging the distance range where the second distance interval is located, where the distance ranges are, from small to large, the first distance range, the second distance range, and the third distance range in sequence; If the second distance interval is within the first distance range, it is determined that the drone is in the monitoring area; If the second distance interval is within the second distance range, a return control signal is generated and sent to the drone to make the drone return; If the second distance interval is within the third distance range, it is determined that the drone is in the lost area, an alarm instruction is generated and sent to the drone to make the drone send an alarm signal according to the alarm instruction.

6. The method according to claim 1, characterized in that, When judging whether to receive the alarm signal of the security monitoring device, it also includes: Obtaining the preset home security task and the preset time interval of the home security task; Generating a third monitoring instruction according to the preset time interval and sending the third monitoring instruction to the drone to make the drone fly to the second preset monitoring area corresponding to the home security task and perform image acquisition in the second preset monitoring area; Obtaining the acquired image information and sending the image information to the background server to enable the background server to perform security risk analysis according to the image information.

7. A monitoring method for home security, applied to an unmanned aerial vehicle, characterized in that, The drone is deployed in the cabin pre-integrated with the home appliance device, and the method includes: Obtaining the monitoring instruction sent by the home appliance device according to the alarm signal corresponding to the current monitoring event; Performing image acquisition in the first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; Sending the acquired image information to the home appliance device to enable the home appliance device to perform omnidirectional monitoring based on the image information until the current monitoring event ends.

8. The method according to claim 7, wherein Performing image acquisition in the first preset monitoring area according to the monitoring instruction includes: Obtaining the position information and sending the position information to the home appliance device to enable the home appliance device to determine its location according to the position information; If at the preset hovering position corresponding to the first preset monitoring area, receiving the first sub-monitoring instruction of the home appliance device in the warning mode and performing image acquisition within a first range at the preset hovering position; If in the cabin, receive the second sub-monitoring instruction of the home appliance device in the warning mode, and fly out of the cabin to the first preset monitoring area according to the second sub-monitoring instruction, and perform image acquisition within a first range at the best monitoring angle in the first preset monitoring area.

9. The method according to claim 8, wherein The flying out of the cabin to the first preset monitoring area according to the second sub-monitoring instruction and performing image acquisition within a first range at the best monitoring angle in the first preset monitoring area includes: Generate a flight instruction according to the second sub-monitoring instruction, and fly out of the cabin to the first preset monitoring area based on the flight instruction; Perform monitoring target recognition in the first preset monitoring area, and when the monitoring target is determined, determine the best monitoring angle according to the monitoring target; Perform image acquisition within a first range based on the best monitoring angle.

10. The method according to claim 9, wherein The performing image acquisition in the first preset monitoring area corresponding to the alarm signal according to the monitoring instruction further includes: Receive the second monitoring instruction of the home appliance device in the warning mode, perform cruising flight on the monitoring target according to the second monitoring instruction, perform image acquisition within a second range during the cruising flight, and send out an alarm signal.

11. The method according to claim 7, wherein After receiving the return control signal of the home appliance device, it further includes: Perform navigation flight according to the preset position of the cabin until within the preset distance range of the preset position; Move within the preset distance range, and determine whether to recognize the infrared information emitted by the cabin during the movement; If the infrared information is recognized, fly into the cabin according to the infrared information.

12. A monitoring device for home security, which is applied to household appliances, is characterized in that The home appliance device is pre-integrated with a cabin, and a drone is deployed inside the cabin. The device includes: A signal acquisition module, configured to acquire an alarm signal of a preset security monitoring device for a current monitoring event; A drone control module, configured to generate a monitoring instruction according to the alarm signal and send the monitoring instruction to the drone, so that the drone performs image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; A security monitoring module, configured to acquire the image information acquired by the drone and perform omni-directional monitoring based on the image information until the current monitoring event ends.

13. A monitoring device for home security, applied to a drone, characterized in that, The drone is deployed inside a cabin pre-integrated with a home appliance device. The device includes: An instruction acquisition module, configured to acquire a monitoring instruction sent by the home appliance device according to an alarm signal corresponding to a current monitoring event; An image acquisition module, configured to perform image acquisition in a first preset monitoring area corresponding to the alarm signal according to the monitoring instruction; An image feedback module, configured to send the acquired image information to the home appliance device, so that the home appliance device performs omni-directional monitoring based on the image information until the current monitoring event ends.

14. A computer device, characterized in that, Including: A memory and a processor, which are communicatively connected to each other. Computer instructions are stored in the memory, and the processor executes the computer instructions to execute the home security monitoring method according to any one of claims 1 to 6, or the home security monitoring method according to any one of claims 7 to 11.

15. A computer-readable storage medium, characterized in that, Computer instructions are stored on the computer-readable storage medium, and the computer instructions are used to cause a computer to execute the home security monitoring method according to any one of claims 1 to 6, or the home security monitoring method according to any one of claims 7 to 11.

16. A computer program product, characterized in that, It includes computer instructions, and the computer instructions are used to cause a computer to execute the home security monitoring method according to any one of claims 1 to 6, or the home security monitoring method according to any one of claims 7 to 11.

Images