Control Method and Related Devices of Smart Lock

Abstract

The embodiments of the present application provide a control method and related devices for an intelligent lock, which relate to the fields of cloud technology and intelligent lock technology. When the method is applied to a cloud platform, it specifically includes: obtaining a target event; if it is determined based on historical monitoring data and / or preset triggering conditions that target monitoring information related to the target event needs to be collected, an information collection instruction is issued to instruct the information collection module of the intelligent lock to collect the target monitoring information. The implementation of the present application can evaluate whether it is necessary to trigger the collection of monitoring information when a target event occurs, realizing the dynamic control of the information collection operation of the intelligent lock, effectively improving the effectiveness of the information collection result, and also reducing the power consumption of the intelligent lock to a certain extent.

Description

Technical Field

[0001] The present application relates to the fields of cloud technology and smart lock technology. Specifically, the present application relates to a smart lock control method and related equipment. Background Art

[0002] Currently, smart locks with peephole sensors can set snapshot events. For example, when the lock is triggered by a set event, the peephole sensor will capture an image outside the door. However, this operation is very mechanical. Once the smart lock detects the corresponding event, it immediately triggers a snapshot, resulting in low snapshot effectiveness and high power consumption of the smart lock. Summary of the Invention

[0003] In order to solve at least one of the above technical problems, the present application provides a control method and related equipment for a smart lock. The technical solution is as follows:

[0004] In a first aspect, an embodiment of the present application provides a method for controlling a smart lock, comprising:

[0005] Get the target event;

[0006] If it is determined to collect target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions, an information collection instruction is issued to instruct the information collection module of the smart lock to collect the target monitoring information.

[0007] In a feasible embodiment, determining to collect target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions includes at least one of the following:

[0008] If the number of historical collections corresponding to the target event in the historical monitoring data of the current time period is less than the first trigger number in the trigger condition, determining to collect target monitoring information related to the target event;

[0009] If the number of historical collections corresponding to the target event in the historical monitoring data of the current time period is greater than or equal to the second trigger number in the trigger condition, then when it is determined that the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than a preset similarity threshold, it is determined to collect the target monitoring information related to the target event;

[0010] If the target event is a trigger event indicated in the trigger condition, determining to collect target monitoring information related to the target event;

[0011] If the historical monitoring information collected based on the target event in the historical monitoring data of the current time period indicates that a non-preset target object exists, determining to collect target monitoring information related to the target event;

[0012] If the target event is different from the historical event obtained from the historical monitoring data in the previous time period, determine to collect target monitoring information related to the target event.

[0013] In a feasible embodiment, the historical monitoring information includes at least one of image information, video information, and audio information;

[0014] When determining that the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than a preset similarity threshold, determining to collect target monitoring information related to the target event includes:

[0015] Judge whether a preset temporary collection condition is met; the temporary collection condition is that the historical monitoring information collected based on the target event in the historical monitoring data of the current time period only includes audio information;

[0016] If so, determine to collect target monitoring information related to the target event;

[0017] If not, instruct the information collection module of the intelligent lock to collect the current image information, calculate the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period, and if the similarity is less than the preset similarity threshold, determine to collect target monitoring information related to the target event.

[0018] In a feasible embodiment, calculating the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period includes at least one of the following:

[0019] Obtain the first monitoring information collected based on the target event in the historical monitoring data of the current time period; calculate the similarity between the current image information and the first monitoring information; the first monitoring information is the image information or video information with the closest collection time to the collection time of the current image information;

[0020] Obtain each second monitoring information collected based on the target event in the historical monitoring data of the current time period; calculate the similarity between the current image information and each second monitoring information, and use the similarity with the smallest threshold as the similarity between the current image information and the historical monitoring information; the second monitoring information includes at least one of image information and video information.

[0021] In a feasible embodiment, the target monitoring information includes at least one of image information, video information, and audio information;

[0022] The step of sending an information collection instruction includes at least one of the following:

[0023] Obtain the remaining storage space currently. If the storage space is less than a preset space threshold, send an information collection instruction to collect image information; otherwise, send an information collection instruction to collect video information and / or audio information;

[0024] Obtain the remaining power of the intelligent lock. If the remaining power is less than a first power threshold, send an information collection instruction to collect image information; otherwise, send an information collection instruction to collect video information and / or audio information;

[0025] If the target event indicates an abnormal monitoring, send an information collection instruction to collect video information;

[0026] Based on a preset mapping relationship between events and the collected information, send an information collection instruction to collect monitoring information corresponding to the target event.

[0027] In a feasible embodiment, the step of determining to collect target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions further includes:

[0028] Predict the effective probability of collecting target monitoring information for the target event through a pre-trained prediction model; if the effective probability is greater than a preset probability threshold, determine to collect target monitoring information related to the target event;

[0029] Wherein, the training of the prediction model includes:

[0030] If the cumulative number of events obtained in the historical monitoring data reaches a preset cumulative threshold or the current time reaches the model cycle update time, obtain training data; the training data includes historical monitoring data and training labels corresponding to the historical monitoring information in the historical monitoring data, and the training labels are determined based on the user's operations on the historical monitoring information;

[0031] Optimize the network parameters of the prediction model based on the training data;

[0032] Wherein, determining the training labels based on the user's operations on the historical monitoring information includes:

[0033] If the user performs a deletion operation on the historical monitoring information, use an invalid label to identify the corresponding historical monitoring information;

[0034] If the user performs a download or retention operation on the historical monitoring information, use a valid label to identify the corresponding historical monitoring information.

[0035] In a second aspect, an embodiment of the present application provides a control method for an intelligent lock, including:

[0036] In response to a triggering operation of an event, transmitting a target event corresponding to the triggering operation;

[0037] receiving an information collection instruction, wherein the information collection instruction is issued when it is determined based on historical monitoring data and / or a preset trigger condition to collect target monitoring information related to the target event;

[0038] The target monitoring information corresponding to the information collection instruction is collected through the information collection module.

[0039] In a feasible embodiment, the information acquisition module includes at least one of a camera unit and a voice unit;

[0040] The collecting of target monitoring information corresponding to the information collection instruction by the information collection module includes at least one of the following:

[0041] If the information collection instruction indicates collecting image information, capturing an image by a camera unit;

[0042] If the information collection instruction indicates to collect video information, recording is performed by the camera unit until a recording stop condition is met;

[0043] If the information collection instruction indicates collecting audio information, recording is performed through the voice unit until a recording stop condition is met;

[0044] If the information collection instruction does not indicate the type of information to be collected, the current remaining power is obtained; if the remaining power is less than a second power threshold, the collection of target monitoring information is suspended and an alarm prompt message is sent to the user; if the remaining power is greater than or equal to the second power threshold and less than a third power threshold, an image is captured by the camera unit; if the remaining power is greater than or equal to the third power threshold, video is recorded by the camera unit until a video recording stop condition is met and / or audio is recorded by the voice unit until a recording stop condition is met;

[0045] Among them, the recording stop conditions include at least one of reaching a preset recording time, recognizing at least one face, and releasing the alarm; the recording stop conditions include at least one of reaching a preset recording time, recognizing a preset keyword, and releasing the alarm.

[0046] In a feasible embodiment, after acquiring the target monitoring information, at least one of the following items is further included:

[0047] Uploading the target monitoring information to generate a monitoring log;

[0048] The target monitoring information is sent to the client bound to the smart lock.

[0049] In a third aspect, an embodiment of the present application provides a control device for an intelligent lock, including:

[0050] An acquisition module, which acquires a target event;

[0051] A determination module, if it determines to collect target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions, then issues an information collection instruction to instruct the collection of the target monitoring information through the information collection module of the intelligent lock;

[0052] Or,

[0053] A transmission module, which is used to transmit a target event corresponding to the trigger operation in response to the trigger operation of the event;

[0054] A receiving module, which is used to receive the information collection instruction, and the information collection instruction is issued when it is determined to collect target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions;

[0055] An acquisition module, which is used to collect target monitoring information corresponding to the information collection instruction through the information collection module.

[0056] In a fourth aspect, an embodiment of the present application provides an intelligent lock, including:

[0057] A door lock main body installed on the door;

[0058] An information collection module, which is connected to the door lock main body and is used to collect monitoring information;

[0059] A data transmission module, which is used to transmit events and the monitoring information collected by the information collection module;

[0060] A control module, which is connected to the information collection module and the data transmission module, and is configured to execute the steps of the control method of the intelligent lock provided in any embodiment of the first aspect or the second aspect above.

[0061] In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored on the memory, and the processor executes the computer program to implement the steps of the control method of the intelligent lock provided in the first aspect and any of its embodiments above.

[0062] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the control method of the intelligent lock provided in any embodiment of the first aspect or the second aspect above.

[0063] The beneficial effects brought by the technical solutions provided by the embodiments of the present application are:

[0064] The embodiments of the present application provide a control method for an intelligent lock, which can be applied to a cloud platform or an intelligent lock; specifically, after obtaining a target event, it is possible to determine whether to collect monitoring information for the target event based on historical monitoring data and / or preset trigger conditions, and only issue an information collection instruction to instruct the information collection module of the intelligent lock to collect target monitoring information related to the target event when it is determined that monitoring information needs to be collected. The implementation of the solution of the present application can evaluate whether to trigger the collection of monitoring information when a target event occurs, realize the dynamic control of the information collection operation of the intelligent lock, effectively improve the effectiveness of the information collection result, and also reduce the power consumption of the intelligent lock to a certain extent.

[0065] The embodiments of the present application also provide a control method for an intelligent lock, which is applied to the intelligent lock; specifically, when the intelligent lock senses the trigger of a specific event, it can transmit the target event corresponding to the trigger operation, and only when receiving the information collection instruction, collect the corresponding target monitoring information through the information collection module. The implementation of the present application can dynamically control the operation of the intelligent lock to collect information after sensing the occurrence of a specific event. Compared with the prior art where information collection is necessarily performed for each specific event, the implementation of the present application enables the intelligent lock to collect target monitoring information through the information collection module only when it is determined to be necessary, and the intelligent lock does not need to give feedback for the target event when it is not necessary. The implementation of the solution of the present application can effectively improve the effectiveness of the information collection result while effectively reducing the power consumption of the intelligent lock. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description in the embodiments of the present application.

[0067] Figure 1 It is a schematic flowchart of a control method for an intelligent lock provided by an embodiment of the present application;

[0068] Figure 2 It is a schematic flowchart of another control method for an intelligent lock provided by an embodiment of the present application;

[0069] Figure 3 It is a schematic diagram of an operation architecture provided by an embodiment of the present application;

[0070] Figure 4 It is a timing diagram provided by an embodiment of the present application;

[0071] Figure 5 It is a schematic diagram of an interface for displaying monitoring logs provided by an embodiment of the present application;

[0072] Figure 6 It is a schematic diagram of the structure of a control device for an intelligent lock provided by an embodiment of the present application;

[0073] Figure 7 It is a schematic structural diagram of another control device of an intelligent lock provided by an embodiment of the present application;

[0074] Figure 8 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application. Specific embodiments

[0075] The embodiments of the present application will be described below with reference to the accompanying drawings in the present application. It should be understood that the embodiments described below in conjunction with the drawings are exemplary descriptions for explaining the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions of the embodiments of the present application.

[0076] Those skilled in the art of the present technology can understand that unless specifically stated otherwise, the singular forms "a", "an", "the" and "said" used herein may also include the plural forms. It should be further understood that the terms "including" and "comprising" used in the embodiments of the present application mean that the corresponding features can be implemented as the displayed features, information, data, steps, operations, elements and / or components, but do not exclude being implemented as other features, information, data, steps, operations, elements, components and / or their combinations supported by the art of the present technology. It should be understood that when we say an element is "connected" or "coupled" to another element, the one element can be directly connected or coupled to the other element, or it can mean that the one element and the other element establish a connection relationship through an intermediate element. In addition, the "connection" or "coupling" used here can include wireless connection or wireless coupling. The term "and / or" used here indicates at least one of the items defined by the term, for example, "A and / or B" can be implemented as "A", or implemented as "B", or implemented as "A and B".

[0077] To make the purpose, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0078] The technical solutions of the embodiments of the present application and the technical effects produced by the technical solutions of the present application will be described below through the description of several exemplary embodiments. It should be noted that the following embodiments can be referenced, learned from or combined with each other, and the same terms, similar features and similar implementation steps in different embodiments will not be described repeatedly.

[0079] Figure 3 It is a schematic operation architecture diagram of a control method for an intelligent lock provided by an embodiment of the present application. In this architecture, it may include a terminal 20, a cloud platform 10, and an intelligent lock 30.

[0080] Among them, the terminal may include any terminal 20 that runs the client. The terminal (which may also be referred to as a device) may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart voice interaction device (such as a smart speaker), a wearable electronic device (such as a smart watch), a vehicle-mounted terminal, a smart home appliance (such as a smart TV), an AR / VR device, etc., but is not limited thereto.

[0081] Among them, the cloud platform 10 may be related to cloud computing and cloud storage.

[0082] Specifically, cloud computing is a computing model that distributes computing tasks across a resource pool composed of a large number of computing devices, enabling various application systems to obtain computing power, storage space, and information services as needed. The network that provides resources is called the "cloud". The resources in the "cloud" seem to be infinitely expandable to users, and can be obtained at any time, used on demand, expanded at any time, and paid according to usage. As a basic capability provider of cloud computing, a cloud computing resource pool (abbreviated as a cloud platform, generally referred to as an IaaS (Infrastructure as a Service) platform) will be established, and various types of virtual resources will be deployed in the resource pool for external customers to select and use. The cloud computing resource pool mainly includes: computing devices (virtual machines, including operating systems), storage devices, and network devices. According to logical function division, a PaaS (Platform as a Service) layer can be deployed on the IaaS (Infrastructure as a Service) layer, and a SaaS (Software as a Service) layer can be deployed on top of the PaaS layer. The SaaS layer can also be directly deployed on the IaaS. PaaS is a platform for software operation, such as databases, web containers, etc. SaaS is various business software, such as web portals, SMS mass senders, etc. Generally speaking, SaaS and PaaS are upper layers relative to IaaS.

[0083] Specifically, cloud storage is a new concept extended and developed from the concept of cloud computing. A distributed cloud storage system (hereinafter referred to as the storage system) refers to a storage system that combines a large number of different types of storage devices (storage devices are also called storage nodes) in the network through functions such as cluster applications, grid technology, and distributed file systems, and works collaboratively through application software or application interfaces to jointly provide data storage and service access functions to the outside world. Currently, the storage method of the storage system is as follows: create a logical volume. When creating a logical volume, physical storage space is allocated for each logical volume. This physical storage space may be composed of the disks of a certain storage device or several storage devices. The client stores data on a certain logical volume, that is, stores the data on the file system. The file system divides the data into many parts, and each part is an object. The object not only contains data but also additional information such as a data identifier (ID, ID entity). The file system writes each object into the physical storage space of the logical volume respectively, and the file system will record the storage location information of each object. Thus, when the client requests to access the data, the file system can enable the client to access the data according to the storage location information of each object. The process of the storage system allocating physical storage space for the logical volume is specifically as follows: according to the capacity estimation of the objects stored in the logical volume (this estimation often has a large margin relative to the actual capacity of the objects to be stored) and the group of the redundant array of independent disks (RAID), the physical storage space is pre-divided into stripes. A logical volume can be understood as a stripe, thereby allocating physical storage space for the logical volume.

[0084] In the embodiment of the present application, resources for collecting monitoring information by providing a dynamic control smart lock can be provided through cloud computing technology, and the monitoring information can be stored through cloud storage technology.

[0085] Among them, the smart lock 30 can be a device provided with a door lock body, an information collection module, a data transmission module, and a control module (such as a functional module carrying an MCU, etc.). Specifically, the information collection module can include at least one of a camera unit and a voice unit. Among them, the camera unit can be a cat's eye module integrated with the door lock body or a distributed cat's eye device.

[0086] In a feasible embodiment, the terminal 20, the cloud platform 10, and the smart lock 30 can be directly or indirectly connected through a wired or wireless communication method, such as communicating through the network 40. The present application does not limit this here.

[0087] The following combines Figure 1 and Figure 4, a specific description of the control method for the intelligent lock in the embodiments of the present application will be given. It can be understood that this method can be applied to a cloud platform or an intelligent lock; when applied to a cloud platform, the target event is sensed by the intelligent lock and transmitted to the cloud platform, and the cloud platform dynamically evaluates whether to collect monitoring information when receiving the target event; when applied to an intelligent lock, when the intelligent lock detects the occurrence of a target event, it dynamically evaluates whether to collect monitoring information through its own control module. To better illustrate the various feasible examples of the present application, the following will be combined with Figure 1 An example where the execution subject is a cloud platform will be described.

[0088] Specifically, as Figure 1 shown, the method includes the following steps S101 - step S102:

[0089] Step S101: Obtain a target event.

[0090] Step S102: If it is determined based on historical monitoring data and / or preset trigger conditions to collect target monitoring information related to the target event, an information collection instruction is issued to instruct the information collection module of the intelligent lock to collect the target monitoring information.

[0091] Among them, the target event refers to an event that can be sensed or triggered by the intelligent lock, and this event can be set by developers or user-defined. For example, developers can set that "ringing the doorbell" belongs to the target event that can trigger the intelligent lock to transmit events. Optionally, the target events include ringing the doorbell, events related to alarms, etc.; events related to alarms can include hijacking alarms, prying alarms, arming alarms, etc. When the intelligent lock is triggered by the target event, the intelligent lock can transmit the relevant information of the target event to the cloud platform.

[0092] Specifically, when the cloud platform receives the target event reported by the intelligent lock, it will obtain the historical monitoring data and / or preset trigger conditions related to the intelligent lock, determine whether to collect the target monitoring information related to the target event, and when it is determined that the target monitoring information needs to be collected, an information collection instruction is sent to the intelligent lock, and the intelligent lock collects the target monitoring information when receiving the information collection instruction.

[0093] Among them, the historical monitoring data is the historical data stored before the current target event, and this data can include the information of the intelligent lock operating based on the target event, such as the specific event transmitted, the number of times of obtaining the target event, whether to specifically collect monitoring information, the number of times of collecting monitoring information, etc.

[0094] Among them, the preset trigger conditions can be set by developers or user-defined. For example, the trigger condition can be to collect monitoring information only once for the same event within a certain time interval, etc.

[0095] Among them, the monitoring information may include multimedia information such as images, videos, and audios. The cloud platform can indicate which type of monitoring information the intelligent lock should collect by sending information collection instructions, or the intelligent lock can determine which type of monitoring information to collect after receiving the information collection instructions.

[0096] Before the implementation of this application, the user can perform network configuration operations on the intelligent lock through the client and register the intelligent lock to the cloud platform, and then manage the intelligent lock through the cloud platform. The operation of network configuration of the intelligent lock can refer to the related technologies, and this application does not limit this.

[0097] In the embodiments of this application, the management of dynamic collection of monitoring information when the intelligent lock is triggered by a set event can be combined with the cloud platform, or the intelligent lock itself can perform dynamic control; compared with the prior art, in the embodiments of this application, after the intelligent lock is triggered by a target event, it first judges whether it is necessary to collect the corresponding monitoring information. If necessary, the intelligent lock can collect the target monitoring information through the information collection module. If not, the intelligent lock does not need to make a feedback for the target event. The implementation of this solution can improve the effectiveness of the collected monitoring information and reduce the power consumption of the intelligent lock.

[0098] The following specifically describes the content of judging whether to collect monitoring information in the embodiments of this application.

[0099] In a feasible embodiment, determining the target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions in step S102 includes at least one of the following steps A1 to A5:

[0100] Step A1: If the historical collection times corresponding to the target event in the historical monitoring data of the current time period are less than the first trigger times in the trigger conditions, determine to collect the target monitoring information related to the target event.

[0101] Specifically, in the judgment of step A1, there are three judgment factors: time, historical collection times, and trigger times. Among them, the time is to set a corresponding judgment time period based on the specific event. For example, for the doorbell ringing event, the judgment time interval can be set to 1 minute (only as an example, this application does not limit this). Among them, the historical collection times refer to the number of times of collecting monitoring information for the target event during the current time period; it can be understood that the historical collection times must be less than or equal to the number of times the intelligent lock transmits for the target event.

[0102] For example, Example 1: Assume that the target event is the doorbell ringing event. When the intelligent lock transmits this target event, the historical collection count corresponding to the doorbell ringing event within the current time period in the historical monitoring data can be obtained (assume it is 1 time). If the first trigger count within a time period set in the preset trigger condition is 2, then it can be determined that the target monitoring information related to the doorbell ringing event needs to be collected (the first trigger count is greater than the historical collection count).

[0103] In addition, as Figure 5 shown, assume that when the first trigger count is 2, within the same time period (2022-11-10 0:34), only the first two doorbell ringing events have corresponding images collected, and subsequent doorbell ringing events do not have monitoring information collected.

[0104] Optionally, the determination method of the time period includes the following two methods (only as an example, this application does not limit this, and this application can also adopt other methods for determining the time period):

[0105] Method 1: Take the time interval corresponding to each preset duration as the same time period; for example, if the preset duration is set to 1 minute, then 12:01:00 to 12:01:59 is the same time period, and 12:02:00 to 12:02:59 belongs to the next time period.

[0106] Method 2: The time period triggered by the same event; for example, when the target event is the doorbell ringing, when the first doorbell ringing event occurs, take the occurrence time point of this event as the start time of the time period, and take the preset duration as the time interval. For example, if the preset duration is 30 seconds, then the same time period is 30 seconds starting from the start time.

[0107] It can be understood that the above determination method of the time period can be applied to any embodiment of this application.

[0108] Step A2: If the historical collection count corresponding to the target event in the historical monitoring data of the current time period is greater than or equal to the second trigger count in the trigger condition, then when it is determined that the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than the preset similarity threshold, determine to collect the target monitoring information related to the target event.

[0109] Among them, when it is determined that the acquisition suitable for the target event in the current time period has reached the preset trigger times, in order to reduce the data acquisition cost while ensuring the effectiveness of data acquisition, image comparison can be performed. If the similarity between the image information corresponding to the current trigger of the target event and the image information in the historical monitoring data of the current time period is very small, it means that the monitoring information related to the trigger of the target event has not been acquired yet, and then the acquisition of monitoring information can be triggered; if the similarity is large, it means that the results obtained by separately analyzing the monitoring information obtained from the re-acquisition and the monitoring information obtained from the historical acquisition have little difference. Considering that repeatedly acquiring multiple similar monitoring information not only consumes a large amount of data acquisition resources but also occupies a large amount of memory space, therefore, when it is determined that the similarity is large, the acquisition of monitoring information can be not performed.

[0110] Optionally, the historical monitoring information includes at least one of image information, video information, and audio information; when it is determined in step A2 that the similarity between the current image information and the historical monitoring information acquired based on the target event in the historical monitoring data of the current time period is less than the preset similarity threshold, determining to acquire the target monitoring information related to the target event includes the following steps A21 - step A23:

[0111] Step A21: Determine whether the preset temporary acquisition condition is met; the temporary acquisition condition is that the historical monitoring information acquired based on the target event in the historical monitoring data of the current time period only includes audio information.

[0112] Step A22: If so, determine to acquire the target monitoring information related to the target event.

[0113] Step A23: If not, instruct the information acquisition module of the intelligent lock to acquire the current image information, and calculate the similarity between the current image information and the historical monitoring information acquired based on the target event in the historical monitoring data of the current time period. If the similarity is less than the preset similarity threshold, determine to acquire the target monitoring information related to the target event.

[0114] Among them, in the judgment of steps A21 - A23, the judgment factors include: time, historical acquisition times, trigger times, temporary acquisition conditions, and image similarity.

[0115] Optionally, when the first trigger count is the same as the second trigger count, step A2 can be other operations of step A1. When it is determined that the historical collection count is greater than or equal to the second trigger count, it is further determined whether the current situation meets the preset temporary collection condition. If so, the target monitoring information related to the target event can be directly determined. If not, it is indicated to collect the current image information through the information collection module of the smart lock and then further determine whether to collect the monitoring information based on the image similarity. For example, for the current image information and the image information collected based on the target event in the historical monitoring data of the current time period, the similarity of the images can be calculated through image recognition technology. If the similarity is less than the preset similarity threshold, it means that the similarity of the images is very low, that is, the relevance of the monitoring information collected in the current time period is relatively low, and it may be the same event triggered by different personnel. At this time, the target monitoring information related to the target event can be determined to improve the security of monitoring through the smart lock.

[0116] Among them, the historical monitoring information may include at least one of image information, video information, and audio information. Correspondingly, the preset temporary collection condition is that the historical monitoring information collected based on the target event in the historical monitoring data of the current time period only includes audio information.

[0117] The embodiment of the present application takes into account that when there is no image-related information in the historical monitoring information collected based on the target event in the historical monitoring data of the current time period, the effectiveness of security judgment based on the historical monitoring information may be reduced. Therefore, when it is determined that the historical collection count corresponding to the target event in the historical monitoring data of the current time period is greater than or equal to the second trigger count and does not include image-related information (image information or video information), there is no need to calculate the similarity, but directly determine that it is necessary to collect the target monitoring information related to the target event to further obtain more information, improve the effectiveness of information collection, and ensure the accuracy of security judgment based on the collected target monitoring information.

[0118] Optionally, the first trigger count and the second trigger count can also be different.

[0119] Optionally, calculating the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period in step A23 includes at least one of the following steps A231 - A232:

[0120] Step A231: Obtain the first monitoring information collected based on the target event in the historical monitoring data of the current time period; calculate the similarity between the current image information and the first monitoring information; the first monitoring information is the image information or video information with the closest collection time to the collection time of the current image information.

[0121] The operations in step A231 are illustrated by the following examples. Example 1: Assume that the second trigger count is 4 (that is, the historical monitoring information collected based on the target event in the historical monitoring data for the current time period includes at least 4 copies and includes image information or video information). Taking the example where the historical monitoring information collected based on the target event in the historical monitoring data for the current time period includes 5 copies of historical monitoring information, the collection time sorting of these 5 copies of historical monitoring information is as follows:

[0122] Historical monitoring information 1 (audio information + video information), collection time: 00:27:03, November 11, 2022;

[0123] Historical monitoring information 2 (audio information + video information), collection time: 00:27:11, November 11, 2022;

[0124] Historical monitoring information 3 (video information), collection time: 00:27:16, November 11, 2022;

[0125] Historical monitoring information 4 (image information), collection time: 00:27:22, November 11, 2022;

[0126] Historical monitoring information 5 (audio information), collection time: 00:27:31, November 11, 2022.

[0127] Obtain 1 copy of image information or video information with the latest collection time from these 5 copies of historical monitoring information, that is, obtain historical monitoring information 4, and calculate the similarity between historical monitoring information 4 and the current image information.

[0128] In another example, if historical monitoring information 4 is video information, image frames with faces in the video information, image frames with the median collection time in the video information, or all image frames in the video information can be obtained for similarity calculation with the current image information. If the image frames obtained from the video information for similarity calculation include at least two frames, then after calculating the similarity between the current image information and each of these at least two image frames, the similarity with the smallest threshold is taken as the similarity between the current image information and the historical monitoring information.

[0129] Step A232: Obtain each second monitoring information collected based on the target event in the historical monitoring data for the current time period; calculate the similarity between the current image information and each second monitoring information, and take the similarity with the smallest threshold as the similarity between the current image information and the historical monitoring information; the second monitoring information includes at least one of image information and video information.

[0130] Continuing with the above Example 1, in step A22, the second monitoring information obtained includes historical monitoring information 1, historical monitoring information 2, historical monitoring information 3, and historical monitoring information 4. On this basis, the similarity between the current image information and these 4 pieces of historical monitoring information is calculated respectively, and the similarity with the smallest threshold is taken as the similarity between the current image information and the historical monitoring information.

[0131] It can be understood that if a piece of second monitoring information is video information, an image frame with a face in the video information, an image frame with a collection time in the middle of the video information, or all the image frames in the video information can be obtained for similarity calculation with the current image information. If the image frames obtained from the video information for similarity calculation include at least two frames, then after calculating the similarity between the current image information and these at least two image frames respectively, the similarity with the smallest threshold is taken as the similarity between the current image information and this piece of second monitoring information.

[0132] Step A3: If the target event is the trigger event indicated in the trigger condition, then determine to collect target monitoring information related to the target event.

[0133] Specifically, in the implementation of this application, developers or users can set that the collection of monitoring information must be carried out for certain specific events. For example, when the smart lock senses prying and triggers an anti-pry alarm, the risk coefficient of this event is relatively high. Then, when setting the trigger condition for the event corresponding to the anti-pry alarm reported by the smart lock, it can be directly determined that it is necessary to collect the target monitoring information related to this event.

[0134] Step A4: If the historical monitoring information collected based on the target event in the historical monitoring data of the current time period indicates the existence of a non-preset target object, then determine to collect target monitoring information related to the target event.

[0135] Specifically, the user can set the information of trusted personnel (preset target objects) of the smart lock through the client. When the event of the smart lock receiving external power charging is concerned, this event indicates that trusted personnel are required to operate. If the historical monitoring information in the current time period indicates the existence of a non-preset target object, it means that this event is not operated by trusted personnel. Therefore, it can be determined that it is necessary to collect the target monitoring information corresponding to this event. If the historical monitoring information in the current time period indicates the existence of a preset target object, there is no need to collect target monitoring information.

[0136] Step A5: If the target event is different from the historical event obtained from the historical monitoring data of the previous time period, then determine to collect target monitoring information related to the target event.

[0137] Specifically, if the smart lock is triggered by the same event in adjacent time intervals, considering that the difference between the collectible monitoring information is not significant and it may consume more power, it can be set that when the smart lock is triggered by the same event in adjacent time intervals, there is no need to collect monitoring information; and only when the smart lock is triggered by different events, it is determined that the target monitoring information corresponding to the current target event needs to be collected.

[0138] It can be understood that in the judgments of the above steps A1 - A5, different target events have corresponding judgment factors. For example, for the doorbell pressing event, the time period can be set to 1 minute. That is, relative to the current time period from 17:02:01 to 17:02:59, the time point 17:01:53 is in its previous time period; for the event of staying outside the door for a long time, considering that the duration of this event is difficult to estimate, the time period can be set to 0 minutes. That is, for each long - staying event, it is not actually considered whether to collect monitoring information based on time factors.

[0139] In a feasible embodiment, the step of determining to collect the target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions further includes step A01:

[0140] Step A01: Predict the effective probability of collecting the target monitoring information for the target event through a pre - trained prediction model; if the effective probability is greater than a preset probability threshold, determine to collect the target monitoring information related to the target event.

[0141] Specifically, in the embodiment of the present application, while meeting the user's usage requirements, to further improve the intelligence of the smart lock's security monitoring, a pre - trained prediction model can be obtained by training a deep - learning network with historical collection data, and the effective probability of the result obtained by collecting the target monitoring information is predicted for the target event through the prediction model. The implementation of this solution can improve the effectiveness of the collected monitoring information to a certain extent and reduce the power consumption of the smart lock.

[0142] Among them, the training of the prediction model includes: if the cumulative number of events in the historical monitoring data reaches a preset cumulative threshold or the current time reaches the model cycle update time, obtain training data; the training data includes historical monitoring data and training labels corresponding to the historical monitoring information in the historical monitoring data, and the training labels are determined based on the user's operations on the historical monitoring information; optimize the network parameters of the prediction model based on the training data.

[0143] Specifically, the prediction model can be applied after being trained offline, and during the application process, the prediction model can also be updated when preset conditions are met to further improve the performance of the prediction model. Among them, the preset conditions may include that the number of events obtained in the historical monitoring data reaches a preset cumulative threshold or the current time reaches the periodic update time of the model (for example, if the set periodic time is 30 days, the model is updated every 30 days).

[0144] Among them, when the intelligent lock is dynamically controlled in combination with the cloud platform, the number of events obtained can refer to the number of times the intelligent lock reports events to the cloud platform, that is, the number of times the judgment on whether to collect monitoring information is made based on the occurrence of events.

[0145] Among them, determining the training label based on the user's operation on the historical monitoring information includes:

[0146] If the user performs a deletion operation on the historical monitoring information, the corresponding historical monitoring information is marked with an invalid label;

[0147] If the user performs a download or retention operation on the historical monitoring information, the corresponding historical monitoring information is marked with a valid label.

[0148] Specifically, as Figure 5 shown, the user can obtain the monitoring log of the intelligent lock from the cloud platform. For the content in the monitoring log, the user can perform operations such as deletion, download, or retention. For example, the user can view Figure 5 Image 1 in. If it is determined that there is no abnormality or no information required by the user in the information shown in Image 1 after viewing, the user can choose to delete Image 1 to free up the storage space occupied by Image 1. In addition, for example, the user can view Figure 5 Video 1 in. If the user finds that there is an abnormality or the information required by the user appears in the content shown in the video after viewing, the user can choose to download Video 1 to the local or retain Video 1 without deletion.

[0149] Optionally, after the user does not perform any operation after viewing the monitoring information in the monitoring log, after a preset storage duration, the cloud platform can destroy the monitoring information to ensure the effective storage of subsequent monitoring information.

[0150] Next, the specific content of the information collection instruction issued in the embodiment of the present application will be described.

[0151] Specifically, the target monitoring information includes at least one of image information, video information, and audio information. Optionally, the information categories that the target monitoring information can collect are related to the hardware device of the intelligent lock and / or the indication of the cloud platform.

[0152] In a feasible embodiment, issuing an information collection instruction in step S102 includes at least one of the following steps B1 to B4:

[0153] Step B1: Obtain the currently remaining storage space. If the storage space is less than a preset space threshold, issue an information collection instruction to collect image information; otherwise, issue an information collection instruction to collect video information and / or audio information.

[0154] Optionally, the storage space that can be provided by the cloud platform can be set by the user. For example, when the user sets that more events need to be recorded rather than taking pictures, the storage space occupied by the collection result of the corresponding monitoring information is larger. Then the user can choose to use a large storage space or expand the storage space of the cloud platform on the original basis. Therefore, in the embodiment of the present application, it is possible to consider what kind of information to collect in combination with the currently remaining storage space of the cloud platform. Specifically, considering that the storage space occupied by image information is less than that of video information or audio information, when the currently remaining storage space of the cloud platform is less than the preset space, an information collection instruction to collect image information can be sent to the intelligent lock; otherwise, an information collection instruction to collect video information and / or audio information is sent to the intelligent lock.

[0155] Optionally, when the embodiment of the present application is executed by the intelligent lock, the storage space can refer to the storage space in the intelligent lock for storing monitoring information, and the size of this storage space can be related to the device memory of the intelligent lock itself. In addition, considering that storing monitoring information requires a large amount of memory, an external memory module can be used on the basis of the original structure of the intelligent lock to store monitoring information to avoid affecting the normal operation of other functions of the intelligent lock.

[0156] Step B2: Obtain the remaining power of the intelligent lock. If the remaining power is less than the first power threshold, issue an information collection instruction to collect image information; otherwise, issue an information collection instruction to collect video information and / or audio information.

[0157] Specifically, when it is determined that the target monitoring information needs to be collected, it is possible to further consider what type of information to collect in combination with the remaining power of the intelligent lock. Specifically, since the main function of the intelligent lock is the door lock function, if too much power is consumed in other functions, it is easy to cause the intelligent lock to be unable to ensure the implementation of the original door lock function. In addition, the power consumed by taking pictures is less than that of taking videos. Therefore, the remaining power of the intelligent lock can be obtained for consideration. When the remaining power is less than the first power threshold, an information collection instruction to collect image information can be issued; otherwise, an information collection instruction to collect video information and / or audio information is issued.

[0158] Step B3: If the target event indicates abnormal monitoring, issue an information collection instruction to collect video information.

[0159] Specifically, considering that when the intelligent lock monitors an anomaly, the risk coefficient of this event is higher than that of other events. Therefore, in order to obtain more monitoring information, an information collection instruction for collecting video information can be issued.

[0160] Optionally, the recording of the video information stops when at least one of the following conditions is met:

[0161] Condition 1: The recording duration reaches the preset recording duration;

[0162] Condition 2: At least one face is recognized during the recording of the video information;

[0163] Condition 3: The alarm indicating the monitoring anomaly is lifted.

[0164] Step B4: Based on the preset mapping relationship between events and the collected information, an information collection instruction for collecting the monitoring information corresponding to the target event is issued.

[0165] Specifically, developers and / or users can preset the mapping relationship between events and the collected information, and this mapping relationship can be as shown in Table 1 below:

[0166] Table 1

[0167] Capture an image Capture a video Record audio Ring the doorbell Yes - - Pick the door lock - Yes Yes ...... ...... ...... ...... Stay outside the door for a long time - Yes -

[0168] As can be seen from Table 1, if the target event is picking the door lock, an information collection instruction for taking a video can be issued. It can be understood that the above Table 1 is only an example, and this application is not limited thereto.

[0169] The following combines Figure 2 and Figure 4 to specifically describe the control method of the intelligent lock applied to the client in the embodiments of this application.

[0170] Specifically, as Figure 2 shown, when the control method of the intelligent lock provided in the embodiments of this application is applied to the intelligent lock, this method includes the following steps S201 - step S203:

[0171] Step S201: In response to the trigger operation of the event, transmit the target event corresponding to this trigger operation.

[0172] Step S202: Receive the information collection instruction, and the information collection instruction is issued when determining to collect the target monitoring information related to the target event based on the historical monitoring data and / or the preset trigger conditions.

[0173] Step S203: Collect the target monitoring information corresponding to the information collection instruction through the information collection module.

[0174] Optionally, when the intelligent lock is triggered by any preset event, such as when someone performs a doorbell pressing operation on the intelligent lock, the intelligent lock transmits (reports) the target event to the cloud platform. At this time, the cloud platform will implement the control method of the intelligent lock through it to determine whether it is necessary to collect the target monitoring information related to the target event. If so, an information collection instruction will be sent to the intelligent lock. After receiving the instruction, the intelligent lock will collect the target monitoring information corresponding to the instruction through the information collection module.

[0175] Optionally, when the intelligent lock is triggered by any preset event, it can also transmit the event to the control module through the data transmission module, and the control module of the intelligent lock itself determines whether it is necessary to collect the monitoring information corresponding to the event. If so, the control module issues an information collection instruction to instruct the information collection module to collect the monitoring information. It can be understood that the intelligent lock may further include an event detection module, which may be composed of an infrared sensor, a radar, a biometric module, etc., and is arranged at corresponding positions on the lock body for detecting whether a target event occurs.

[0176] Specifically, the information collection module includes at least one of a camera unit and a voice unit.

[0177] Among them, the information collection instruction can indicate which hardware unit of the intelligent lock to collect what kind of information. For example, it can indicate that the intelligent lock collects image information through the camera unit.

[0178] In a feasible embodiment, collecting the target monitoring information corresponding to the information collection instruction through the information collection module in step S203 includes at least one of the following steps C1-step C4:

[0179] Step C1: If the information collection instruction indicates collecting image information, take a picture through the camera unit.

[0180] Step C2: If the information collection instruction indicates collecting video information, record video through the camera unit until the video recording stop condition is met.

[0181] Step C3: If the information collection instruction indicates collecting audio information, record audio through the voice unit until the audio recording stop condition is met.

[0182] Step C4: If the information collection instruction does not indicate the category of information to be collected, the current remaining power is obtained. If the remaining power is less than the second power threshold, the collection of target monitoring information is suspended and an alarm prompt message is sent to the client bound to the smart lock; if the remaining power is greater than or equal to the second power threshold and less than the third power threshold, an image is captured by the camera unit; if the remaining power is greater than or equal to the third power threshold, video is recorded by the camera unit until the video stop condition is met and / or audio is recorded by the voice unit until the recording stop condition is met.

[0183] Among them, the recording stop conditions include at least one of reaching a preset recording time, recognizing at least one face, and releasing the alarm; the recording stop conditions include at least one of reaching a preset recording time, recognizing a preset keyword, and releasing the alarm.

[0184] Specifically, in step C1, the camera unit of the smart lock can refer to the cat's eye module it carries itself, or it can be a distributed cat's eye device (independent of the smart lock, but can be bound and used synchronously). At this time, the smart lock can take images through its own cat's eye module, or it can instruct the distributed cat's eye device to take images.

[0185] Specifically, compared to steps C1-C3, step C4 only instructs the cloud platform to collect target monitoring information, but does not specify the specific information to be collected. Based on this, the smart lock can independently determine or collect target monitoring information according to a preset method. Optionally, the smart lock can make this determination based on its current remaining battery life. For example, if the current remaining battery life is less than a second battery threshold, this indicates that the smart lock's battery life is very low. Continuing to collect monitoring information could deplete the battery. In this case, the smart lock can suspend the collection of target monitoring information and simultaneously send an alert to the associated client, allowing the user to detect that the door lock has detected a specific event even when unable to view monitoring information. Optionally, given that the power consumption required to collect image information is less than the power consumption required to collect video or audio information, the smart lock can collect image information using the camera unit if the remaining battery life is greater than or equal to the second battery threshold and less than a third battery threshold. Subsequently, when the remaining battery life is greater than or equal to the third battery threshold, the smart lock has sufficient battery life and can continue recording using the camera unit until a recording stop condition is met.

[0186] Among them, the preset keywords can be set by developers or customized by users through the client. For example, if the name (such as a name or nickname) of the preset target object exists in the recording information. For illustration, Example 2: Assume that the smart lock is in the recording state, and voice recognition is performed synchronously during the recording. If the preset keyword is recognized, it indicates that the risk factor of the target event triggering the smart lock is relatively low. Therefore, the recording can be stopped.

[0187] Optionally, in the embodiments of the present application, operations such as image recognition, image similarity calculation, face recognition, and voice recognition can all be performed through artificial intelligence technology.

[0188] In a feasible embodiment, after the target monitoring information is collected, at least one of the following steps D1 to D2 is further included:

[0189] Step D1: Upload the target monitoring information to generate a monitoring log.

[0190] Step D2: Send the target monitoring information to the client bound to the smart lock.

[0191] Specifically, as Figure 4 shown, after the smart lock collects the target monitoring information corresponding to the target event, the target monitoring information can be uploaded to the cloud platform to generate the monitoring log of the smart lock through the cloud platform. In addition, the smart lock can also send the collected monitoring information to the client bound to the smart lock so that the user can understand the current monitoring situation in real time and in a timely manner.

[0192] It should be noted that in the optional embodiments of the present application, for the data involved (such as data related to monitoring information, image information, event information, etc.), when the above embodiments of the present application are applied to specific products or technologies, permission or consent from the object of use is required, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of the relevant countries and regions. That is to say, in the embodiments of the present application, if data related to the object is involved, these data need to be obtained with the authorization and consent of the object and comply with the relevant laws, regulations, and standards of the country and region.

[0193] The embodiments of the present application provide a control device for a smart lock, as Figure 6 shown, the control device 100 of the smart lock may include: an acquisition module 101 and a determination module 102.

[0194] Among them, the acquisition module 101 is used to acquire the target event; the determination module 102 is used to issue an information acquisition instruction to indicate the acquisition of target monitoring information through the information acquisition module of the smart lock if it is determined based on historical monitoring data and / or preset trigger conditions that target monitoring information related to the target event needs to be collected.

[0195] Optionally, when the determination module 102 is used to execute the determination of collecting target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions, it is specifically used to execute at least one of the following:

[0196] If the historical collection times corresponding to the target event in the historical monitoring data of the current time period are less than the first trigger times in the trigger conditions, determine to collect the target monitoring information related to the target event;

[0197] If the historical collection times corresponding to the target event in the historical monitoring data of the current time period are greater than or equal to the second trigger times in the trigger conditions, determine to collect the target monitoring information related to the target event when the preset temporary collection conditions are met; otherwise, instruct the information collection module of the intelligent lock to collect the current image information, and calculate the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period. If the similarity is less than the preset similarity threshold, determine to collect the target monitoring information related to the target event;

[0198] If the target event is the trigger event indicated in the trigger conditions, determine to collect the target monitoring information related to the target event;

[0199] If the historical monitoring information collected based on the target event in the historical monitoring data of the current time period indicates the existence of non-preset target objects, determine to collect the target monitoring information related to the target event;

[0200] If the target event is different from the historical event obtained from the historical monitoring data of the previous time period, determine to collect the target monitoring information related to the target event.

[0201] Optionally, the historical monitoring information includes at least one of image information, video information, and audio information; when the determination module 102 is used to execute the determination of collecting the target monitoring information related to the target event when the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than the preset similarity threshold, it is specifically used to:

[0202] Judge whether the preset temporary collection conditions are met; the temporary collection conditions are that the historical monitoring information collected based on the target event in the historical monitoring data of the current time period only includes audio information;

[0203] If so, determine to collect the target monitoring information related to the target event;

[0204] Otherwise, it is indicated to collect the current image information through the information collection module of the intelligent lock, and calculate the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period. If the similarity is less than the preset similarity threshold, it is determined to collect the target monitoring information related to the target event.

[0205] Optionally, when the determining module 102 is used to calculate the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period, it is specifically used for at least one of the following:

[0206] Obtain the first monitoring information collected based on the target event in the historical monitoring data of the current time period; calculate the similarity between the current image information and the first monitoring information; the first monitoring information is the image information or video information with the closest collection time to the collection time of the current image information.

[0207] Obtain each second monitoring information collected based on the target event in the historical monitoring data of the current time period; calculate the similarity between the current image information and each second monitoring information, and use the similarity with the smallest threshold as the similarity between the current image information and the historical monitoring information; the second monitoring information includes at least one of image information and video information.

[0208] Optionally, the target monitoring information includes at least one of image information, video information, and audio information; when the determining module 102 is used to issue an information collection instruction, it is specifically used for at least one of the following:

[0209] Obtain the remaining storage space currently available. If the storage space is less than the preset space threshold, issue an information collection instruction to collect image information; otherwise, issue an information collection instruction to collect video information and / or audio information.

[0210] Obtain the remaining battery power of the intelligent lock. If the remaining battery power is less than the first power threshold, issue an information collection instruction to collect image information; otherwise, issue an information collection instruction to collect video information and / or audio information.

[0211] If the target event indicates monitoring an abnormality, issue an information collection instruction to collect video information.

[0212] Based on the preset mapping relationship between events and the collected information, issue an information collection instruction to collect the monitoring information corresponding to the target event.

[0213] Optionally, when the determining module 102 is used to determine to collect the target monitoring information related to the target event based on the historical monitoring data and / or the preset trigger condition, it is also used to execute:

[0214] Predict the effective probability of collecting target monitoring information for the target event through a pre-trained prediction model; if the effective probability is greater than a preset probability threshold, determine to collect target monitoring information related to the target event.

[0215] Among them, the training of the prediction model includes:

[0216] If the cumulative number of event acquisitions in the historical monitoring data reaches a preset cumulative threshold or the current time reaches the model cycle update time, obtain training data; the training data includes historical monitoring data and training labels corresponding to the historical monitoring information in the historical monitoring data, and the training labels are determined based on the user's operations on the historical monitoring information.

[0217] Optimize the network parameters of the prediction model based on the training data.

[0218] Among them, determining the training label based on the user's operation on the historical monitoring information includes:

[0219] If the user performs a deletion operation on the historical monitoring information, use an invalid label to identify the corresponding historical monitoring information.

[0220] If the user performs a download or retention operation on the historical monitoring information, use a valid label to identify the corresponding historical monitoring information.

[0221] The embodiment of the present application also provides another control device for an intelligent lock, as Figure 7 shown. The control device 200 of the intelligent lock may include: a transmission module 201, a receiving module 202, and a collection module 203.

[0222] Among them, the transmission module 201 is used to transmit the target event corresponding to the trigger operation in response to the trigger operation of the event; the receiving module 202 is used to receive an information collection instruction, and the information collection instruction is issued when it is determined to collect target monitoring information related to the target event based on historical monitoring data and / or preset trigger conditions; the collection module 203 is used to collect the target monitoring information corresponding to the information collection instruction through the information collection module.

[0223] Optionally, the information collection module includes at least one of a camera unit and a voice unit; when the collection module 203 is used to execute collecting the target monitoring information corresponding to the information collection instruction through the information collection module, it is specifically used to execute at least one of the following:

[0224] If the information collection instruction indicates collecting image information, take a picture through the camera unit.

[0225] If the information collection instruction indicates to collect video information, recording is performed by the camera unit until a recording stop condition is met;

[0226] If the information collection instruction indicates collecting audio information, recording is performed through the voice unit until a recording stop condition is met;

[0227] If the information collection instruction does not indicate the type of information to be collected, the current remaining power is obtained; if the remaining power is less than the second power threshold, the collection of target monitoring information is suspended and an alarm prompt message is sent to the client bound to the smart lock; if the remaining power is greater than or equal to the second power threshold and less than the third power threshold, an image is captured by the camera unit; if the remaining power is greater than or equal to the third power threshold, video is recorded by the camera unit until a video stop condition is met and / or audio is recorded by the voice unit until a recording stop condition is met;

[0228] Among them, the recording stop conditions include at least one of reaching a preset recording time, recognizing at least one face, and releasing the alarm; the recording stop conditions include at least one of reaching a preset recording time, recognizing a preset keyword, and releasing the alarm.

[0229] Optionally, after being used to collect target monitoring information, the collection module 203 is further used to perform at least one of the following:

[0230] Uploading the target monitoring information to generate a monitoring log;

[0231] The target monitoring information is sent to the client bound to the smart lock.

[0232] The device of the embodiment of the present application can execute the method provided by the embodiment of the present application, and its implementation principle is similar. The actions performed by each module in the device of each embodiment of the present application correspond to the steps in the method of each embodiment of the present application. For the detailed functional description of each module of the device, please refer to the description in the corresponding method shown in the previous text, and will not be repeated here.

[0233] The modules described in the embodiments of the present application may be implemented by software. In some cases, the name of a module does not limit the module itself. For example, an acquisition module may also be described as a "module for acquiring target events".

[0234] An embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory. The processor executes the above computer program to implement the steps of a control method for an intelligent lock. Compared with the related art, it can achieve: evaluating whether it is necessary to trigger the collection of monitoring information when a target event is detected, realizing the dynamic control of the information collection operation of the intelligent lock, effectively improving the effectiveness of the information collection result, and also reducing the power consumption of the intelligent lock to a certain extent.

[0235] In an alternative embodiment, an electronic device is provided, such as Figure 8 shown. Figure 8 The electronic device 4000 shown includes: a processor 4001 and a memory 4003. Among them, the processor 4001 and the memory 4003 are connected, such as through a bus 4002. Optionally, the electronic device 4000 may further include a transceiver 4004, and the transceiver 4004 may be used for data interaction between the electronic device and other electronic devices, such as data sending and / or data receiving, etc. It should be noted that in actual applications, the transceiver 4004 is not limited to one, and the structure of the electronic device 4000 does not constitute a limitation to the embodiments of the present application.

[0236] The processor 4001 may be a CPU (Central Processing Unit, central processor), a general-purpose processor, a DSP (Digital Signal Processor, data signal processor), an ASIC (Application Specific Integrated Circuit, application-specific integrated circuit), an FPGA (Field Programmable Gate Array, field programmable gate array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in connection with the disclosure of the present application. The processor 4001 may also be a combination that realizes computing functions, such as a combination including one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0237] The bus 4002 may include a path for transmitting information between the above components. The bus 4002 may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus or an EISA (Extended Industry Standard Architecture, extended industry standard architecture) bus, etc. The bus 4002 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 only a thick line is shown in, but it does not mean that there is only one bus or one type of bus.

[0238] The memory 4003 can be a ROM (Read Only Memory), or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory), or other types of dynamic storage devices that can store information and instructions. It can also be an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory), or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium that can be used to carry or store computer programs and can be read by a computer, which is not limited herein.

[0239] The memory 4003 is used to store the computer program for implementing the embodiments of the present application and is controlled by the processor 4001 for execution. The processor 4001 is used to execute the computer program stored in the memory 4003 to implement the steps shown in the foregoing method embodiments.

[0240] Among them, the electronic device includes but is not limited to: terminals, servers.

[0241] The embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps and corresponding contents of the foregoing method embodiments can be implemented.

[0242] The embodiments of the present application also provide a computer program product, including a computer program. When the computer program is executed by a processor, the steps and corresponding contents of the foregoing method embodiments can be implemented.

[0243] The terms "first", "second", "third", "fourth", "1", "2", etc. (if any) in the specification, claims and the above drawings of the present application are used to distinguish similar objects and do not necessarily describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances so that the embodiments of the present application described herein can be implemented in an order other than that shown or described in words.

[0244] It should be understood that although the flowcharts of the embodiments of the present application indicate various operation steps by arrows, the execution order of these steps is not limited to the order indicated by the arrows. Unless there is a clear description in this article, in some implementation scenarios of the embodiments of the present application, the implementation steps in each flowchart can be executed in other orders according to requirements. In addition, some or all of the steps in each flowchart may include multiple sub-steps or multiple stages based on the actual implementation scenario. Some or all of these sub-steps or stages can be executed at the same time, and each sub-step or stage among these sub-steps or stages can also be executed at different times respectively. In the scenario where the execution times are different, the execution order of these sub-steps or stages can be flexibly configured according to requirements, and the embodiments of the present application do not limit this.

[0245] The above are only optional implementation manners of some implementation scenarios of the present application. It should be noted that for those of ordinary skill in the art, without departing from the technical concept of the solution of the present application, adopting other similar implementation means based on the technical idea of the present application also belongs to the protection scope of the embodiments of the present application.

Claims

1. A control method for an intelligent lock, characterized in that, Applied to a cloud platform, including: Receiving a target event sent by an intelligent lock and obtaining historical monitoring data; Determining to collect target monitoring information related to the target event, including: if the historical collection times corresponding to the target event in the historical monitoring data of the current time period are less than the first trigger times in the preset trigger conditions, determining to collect target monitoring information related to the target event; if the historical collection times corresponding to the target event in the historical monitoring data of the current time period are greater than or equal to the second trigger times in the trigger conditions, determining to collect target monitoring information related to the target event when the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than the preset similarity threshold; Sending an information collection instruction to the intelligent lock; Wherein, the instruction is used to instruct the intelligent lock to collect the target monitoring information through an information collection module; the current time period includes a time period determined based on a time interval corresponding to a preset duration or a time period determined based on the target event.

2. The method according to claim 1, wherein The historical monitoring information includes at least one of image information, video information, and audio information; The determining to collect target monitoring information related to the target event when the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than the preset similarity threshold includes: Judging whether a preset temporary collection condition is satisfied; the temporary collection condition is that the historical monitoring information collected based on the target event in the historical monitoring data of the current time period only includes audio information; If so, determining to collect target monitoring information related to the target event; If not, instructing to collect the current image information through the information collection module of the intelligent lock, calculating the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period, and if the similarity is less than the preset similarity threshold, determining to collect target monitoring information related to the target event.

3. The method according to claim 2, wherein The calculating the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period includes at least one of the following: Obtaining the first monitoring information collected based on the target event in the historical monitoring data of the current time period; Calculating the similarity between the current image information and the first monitoring information; The first monitoring information is the image information or video information with the collection time closest to the collection time of the current image information; Obtaining each second monitoring information collected based on the target event in the historical monitoring data of the current time period; Calculating the similarity between the current image information and each second monitoring information, and taking the similarity with the smallest threshold as the similarity between the current image information and the historical monitoring information; the second monitoring information includes at least one of image information and video information.

4. The method according to claim 1, wherein The target monitoring information includes at least one of image information, video information, and audio information; The sending the information collection instruction includes at least one of the following: Obtain the current remaining storage space. If the storage space is less than the preset space threshold, issue an information collection instruction to collect image information; otherwise, issue an information collection instruction to collect video information and / or audio information; Obtain the remaining battery power of the intelligent lock. If the remaining battery power is less than the first power threshold, issue an information collection instruction to collect image information; Otherwise, issue an information collection instruction to collect video information and / or audio information; If the target event indicates a monitoring anomaly, issue an information collection instruction to collect video information; Based on the preset mapping relationship between events and the collected information, issue an information collection instruction to collect the monitoring information corresponding to the target event.

5. The method according to claim 1, wherein The determination of collecting the target monitoring information related to the target event further includes at least one of the following: If the target event is the trigger event indicated in the trigger condition, determine to collect the target monitoring information related to the target event; If the historical monitoring information collected based on the target event in the historical monitoring data of the current time period indicates the existence of non-preset target objects, determine to collect the target monitoring information related to the target event; If the target event is different from the historical event obtained from the historical monitoring data of the previous time period, determine to collect the target monitoring information related to the target event; Predict the effective probability of collecting the target monitoring information for the target event through a pre-trained prediction model; If the effective probability is greater than the preset probability threshold, determine to collect the target monitoring information related to the target event; Among them, the training of the prediction model includes: If the cumulative number of event acquisitions in the historical monitoring data reaches the preset cumulative threshold or the current time reaches the model cycle update time, obtain the training data; the training data includes the historical monitoring data and the training labels corresponding to the historical monitoring information in the historical monitoring data, and the training labels are determined based on the user's operations on the historical monitoring information; Optimize the network parameters of the prediction model based on the training data; Among them, determining the training labels based on the user's operations on the historical monitoring information includes: If the user performs a deletion operation on the historical monitoring information, use an invalid label to identify the corresponding historical monitoring information; If the user performs a download or retention operation on the historical monitoring information, use a valid label to identify the corresponding historical monitoring information.

6. A control method for an intelligent lock, characterized in that, Applied to an intelligent lock, it includes: In response to the trigger operation of the event, transmit the target event corresponding to the trigger operation to the cloud platform; Receive an information collection instruction, the information collection instruction is issued when the cloud platform determines to collect target monitoring information related to the target event; the determination to collect the target monitoring information related to the target event includes: if the number of historical collections corresponding to the target event in the historical monitoring data of the current time period is less than the first trigger number in the preset trigger condition, then determine to collect the target monitoring information related to the target event; if the number of historical collections corresponding to the target event in the historical monitoring data of the current time period is greater than or equal to the second trigger number in the trigger condition, then when it is determined that the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than a preset similarity threshold, determine to collect the target monitoring information related to the target event; the current time period includes a time period determined based on a time interval corresponding to a preset duration, or a time period determined based on the target event; The target monitoring information corresponding to the information collection instruction is collected through the information collection module.

7. The method according to claim 6, wherein The information acquisition module includes at least one of a camera unit and a voice unit; The collecting of target monitoring information corresponding to the information collection instruction by the information collection module includes at least one of the following: If the information collection instruction indicates collecting image information, capturing an image by a camera unit; If the information collection instruction indicates to collect video information, recording is performed by the camera unit until a recording stop condition is met; If the information collection instruction indicates collecting audio information, recording is performed through the voice unit until a recording stop condition is met; If the information collection instruction does not indicate the type of information to be collected, the current remaining power is obtained; if the remaining power is less than the second power threshold, the collection of target monitoring information is suspended and an alarm prompt message is sent to the client bound to the smart lock; if the remaining power is greater than or equal to the second power threshold and less than the third power threshold, an image is captured by the camera unit; if the remaining power is greater than or equal to the third power threshold, video is recorded by the camera unit until a video stop condition is met and / or audio is recorded by the voice unit until a recording stop condition is met; Among them, the recording stop conditions include at least one of reaching a preset recording time, recognizing at least one face, and releasing the alarm; the recording stop conditions include at least one of reaching a preset recording time, recognizing a preset keyword, and releasing the alarm.

8. The method according to claim 6, characterized in that, After acquiring the target monitoring information, at least one of the following items is also included: Uploading the target monitoring information to generate a monitoring log; The target monitoring information is sent to the client bound to the smart lock.

9. A control device for an intelligent lock, characterized in that, include: Devices used in cloud platforms include: The acquisition module receives the target event sent by the smart lock and obtains historical monitoring data; A determination module determines target monitoring information related to the target event, including: if the historical collection times corresponding to the target event in the historical monitoring data of the current time period are less than the first trigger times in the preset trigger conditions, determining to collect the target monitoring information related to the target event; if the historical collection times corresponding to the target event in the historical monitoring data of the current time period are greater than or equal to the second trigger times in the trigger conditions, when it is determined that the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than the preset similarity threshold, determining to collect the target monitoring information related to the target event; The determination module is further configured to, when determining to collect the target monitoring information related to the target event, send an information collection instruction to the intelligent lock; Wherein, the instruction is used to instruct the intelligent lock to collect the target monitoring information through the information collection module; the current time period includes a time period determined based on a time interval corresponding to a preset duration, or a time period determined based on the target event; Or, A device applied to an intelligent lock, including: A transmission module, configured to transmit a target event corresponding to a trigger operation to a cloud platform in response to the trigger operation of the event; A receiving module, configured to receive an information collection instruction, where the information collection instruction is sent when the cloud platform determines to collect the target monitoring information related to the target event; the determination of collecting the target monitoring information related to the target event includes: if the historical collection times corresponding to the target event in the historical monitoring data of the current time period are less than the first trigger times in the trigger conditions, determining to collect the target monitoring information related to the target event; if the historical collection times corresponding to the target event in the historical monitoring data of the current time period are greater than or equal to the second trigger times in the trigger conditions, when it is determined that the similarity between the current image information and the historical monitoring information collected based on the target event in the historical monitoring data of the current time period is less than the preset similarity threshold, determining to collect the target monitoring information related to the target event; the current time period includes a time period determined based on a time interval corresponding to a preset duration, or a time period determined based on the target event; A collection module, configured to collect the target monitoring information corresponding to the information collection instruction through the information collection module.

10. An intelligent lock, characterized in that, Including: A door lock main body installed on a door; An information collection module, connected to the door lock main body, for collecting monitoring information; A data transmission module, for transmitting events and the monitoring information collected by the information collection module; A control module, connected to the information collection module and the data transmission module, and configured to execute the method according to any one of claims 6 to 8.

11. An electronic device, comprising a memory, a processor, and a computer program stored on the memory, characterized in that, The processor executes the computer program to implement the method according to any one of claims 1 to 5.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, The computer program, when executed by the processor, implements the method according to any one of claims 1 to 5 or 6 to 8.

Images