Control method and device of security and protection equipment

Abstract

The embodiment of the invention relates to a control method and device for security and protection equipment. The method comprises the following steps: acquiring a target image set corresponding to a security and protection equipment set; extracting a calibration object from the target image set; establishing an association relationship between the security and protection devices based on the calibration object; when it is detected that a target object exists in a security area monitored by the security equipment set, determining one or more linkage security equipment from the security equipment set based on the association relationship and target information of the target object; and controlling one or more linkage security and protection devices to perform monitoring operation on the target object. Therefore, the automation degree of monitoring by using the security and protection equipment by a user can be improved, and the complexity of monitoring by using the security and protection equipment by the user is reduced.

Description

Technical Field

[0001] The present application relates to the field of security, and in particular to a control method and device for security equipment. Background Art

[0002] Security is a safety and security industry that uses technical means such as video surveillance, intrusion alarms, and new-generation information technology to prevent and respond to various risks and challenges, build a three-dimensional social security prevention and control system, and maintain national security and social stability.

[0003] At present, in order to achieve security, the above requirements are mainly met through the security equipment linkage function manually configured by users. Before using the above security equipment, users often need to spend a lot of time and energy to configure it, which makes the use of security equipment for monitoring more complicated. Summary of the invention

[0004] In view of this, in order to solve the above-mentioned technical problem of high complexity in monitoring using security equipment, an embodiment of the present application provides a control method and device for security equipment.

[0005] In a first aspect, an embodiment of the present application provides a method for controlling a security device, the method comprising:

[0006] Get the target image set corresponding to the security equipment set;

[0007] Extracting a calibration object from the target image set;

[0008] Establishing an association relationship between the security devices based on the calibration object;

[0009] In the case where a target object is detected in the security area monitored by the security device set, one or more linked security devices are determined from the security device set based on the association relationship and the target information of the target object;

[0010] Control one or more of the linked security devices to perform monitoring operations on the target object.

[0011] In a possible implementation manner, the security device includes a camera; and

[0012] The step of obtaining a target image set corresponding to a security device set includes:

[0013] Acquire images captured by the security devices in the security device set to obtain a target image set, wherein the security devices and the target images correspond one to one; and

[0014] The establishing of the association relationship between the security devices based on the calibration object includes:

[0015] Determining a capture time of the target image in the target image set;

[0016] An association relationship between the security devices in the security device set is established based on the determined collection time and the calibration object.

[0017] In a possible implementation, establishing an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes:

[0018] Based on the determined acquisition time and the calibration object, determining whether the target image set includes a first target image subset, wherein the acquisition time of each target image in the first target image subset is the same, and at least part of the calibration objects of each target image in the first target image subset indicates a same photographed object;

[0019] In a case where the target image set includes the first target image subset, determining that the association relationship of the security devices in the first security device subset represents a first relationship, wherein the first relationship represents a shared field of view, and the security devices in the first security device subset acquire the target images in the first target image subset.

[0020] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0021] In a case where the association relationship represents the first relationship and the target object is located in a security area monitored by the first security device subset, determining, from the first security device subset, a security device corresponding to the security area to be entered by the target object for monitoring as a linkage security device; and

[0022] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0023] After waking up the linkage security device, the linkage security device is controlled to collect images of the target object to perform the monitoring operation.

[0024] In a possible implementation, establishing an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes:

[0025] Based on the determined acquisition time and the calibration object, determining whether the target image set includes a second target image subset, wherein the second target image subset includes a telephoto image and a wide-angle image of the same photographed object;

[0026] In a case where the target image set includes the second target image subset, determining that the association relationship of the security devices in the second security device subset represents a second relationship, wherein the second relationship represents a telephoto camera and a wide-angle camera working in pair, the telephoto camera is used to capture telephoto images, and the wide-angle camera is used to capture wide-angle images.

[0027] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0028] In a case where the association relationship indicates the second relationship, respectively determining the security devices in the second security device subset as linked security devices; and

[0029] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0030] Controlling the telephoto camera to capture a telephoto image of the target object;

[0031] The wide-angle camera is controlled to capture a wide-angle image of the target object.

[0032] In a possible implementation manner, the target information includes at least the following information: the object type of the target object, the security device that detects the target object; and

[0033] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0034] Based on the target information, identifying an event triggered by the target object;

[0035] The linked security device is controlled to perform the monitoring operation for monitoring the event.

[0036] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0037] Determine whether the target object is located in a security area monitored by a target camera; the target camera is any one of the security device set;

[0038] In a case where the target object is located in a security area monitored by the target camera, based on the association relationship, determining a linkage security device associated with the target camera from the security device set; and

[0039] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0040] In the case where the linkage security device includes an audio output device, the audio output device is controlled to output the prompt audio corresponding to the target object to perform the monitoring operation.

[0041] In a possible implementation manner, when the monitoring operation is used to perform image acquisition, the method further includes:

[0042] Acquire an image obtained by the linked security device performing the monitoring operation to obtain a monitoring image;

[0043] Extract at least one of the following feature information of the target object from the surveillance image: face image, license plate number, movement trajectory, first appearance time, first appearance location, departure time, and departure location;

[0044] Sending the characteristic information to a preset user terminal so that the user terminal displays event information determined based on the characteristic information; or determining event information based on the characteristic information, and sending the event information to a preset user terminal so that the user terminal displays the event information; wherein the event information represents an event triggered by the target object.

[0045] In a second aspect, an embodiment of the present application provides a control device for a security device, the device comprising:

[0046] A first acquisition unit is used to acquire a target image set corresponding to a security device set;

[0047] A first extraction unit, used to extract a calibration object from the target image set;

[0048] An establishing unit, configured to establish an association relationship between the security devices based on the calibration object;

[0049] a determining unit, configured to determine one or more linked security devices from the security device set based on the association relationship and target information of the target object when detecting that a target object exists in the security area monitored by the security device set;

[0050] A control unit is used to control one or more of the linked security devices to perform monitoring operations on the target object.

[0051] In a possible implementation manner, the security device includes a camera; and

[0052] The step of obtaining a target image set corresponding to a security device set includes:

[0053] Acquire images captured by the security devices in the security device set to obtain a target image set, wherein the security devices and the target images correspond one to one; and

[0054] The establishing of the association relationship between the security devices based on the calibration object includes:

[0055] Determining a capture time of the target image in the target image set;

[0056] An association relationship between the security devices in the security device set is established based on the determined collection time and the calibration object.

[0057] In a possible implementation, establishing an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes:

[0058] Based on the determined acquisition time and the calibration object, determining whether the target image set includes a first target image subset, wherein the acquisition time of each target image in the first target image subset is the same, and at least part of the calibration objects of each target image in the first target image subset indicates a same photographed object;

[0059] In a case where the target image set includes the first target image subset, determining that the association relationship of the security devices in the first security device subset represents a first relationship, wherein the first relationship represents a shared field of view, and the security devices in the first security device subset acquire the target images in the first target image subset.

[0060] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0061] In a case where the association relationship represents the first relationship and the target object is located in a security area monitored by the first security device subset, determining, from the first security device subset, a security device corresponding to the security area to be entered by the target object for monitoring as a linkage security device; and

[0062] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0063] After waking up the linkage security device, the linkage security device is controlled to collect images of the target object to perform the monitoring operation.

[0064] In a possible implementation, establishing an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes:

[0065] Based on the determined acquisition time and the calibration object, determining whether the target image set includes a second target image subset, wherein the second target image subset includes a telephoto image and a wide-angle image of the same photographed object;

[0066] In a case where the target image set includes the second target image subset, determining that the association relationship of the security devices in the second security device subset represents a second relationship, wherein the second relationship represents a telephoto camera and a wide-angle camera working in pair, the telephoto camera is used to capture telephoto images, and the wide-angle camera is used to capture wide-angle images.

[0067] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0068] In a case where the association relationship indicates the second relationship, respectively determining the security devices in the second security device subset as linked security devices; and

[0069] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0070] Controlling the telephoto camera to capture a telephoto image of the target object;

[0071] The wide-angle camera is controlled to capture a wide-angle image of the target object.

[0072] In a possible implementation manner, the target information includes at least the following information: the object type of the target object, the security device that detects the target object; and

[0073] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0074] Based on the target information, identifying an event triggered by the target object;

[0075] The linked security device is controlled to perform the monitoring operation for monitoring the event.

[0076] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0077] Determine whether the target object is located in a security area monitored by a target camera; the target camera is any one of the security device set;

[0078] In a case where the target object is located in a security area monitored by the target camera, based on the association relationship, determining a linkage security device associated with the target camera from the security device set; and

[0079] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0080] In the case where the linkage security device includes an audio output device, the audio output device is controlled to output the prompt audio corresponding to the target object to perform the monitoring operation.

[0081] In a possible implementation manner, when the monitoring operation is used to perform image acquisition, the device further includes:

[0082] A second acquisition unit is used to acquire an image obtained by the linked security device performing the monitoring operation to obtain a monitoring image;

[0083] A second extraction unit is used to extract at least one of the following feature information of the target object from the surveillance image: face image, license plate number, movement trajectory, first appearance time, first appearance location, departure time, and departure location;

[0084] A sending unit, used to send the characteristic information to a preset user terminal so that the user terminal displays event information determined based on the characteristic information; or to determine event information based on the characteristic information, and send the event information to a preset user terminal so that the user terminal displays the event information; wherein the event information represents an event triggered by the target object.

[0085] In a third aspect, an embodiment of the present application provides a security system, the system comprising: a security device set and a control device; wherein the control device is used to execute any of the methods described in the first aspect above.

[0086] In a fourth aspect, an embodiment of the present application provides an electronic device, including:

[0087] Memory for storing computer programs;

[0088] The processor is used to execute the computer program stored in the memory, and when the computer program is executed, the method of any embodiment of the method for controlling the security equipment of the first aspect of the present application is implemented.

[0089] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method of any embodiment of the method for controlling a security device as described in the first aspect above is implemented.

[0090] In a sixth aspect, an embodiment of the present application provides a computer program, which includes a computer-readable code. When the computer-readable code runs on a device, the processor in the device implements a method of any embodiment of the method for controlling a security device in the first aspect described above.

[0091] The control method of security equipment provided in the embodiment of the present application can obtain the target image set corresponding to the security equipment set, so as to subsequently establish the association relationship of the security equipment, then extract the calibration object from the target image set, and establish the association relationship between the security equipment based on the calibration object, so as to automatically determine the association relationship of the security equipment through the target image set, and then, when it is detected that there is a target object in the security area monitored by the security equipment set, one or more linkage security equipment is determined from the security equipment set based on the association relationship and the target information of the target object, and then, one or more linkage security equipment is controlled to perform monitoring operations on the target object. Thus, the association relationship of the security equipment and security equipment can be automatically determined based on the target image set corresponding to the security equipment set, and the linkage security equipment can be controlled to perform monitoring operations, so that the degree of automation of users using security equipment for monitoring can be improved, and the complexity of users using security equipment for monitoring can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0092] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0093] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0094] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0095] Figure 1 A schematic diagram of a flow chart of a method for controlling a security device provided in an embodiment of the present application;

[0096] Figure 2 A flowchart of another method for controlling a security device provided in an embodiment of the present application;

[0097] Figure 3 A flowchart of another method for controlling a security device provided in an embodiment of the present application;

[0098] Figure 4A-4C A schematic diagram of an application scenario of tracking and expelling strangers involved in a control method for security equipment provided in an embodiment of the present application;

[0099] Figure 5A-5C A schematic diagram of an application scenario of tracking and driving away a suspicious vehicle involved in a control method for a security device provided in an embodiment of the present application;

[0100] Figure 6 A schematic diagram of the structure of a control system of a security device provided in an embodiment of the present application;

[0101] Figure 7 A schematic diagram of the structure of a control device for security equipment provided in an embodiment of the present application;

[0102] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0103] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. It should be noted that unless otherwise specifically stated, the relative arrangement of the components and steps, the numerical expressions and the numerical values ​​described in these embodiments do not limit the scope of the present application.

[0104] Those skilled in the art will understand that the terms "first" and "second" in the embodiments of the present application are only used to distinguish between different steps, devices, modules and other objects, and do not represent any specific technical meanings, nor do they indicate the logical order between them.

[0105] It should also be understood that in this embodiment, “plurality” may refer to two or more than two, and “at least one” may refer to one, two or more than two.

[0106] It should also be understood that any component, data or structure mentioned in the embodiments of the present application can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0107] In addition, the term "and / or" in this application is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this application generally indicates that the associated objects before and after are in an "or" relationship.

[0108] It should also be understood that the description of the various embodiments in this application focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0109] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present application, its application, or uses.

[0110] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the above-mentioned technologies, methods, and equipment should be considered as part of the specification.

[0111] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0112] It should be noted that, in the absence of conflict, the embodiments in this application and the features in the embodiments can be combined with each other. To facilitate the understanding of the embodiments of the present application, the present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0113] In addition, it should be noted that the users described in this application (such as target users) can be distinguished by user identifiers. For example, a user identifier can be a login account. In this scenario, if different persons use the same account to log in, the above-mentioned different persons can be considered to be the same user; if the same person uses different accounts to log in, the same person who logs in to different accounts can be considered to be different users. For another example, when the device is not logged in, the user identifier can also be assigned based on the device identifier of the device. In this scenario, if different persons use devices with the same device identifier to operate, the above-mentioned different persons can be considered to be the same user; if the same person uses devices with different device identifiers to operate, the above-mentioned same person can be considered to be different users.

[0114] In order to solve the technical problem of high complexity of monitoring by security equipment in the prior art, the present application provides a control method for security equipment, which can reduce the complexity of users using security equipment for monitoring.

[0115] Figure 1 A flow chart of a control method for a security device provided in an embodiment of the present application. The method can be applied to one or more electronic devices such as a control device, a smart phone, a laptop computer, a desktop computer, a portable computer, a server, etc. In addition, the execution subject of the method can be hardware or software. When the above-mentioned execution subject is hardware, the execution subject can be one or more of the above-mentioned electronic devices. For example, a single electronic device can execute the method, or multiple electronic devices can cooperate with each other to execute the method. When the above-mentioned execution subject is software, the method can be implemented as multiple software or software modules, or as a single software or software module. No specific limitation is made here.

[0116] like Figure 1 As shown, the method specifically includes:

[0117] Step 101, obtaining a target image set corresponding to a security device set.

[0118] In this embodiment, the security device set may include at least two security devices. The security device may include at least one of the following: a camera, an alarm, a sensor, etc.

[0119] For example, a single security device in the security device set may be: a camera, an alarm, or a sensor. For another example, a single security device in the security device set may include: a camera and an alarm.

[0120] The target image set corresponding to the security device set may be a set of images obtained by capturing images of the security devices in the security device set (hereinafter referred to as method 1). For example, the target image set corresponding to the security device set may be obtained by capturing images of each security device in the security device set via one or more cameras.

[0121] Alternatively, the target image set corresponding to the security device set may also be a set of images acquired through the cameras in the security device set (hereinafter referred to as Mode 2). For example, each security device in the security device set may include a camera, and thus, the target image set corresponding to the security device set may be acquired by acquiring images of the area within the shooting range of the cameras included in the security device set.

[0122] Step 102: extracting calibration objects from the target image set.

[0123] In this embodiment, the calibration object may be a preset physical entity or images of multiple physical entities with known positional relationships. For example, the calibration object may be an image of a preset tree at the user's residence, or another example, the calibration object may be an image of the door of the user's residence and a preset tree, or the calibration object may be an image of the user himself, an object held by the user, etc. in a target image set captured by the security device set when the user walks around the security device set.

[0124] Step 103: establishing associations between the security devices based on the calibration objects.

[0125] In this embodiment, the association relationship may include at least one of the following: position relationship (e.g., whether adjacent, relative position, etc.), whether paired, whether having a shared field of view, etc. Among them, if two security devices include camera A and camera B respectively, if camera A is used to capture a telephoto image of subject A, and camera B is used to capture a wide-angle image of subject A, then it can be determined that the association relationship between the above two security devices represents paired operation. The association relationship may include the association relationship between all or part of the security devices in the security device set.

[0126] As an example, when the target image set is obtained by the method described in Mode 1, the relative position of each security device in the security device set can be determined based on the target image set, so that the determined relative position is used as an association relationship.

[0127] As another example, when the target image set is obtained by adopting the method of method 2 as described above, the position relationship of each security device in the security device set (for example, whether they are adjacent, relative position, etc.), whether they work in pairs, whether they have a shared field of view, etc. can be determined based on the target image set to obtain the association relationship.

[0128] Step 104: when it is detected that there is a target object in the security area monitored by the security device set, one or more linked security devices are determined from the security device set based on the association relationship and the target information of the target object.

[0129] In this embodiment, the security area may be the security area of ​​the security equipment in the security equipment set. For example, the security area may be the shooting range of the camera included in the security equipment set.

[0130] The target object may be an object located in the security area. As an example, the target object may be an image of an object in the security area that is in a moving state at a historical time or at a current time. In addition, the target object may include an image of at least one of the following objects: a person, a vehicle, an animal, etc.

[0131] The target information may include at least one of the following information of the target object: posture information, focal length information, appearance feature information, moving speed, etc.

[0132] As an example, if the target information of the target object represents that the moving speed of the target object is less than or equal to a preset speed value, then the security area of ​​a single security device A where the target object is located can be determined first, and then a security device that has an associated relationship of pairing with security device A (a type of associated relationship, for example, a telephoto camera and a wide-angle camera can be paired) is determined from the security device set, and the security device is used as a linked security device.

[0133] As another example, if the target information of the target object represents that the moving speed of the target object is greater than the above-mentioned preset speed value, then, the security area of ​​the single security device A where the target object is located can be determined first, and then the security device that has an associated relationship with the security device A that shares a field of view (a type of associated relationship, for example, two adjacent cameras can share a field of view) is determined from the security device set, and the security device is used as a linked security device.

[0134] As another example, it is possible to determine whether the objects indicated by the two images are the same object based on the posture information and / or the appearance feature information. If they are the same object, it can be determined that the two security devices that captured the two images have a shared field of view (a type of association relationship, for example, two adjacent cameras can share a field of view), and when the target object is located in the security area monitored by one of the security devices, the other security device is used as a linked security device.

[0135] As another example, it is possible to determine whether the objects indicated by the two images are the same object based on the posture information and / or the appearance feature information. If they are the same object, and the focal lengths indicated by the focal length information of the two images are different, it can be determined that the two security devices that captured the two images have a paired working relationship (a type of associated relationship, such as a telephoto camera and a wide-angle camera can work in pairs), and when the target object is located in the security area monitored by one of the security devices, the other security device is used as a linked security device.

[0136] It can be understood that, when the same security device A has a first relationship with security device B (i.e., a shared field of view) and a second relationship with security device C (i.e., a paired working relationship), it can be determined based on the moving speed of objects in the security area monitored by the security device to determine whether security device B or security device C is determined as a linked security device.

[0137] Step 105: Control the linked security device to perform the monitoring operation.

[0138] In this embodiment, each security device in the security device set may be associated with one or more monitoring operations, and based on the association, the monitoring operation to be performed by the linked security device may be determined.

[0139] The monitoring operation may include at least one of the following: an image acquisition operation and an early warning operation. For example, if the security device is a camera, the security device may perform an image acquisition operation. If the security device is an alarm, the security device may perform an early warning operation.

[0140] Here, each security device in the above security device set may be associated with one or more monitoring operations. Based on the association, the monitoring operation to be performed by the linked security device may be determined.

[0141] In addition, the linkage rules can be determined in advance, and then based on the linkage rules, the monitoring operations to be performed by the linkage security device can be determined. For example, the linkage rules can be determined based on user needs and at least one of the above-mentioned association relationships. The linkage rules are used to instruct the linkage security device to perform monitoring operations. For example, when the front yard camera recognizes that there is a courier at the front yard door, the front door camera (linked security device) can be awakened to perform package detection. Among them, the operations performed by the devices that perform execution actions in the entire event can be used as monitoring operations. For example, the camera at the front door detects the face and makes a courier judgment. After the courier enters the courtyard, the camera in the courtyard performs associated video recording. When the doorbell camera arrives at the door, it performs package detection and makes a signal broadcast. These can all be regarded as monitoring operations.

[0142] Further, after the linked security device and the monitoring operation to be performed by the linked security device are determined, the linked security device may be controlled to perform the monitoring operation.

[0143] In some optional implementations of this embodiment, the target information includes at least the following information: an object type of the target object and the security device that detects the target object.

[0144] On this basis, the following methods can be used to control one or more of the linked security devices to perform monitoring operations on the target object:

[0145] The first step is to identify the event triggered by the target object based on the target information.

[0146] The events triggered by the target object may include at least one of the following: indoor intrusion, visit by relatives or friends, etc.

[0147] The second step is to control the linkage security device to execute the monitoring operation for monitoring the event.

[0148] Here, each event can be pre-associated with one or more monitoring operations. The monitoring operation pre-associated with the event is the monitoring operation used to monitor the event. Thus, the linkage security device can be controlled to execute the monitoring operation used to monitor the event.

[0149] It can be understood that in the above optional implementation method, the linked security equipment can be controlled to perform corresponding monitoring operations based on the events triggered by the target object. In this way, different monitoring operations can be performed based on different events, thereby improving the pertinence and safety of security.

[0150] In some optional implementations of this embodiment, the following method may be used to determine one or more linked security devices from the security device set based on the association relationship and the target information of the target object:

[0151] The first step is to determine whether the target object is located in the security area monitored by the target camera.

[0152] The target camera may be any camera in the above security equipment set. The target camera is any camera in the above security equipment set.

[0153] In the second step, when the target object is located in the security area monitored by the target camera, based on the association relationship, the linked security device associated with the target camera is determined from the security device set.

[0154] Here, since the association relationship may indicate the security device associated with the target camera in the security device set, the security device associated with the target camera may be determined from the security device set based on the association relationship, and the security device may be used as the linkage security device.

[0155] Furthermore, the following method can be used to control one or more of the linked security devices to perform monitoring operations on the target object: when the linked security device includes an audio output device, the audio output device is controlled to output the prompt audio corresponding to the target object to perform the monitoring operation.

[0156] The above-mentioned prompt audio may be a preset audio corresponding to the target object, for example, the prompt audio may be an audio of "You have entered the security area". In addition, the above-mentioned prompt audio may also be determined based on the object type of the target object captured by the target camera. For example, if the image captured by the target camera includes an image of a courier (i.e., the object type), then the prompt audio may be an audio of "Please place the courier at XX location".

[0157] It is understood that in the above optional implementation, when the linkage security device includes an audio output device (such as an intercom), the prompt audio corresponding to the target object can be automatically output via the audio output device to perform the monitoring operation. In this way, more intelligent monitoring can be achieved.

[0158] In some optional implementations of this embodiment, when the monitoring operation is used to perform image acquisition, the following steps may also be performed:

[0159] The first step is to obtain the image obtained by the linkage security device performing the monitoring operation to obtain a monitoring image.

[0160] The monitoring image may be an image obtained by linking the security equipment to perform the monitoring operation.

[0161] The second step is to extract at least one of the following feature information of the target object from the surveillance image: facial image, license plate number, movement trajectory, first appearance time, first appearance location, departure time, and departure location.

[0162] The third step is to send the characteristic information to a preset user terminal so that the user terminal displays event information determined based on the characteristic information; or, determine event information based on the characteristic information, and send the event information to a preset user terminal so that the user terminal displays the event information; wherein the event information represents an event triggered by the target object.

[0163] The event information may include at least one of the following: indoor intrusion, visit by relatives or friends, etc.

[0164] It can be understood that in the above optional implementation, the above feature information can be automatically extracted from the surveillance image for secondary processing, thereby improving the efficiency of users in knowing the security status.

[0165] The control method of security equipment provided in the embodiment of the present application can obtain the target image set corresponding to the security equipment set, so as to subsequently establish the association relationship of the security equipment, then extract the calibration object from the target image set, and establish the association relationship between the security equipment based on the calibration object, so as to automatically determine the association relationship of the security equipment through the target image set, and then, when it is detected that there is a target object in the security area monitored by the security equipment set, one or more linkage security equipment is determined from the security equipment set based on the association relationship and the target information of the target object, and then, one or more linkage security equipment is controlled to perform monitoring operations on the target object. Thus, based on the target image set corresponding to the security equipment set, the association relationship of the security equipment in the security equipment set can be automatically determined, and the linkage security equipment can be controlled to perform monitoring operations, so that the degree of automation of users using security equipment for monitoring can be improved, and the complexity of users using security equipment for monitoring can be reduced.

[0166] Figure 2 A flowchart of another method for controlling a security device provided in an embodiment of the present application. Figure 2 As shown, the method specifically includes:

[0167] Step 201, acquiring images collected by the security devices in the security device set to obtain a target image set, wherein the security devices and the target images correspond one to one, and the security devices include cameras.

[0168] In this embodiment, the security device set may include at least two security devices. The security device may include at least one of the following: a camera, an alarm, a sensor, etc.

[0169] For example, a single security device in the security device set may be: a camera, an alarm, or a sensor. For another example, a single security device in the security device set may include: a camera and an alarm.

[0170] The target image set corresponding to the security device set may be a set of images obtained by capturing images of the security devices in the security device set. For example, the target image set corresponding to the security device set may be obtained by capturing images of each security device in the security device set via one or more cameras.

[0171] Alternatively, the target image set corresponding to the security device set may also be a set of images acquired through the cameras in the security device set. For example, each security device in the security device set may include a camera, and thus, the target image set corresponding to the security device set may be acquired by acquiring images of the area within the shooting range of the cameras included in the security device set.

[0172] Specifically, if the security device set includes security device A, security device B and security device C, and security device A captures image A, security device B captures image B, and security device C captures image C, then the target image set may include image A, image B and image C.

[0173] In this embodiment, the corresponding relationship between the security device and the target image is as follows: the target image is acquired through the security device having a corresponding relationship with the target image.

[0174] Step 202: extracting calibration objects from the target image set.

[0175] In this embodiment, step 202 and Figure 1 Step 102 in the corresponding embodiment is basically the same and will not be described again here.

[0176] Step 203: Determine the acquisition time of the target image in the target image set.

[0177] In this embodiment, when the target image is captured, the capture time can be recorded.

[0178] Step 204: determining the association relationship among the security devices in the security device set based on the determined collection time and the calibration object.

[0179] In this embodiment, after the collection time and the calibration object are obtained, the association relationship of the security devices in the security device set may be determined based on the determined collection time and the calibration object.

[0180] For example, the target object appears in the target images of camera A and camera B at the same time. At another moment, the target object appears in the target images of camera A and camera C at the same time. This means that at the first appearance, camera A and camera B are cameras with a shared field of view (that is, the above-mentioned association relationship), and at the second appearance, camera A and camera C are cameras with a shared field of view (that is, the above-mentioned association relationship).

[0181] Based on this association, tracking without blind spots can be achieved. For example, when the target object is about to leave the camera A's camera range and is judged to enter the camera B's monitoring area based on its target information, camera B will take over the recording while camera C is still dormant, which can save power. When the target object is about to leave the camera A's camera range and is judged to enter the camera C's monitoring area, camera C will be awakened to record while camera B is dormant.

[0182] For another example, if camera A and camera B simultaneously capture a vehicle target (i.e., the target object mentioned above), camera A can capture a clear license plate image, while camera B can only capture the vehicle exterior. In this case, camera A and camera B are paired telephoto and wide-angle cameras, with camera A being a telephoto lens and camera B being a wide-angle lens. They can work together to track the vehicle, with the telephoto lens recognizing the license plate and the wide-angle lens recording the vehicle exterior features.

[0183] Step 205: when it is detected that there is a target object in the security area monitored by the security device set, one or more linked security devices are determined from the security device set based on the association relationship and the target information of the target object.

[0184] In this embodiment, step 205 and Figure 1 Step 104 in the corresponding embodiment is basically the same and will not be described again here.

[0185] Step 206: Control one or more of the linked security devices to perform monitoring operations on the target object.

[0186] In this embodiment, step 206 and Figure 1 Step 105 in the corresponding embodiment is basically the same and will not be described again here.

[0187] In some optional implementations of this embodiment, the following method may be used to determine the association relationship of the security devices in the security device set based on the determined collection time and the calibration object:

[0188] First, based on the determined acquisition time and the calibration object, it is determined whether the target image set includes a first target image subset.

[0189] The acquisition time of each of the target images in the first target image subset is the same, and at least part of the calibration objects of each of the target images in the first target image subset indicate the same photographed object.

[0190] Afterwards, when the target image set includes the first target image subset, determining that the association relationship of the security devices in the first security device subset represents a first relationship.

[0191] The security devices in the first security device subset acquire the target images in the first target image subset, and the first relationship represents a shared field of view.

[0192] As an example, if the target object appears in the target images of camera A and camera B at the same time, it means that camera A and camera B are cameras with a shared field of view (ie, the above-mentioned association relationship).

[0193] It can be understood that in the above optional implementation, it can be automatically determined whether the security equipment (camera) shares the field of view based on the determined collection time and the calibration object.

[0194] In some application scenarios of the above optional implementation manners, the following manner may be adopted to determine one or more linked security devices from the security device set based on the association relationship and the target information of the target object:

[0195] When the association relationship represents the first relationship and the target object is located in the security area monitored by the first security device subset, the security device corresponding to the security area to be entered by the target object is determined as the linkage security device from the first security device subset.

[0196] The linked security device may be a security device corresponding to the security area that the target object is about to enter and used to monitor.

[0197] On this basis, the following method can be used to control one or more of the linked security devices to perform monitoring operations on the target object: after waking up the linked security device, control the linked security device to collect images of the target object to perform the monitoring operation.

[0198] It can be understood that in the above application scenario, when the first security device subset includes security device A and security device B, and security device A and security device B have the above first relationship (i.e., shared field of view), if the current target object is located in the security area of ​​security device A, then security device B can be in a dormant state at this time, and as the target object moves, security device B (i.e., the above linked security device) can be awakened, and then security device B can be controlled to collect images for the target object to perform the monitoring operation. In this way, security monitoring can be achieved more intelligently.

[0199] In some optional implementations of this embodiment, the following method may be used to determine the association relationship of the security devices in the security device set based on the determined collection time and the calibration object:

[0200] First, based on the determined acquisition time and the calibration object, it is determined whether the target image set includes a second target image subset.

[0201] The second target image subset includes a telephoto image and a wide-angle image of the same photographed object.

[0202] Afterwards, when the target image set includes the second target image subset, determining that the association relationship of the security devices in the second security device subset represents a second relationship.

[0203] The security devices in the second security device subset acquire the telephoto image or the wide-angle image, and the second relationship represents a telephoto camera and a wide-angle camera working in pair.

[0204] As an example, if camera A and camera B simultaneously capture a vehicle target (i.e., the target object mentioned above), camera A can capture a clear license plate image, and camera B can only capture the vehicle exterior. In this case, camera A and camera B are paired telephoto and wide-angle cameras, with camera A being a telephoto lens and camera B being a wide-angle lens. They can work together to track the vehicle, with the telephoto lens recognizing the license plate and the wide-angle lens recording the vehicle exterior features.

[0205] It can be understood that in the above optional implementation, whether the security device (camera) is paired and working can be automatically determined based on the determined collection time and the calibration object.

[0206] In some application scenarios of the above optional implementation manners, the following manner may be adopted to determine one or more linked security devices from the security device set based on the association relationship and the target information of the target object:

[0207] In a case where the association relationship indicates the second relationship, the security devices in the second security device subset are respectively determined as linked security devices.

[0208] On this basis, the following methods can be used to control one or more of the linked security devices to perform monitoring operations on the target object:

[0209] The first step is to control the telephoto camera to capture a telephoto image of the target object.

[0210] The second step is to control the wide-angle camera to capture a wide-angle image of the target object.

[0211] It can be understood that in the above application scenario, when the second security device subset includes security device C and security device D, and security device C and security device D have the above second relationship (i.e., a telephoto camera and a wide-angle camera used in pairs), if the current target object is located in the security area of ​​security device C, then security device D can be determined as a linked security device, and then security device D can be controlled to perform image acquisition for the target object to perform the monitoring operation. In this way, both the overall image of the target object and the detailed features of the target object can be obtained, and security monitoring can be achieved more intelligently, and the safety of the placement can be improved.

[0212] It should be noted that, in addition to the above contents, this embodiment may also include Figure 1 The corresponding technical features described in the corresponding embodiments are realized Figure 1 For details, please refer to the technical effects of the control method of the security equipment shown. Figure 1 For the sake of brevity, the relevant description is not repeated here.

[0213] The control method of security equipment provided in the embodiment of the present application determines the association relationship of the security equipment in the security equipment set through the determined collection time and calibration object, so that the accuracy of determining the association relationship of the security equipment can be improved.

[0214] The following is an illustrative description of the embodiments of the present application, but it should be noted that the embodiments of the present application may have the features described below, but the following description does not constitute a limitation on the scope of protection of the embodiments of the present application.

[0215] First, the technical terms involved in this method are explained as follows:

[0216] The main controller is a hardware device that can be used to connect, receive and forward information, process information, and control security monitoring equipment such as cameras, sensors, alarms, etc. in the area (such as the above-mentioned security equipment).

[0217] Security equipment can be a general term for various devices used for regional security protection, such as cameras, sensors, and alarms.

[0218] Security records can be a collection of content generated by various security devices such as video recordings and event alarms for transmitting security information.

[0219] A pan / tilt camera may be a camera that has the ability to rotate the lens horizontally and vertically.

[0220] AI (Artificial Intelligence) target recognition refers to the technology that detects moving targets and analyzes target features based on computer vision and AI algorithms to identify the same target.

[0221] Multimodality can refer to the use of multiple different media or modes to convey information or communicate.

[0222] The shared field of view may refer to the area where the surveillance images of multiple cameras overlap.

[0223] Starting field of view angle. It can refer to the rotation angle of the lens when a PTZ camera starts to detect the target in the picture.

[0224] The extreme field of view angle may refer to the lens rotation angle at which a PTZ camera can no longer track the target by rotating the lens.

[0225] Calibration refers to automatically establishing the relationship between security devices through a series of tests and adjustments to the security devices and the main controller.

[0226] Users' security needs mainly include three aspects:

[0227] 1. The security coverage area should be as large as possible.

[0228] 2. Be able to obtain as much detailed information as possible.

[0229] 3. Ability to link logically related security records for better understanding and analysis.

[0230] Currently, the above requirements are mainly met by the device linkage function manually configured by users. The current linkage function is described as follows:

[0231] 1. The user manually builds a building model, manually groups cameras and sets physical codes to represent the adjacent installation positions or whether there are overlapping areas between the cameras.

[0232] 2. Users can design linkage rules based on the installation location of the device and other information. When a device triggers monitoring or detects the movement of an object, other devices can be linked to record. For example, when the front door camera detects movement, the front yard camera can be turned on to record.

[0233] 3. When the linkage rule is triggered, the associated device generates a video and sends a notification to the user. The user stitches the captured images together based on the device association and the time sequence of the capture to confirm what happened.

[0234] The linkage function manually configured by users currently has the following problems:

[0235] 1. Users are required to create the building model by themselves and determine the installation location of the equipment, which is difficult for users in home scenarios to complete independently.

[0236] 2. Designing linkage rules requires users to have strong logical thinking and spatial imagination, and be able to judge the relationship between devices on their own, and the threshold for use is high.

[0237] 3. It can only stitch images captured by associated devices, and cannot perform secondary processing on the images to extract key information such as face screenshots, license plate numbers, intrusion trajectories, etc. The efficiency of users obtaining information from images is low.

[0238] In view of this, the following method can be used to solve the above problems:

[0239] Please refer to Figure 3 , Figure 3 A flowchart of another method for controlling a security device provided in an embodiment of the present application.

[0240] 1. The main controller (a local control base station connected to multiple cameras) uses the target recognition algorithm to identify the target image (i.e. the target image set) that has been recorded in the main controller, and automatically determines the relationship between cameras based on the time sequence of the target (i.e. the calibration object) appearing in different cameras (i.e. the security equipment), the content of the captured image, and the identified target information. The relationship includes: adjacent cameras, cameras with a shared field of view, paired telephoto and wide-angle cameras, etc.

[0241] For example, if the calibration object appears in the images of camera A and camera B at the same time, and appears in the images of camera A and camera C at another time, it means that camera A and camera B are cameras with a shared field of view at the first appearance, and camera A and camera C are cameras with a shared field of view at the second appearance. Based on this association, no-blind-angle tracking can be achieved. When the suspicious target is about to leave the camera A's shooting range and is judged to be about to enter the monitoring area of ​​camera B based on its target information, camera B will take over the recording, while camera C is still dormant, which can save power; and when the target is about to leave the camera A's shooting range and is judged to be about to enter the monitoring area of ​​camera C, camera C will be awakened to record and camera B will be dormant.

[0242] For another example, when camera A and camera B simultaneously capture a vehicle target, camera A can capture a clear license plate image, while camera B can only capture the vehicle exterior. In this case, camera A and camera B are paired telephoto and wide-angle cameras, with camera A being a telephoto lens and camera B being a wide-angle lens. They can work together to track the vehicle, with the telephoto lens recognizing the license plate and the wide-angle lens recording the vehicle exterior features.

[0243] 2. The user selects a preset linkage application scenario and selects the associated device group to execute the linkage (that is, the above-mentioned linkage security device). The main controller automatically generates linkage rules for multi-modal condition judgment based on the application scenario requirements and the association relationship between the devices (expressed using the above-mentioned association relationship).

[0244] The linkage rules of multimodal conditional judgment can perform different actions after the linkage is triggered based on different AI recognition results or trigger time and other conditions. Compared with simple triggering and execution linkage methods, it can more flexibly meet user needs.

[0245] For example, if the user selects the front yard guard application scenario, he / she selects the front yard associated security device group to perform linkage. The associated security device group includes the front yard entrance camera, front yard camera, and front door doorbell.

[0246] The requirements of this application scenario are that when the courier enters the front yard, the loudspeaker reminds him to put the package at the designated location at the front door, and the user is notified when there is a package at the front door; when the user and his family members return home, the indoor camera is turned off to protect the user's privacy.

[0247] Based on this requirement and the association between devices, the main controller generates multimodal conditional judgment linkage rules. Since the front door / front yard camera has a wide shooting angle and the front doorbell has a small shooting range, the front door / front yard camera is responsible for detecting and identifying people. Since the front doorbell is a battery-powered device, it needs to go into sleep mode to save power. Therefore, when the main controller determines that the courier has been identified by the front yard camera / front yard, it wakes up the front doorbell for package detection. Ultimately, the courier is found in the front yard, and when there is a package at the door, a package arrival notification is sent to the user. If a user or family member is found in the front yard, the doorbell will not be woken up, and the indoor camera will be turned off to protect privacy.

[0248] 3. The user manually fine-tunes the linkage rules, customizes the response actions after linkage such as sound and light alarms, lighting, etc. in the linkage rules, and generates the final linkage rules and stores them in the main controller.

[0249] 4. When any device detects a monitoring target (that is, the target object mentioned above, such as a stranger), it reports the identified target type and identity ID (for example, a stranger or an acquaintance) to the main controller. The main controller retrieves the linkage rule list, matches the device ID of the reported event with the identified target type and identity ID, determines which linkage rule is triggered, and determines what actions other devices in the associated device group should perform subsequently (that is, the above-mentioned monitoring operation).

[0250] After the main controller determines the linkage rules to be executed, it wakes up the corresponding associated device group and executes the actions set in the linkage rules such as recording, identification, and alarm.

[0251] For example, the front door camera detects that a courier has entered the front yard and sends an event message to the main controller. The main controller retrieves the two trigger conditions of the front door camera and the recognition of the courier in the linkage rule list, and successfully matches the "front yard package protection" linkage rule. The rule stipulates that if a courier enters the front yard, the front yard camera broadcasts a notification to the courier to "put the package at the front door" and wakes up the front doorbell for package detection. The main controller then sends broadcast and wake-up recording instructions for package detection to the front yard camera and front door lock respectively, completing the linkage.

[0252] 5. Use the main controller to extract key information such as face screenshots, license plate numbers, intrusion trajectories, etc. from the security records generated by the security equipment, and then splice them into related records through association relationships.

[0253] Two typical application scenarios are as follows:

[0254] Figure 4A-4C A schematic diagram of an application scenario of tracking and expelling strangers involved in a control method of a security device provided in an embodiment of the present application. The application scenario process is as follows:

[0255] 1. The user enters his ID into the main controller, starts the calibration process, and slowly walks around the house

[0256] 2. The main controller recognizes the time sequence of the user and the pan / tilt rotation angle through each camera, and determines the relative position relationship between the cameras.

[0257] 3. The main controller automatically generates linkage rules based on the relative position relationship between cameras.

[0258] 4. The user manually adjusts and selects the target type to be tracked as stranger, and adds expulsion actions such as sound and light alarms.

[0259] 5. Establish complete rules for tracking and expelling strangers.

[0260] The linkage effects are as follows:

[0261] 1. If a stranger invades the perimeter of the house, any camera detects the stranger, triggering the stranger tracking and expulsion linkage, and pushing a message to the user.

[0262] 2. The main controller collects the images returned by each camera, and uses the AI ​​image algorithm to determine the area the stranger is about to enter based on his or her direction and speed in the image, and wakes up the camera in the designated area to start recording, tracking, and sound and light alarms.

[0263] 3. When the stranger moves away from the home perimeter, the camera stops recording and alarming.

[0264] 4. The main controller collects video footage from multiple cameras; uses an AI face detection algorithm to extract clear facial portraits from multiple video clips; and draws the stranger's intrusion trajectory based on the time sequence in which the stranger appears on each camera screen.

[0265] 5. The main controller combines multimodal key information such as video recording, face portrait, intrusion trajectory, first appearance time, first appearance location, departure time, departure location, etc. to form an event card for users to view.

[0266] Figure 5A-5C A schematic diagram of an application scenario of tracking and driving away a suspicious vehicle involved in a control method of a security device provided in an embodiment of the present application. As shown in the figure, the application scenario process is as follows:

[0267] 1. Enter the user's vehicle ID into the main controller, start the calibration process, and park the vehicle in a location where suspicious vehicles may appear.

[0268] 2. The main controller collects the image content captured by each camera, and automatically assigns the work roles of recognizing license plates and recording vehicle images to multiple cameras based on conditions such as whether there is a target vehicle in the image and whether the license plate information can be recognized.

[0269] 3. The main controller automatically generates linkage rules based on the above role allocation.

[0270] 4. The user manually adjusts and selects the time period in which this linkage needs to be executed, and manually adds expulsion actions such as sound and light alarms.

[0271] 5. Establish complete rules for tracking and removing suspicious vehicles.

[0272] The linkage effects are as follows:

[0273] 1. When a vehicle is parked near a house, any camera detects the vehicle and identifies it as a strange vehicle, triggering the suspicious vehicle tracking and expulsion linkage.

[0274] 2. The main controller wakes up the camera used to take pictures of the license plate information, rotates the angle to take a clear picture of the license plate, and runs the license plate recognition algorithm to read the license plate information. In addition, it wakes up the camera used to take pictures of other features of the vehicle to obtain the vehicle's action video. At the same time, it wakes up the alarm to sound an alarm and drive the vehicle away.

[0275] 3. When the vehicle leaves the monitoring area and loses the target for 1 minute, the alarm and recording will stop and the system will return to sleep mode.

[0276] 4. The main controller extracts the vehicle’s license plate information, vehicle color, vehicle type and other information, splices multiple camera recordings, and generates a suspicious vehicle tracking event card for users to quickly obtain key event information.

[0277] It should be noted that, in addition to the contents recorded above, this embodiment may also include the technical features described in the above embodiments, so as to achieve the technical effects of the control method of the security equipment shown above. Please refer to the above description for details. For the sake of brevity, it will not be repeated here.

[0278] The control method of security equipment provided in the embodiment of the present application can lower the threshold for establishing equipment linkage rules and save user energy. The generated association records improve the efficiency of users in obtaining information and enhance the user experience. In addition, based on the AI ​​target recognition algorithm, the association relationship between devices is automatically determined and linkage rules are automatically generated. The main controller uses AI target recognition and AI target detection algorithms to extract key information from the screen and realize multi-modal information splicing and display.

[0279] Figure 6 This is a schematic diagram of the structure of a control system of a security device provided in an embodiment of the present application. Figure 6 As shown, the security system 10 includes a security device set 11 and a control device 12 .

[0280] The control device 12 is used to execute any of the above-mentioned methods for controlling security equipment.

[0281] The security system provided by the embodiment of the present application includes a security device set and a control device. Among them, the control device can obtain a target image set corresponding to the security device set so as to subsequently establish an association relationship between the security devices, then extract a calibration object from the target image set, and establish an association relationship between the security devices based on the calibration object, so as to automatically determine the association relationship of the security devices through the target image set, and then, when it is detected that there is a target object in the security area monitored by the security device set, one or more linkage security devices are determined from the security device set based on the association relationship and the target information of the target object, and then, one or more linkage security devices are controlled to perform monitoring operations on the target object. Therefore, based on the target image set corresponding to the security device set, the association relationship of the security devices in the security device set can be automatically determined, and the linkage security devices can be controlled to perform monitoring operations, so that the degree of automation of users using security devices for monitoring can be improved, and the complexity of users using security devices for monitoring can be reduced.

[0282] Figure 7 A schematic diagram of the structure of a control device for security equipment provided in an embodiment of the present application. Specifically comprising:

[0283] The first acquisition unit 401 is used to acquire a target image set corresponding to a security device set;

[0284] A first extraction unit 402, configured to extract a calibration object from the target image set;

[0285] An establishing unit 403, configured to establish an association relationship between the security devices based on the calibration object;

[0286] A determination unit 404 is configured to determine one or more linked security devices from the security device set based on the association relationship and target information of the target object when a target object is detected in the security area monitored by the security device set;

[0287] The control unit 405 is used to control one or more of the linked security devices to perform monitoring operations on the target object.

[0288] In a possible implementation manner, the security device includes a camera; and

[0289] The step of obtaining a target image set corresponding to a security device set includes:

[0290] Acquire images captured by the security devices in the security device set to obtain a target image set, wherein the security devices and the target images correspond one to one; and

[0291] The establishing of the association relationship between the security devices based on the calibration object includes:

[0292] Determining a capture time of the target image in the target image set;

[0293] An association relationship between the security devices in the security device set is established based on the determined collection time and the calibration object.

[0294] In a possible implementation, establishing an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes:

[0295] Based on the determined acquisition time and the calibration object, determining whether the target image set includes a first target image subset, wherein the acquisition time of each target image in the first target image subset is the same, and at least part of the calibration objects of each target image in the first target image subset indicates a same photographed object;

[0296] In a case where the target image set includes the first target image subset, determining that the association relationship of the security devices in the first security device subset represents a first relationship, wherein the first relationship represents a shared field of view, and the security devices in the first security device subset acquire the target images in the first target image subset.

[0297] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0298] In a case where the association relationship represents the first relationship and the target object is located in a security area monitored by the first security device subset, determining, from the first security device subset, a security device corresponding to the security area to be entered by the target object for monitoring as a linkage security device; and

[0299] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0300] After waking up the linkage security device, the linkage security device is controlled to collect images of the target object to perform the monitoring operation.

[0301] In a possible implementation, establishing an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes:

[0302] Based on the determined acquisition time and the calibration object, determining whether the target image set includes a second target image subset, wherein the second target image subset includes a telephoto image and a wide-angle image of the same photographed object;

[0303] In a case where the target image set includes the second target image subset, determining that the association relationship of the security devices in the second security device subset represents a second relationship, wherein the second relationship represents a telephoto camera and a wide-angle camera working in pair, the telephoto camera is used to capture telephoto images, and the wide-angle camera is used to capture wide-angle images.

[0304] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0305] In a case where the association relationship indicates the second relationship, respectively determining the security devices in the second security device subset as linked security devices; and

[0306] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0307] Controlling the telephoto camera to capture a telephoto image of the target object;

[0308] The wide-angle camera is controlled to capture a wide-angle image of the target object.

[0309] In a possible implementation manner, the target information includes at least the following information: the object type of the target object, the security device that detects the target object; and

[0310] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0311] Based on the target information, identifying an event triggered by the target object;

[0312] The linked security device is controlled to perform the monitoring operation for monitoring the event.

[0313] In a possible implementation manner, determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes:

[0314] Determine whether the target object is located in a security area monitored by a target camera; the target camera is any one of the security device set;

[0315] In a case where the target object is located in a security area monitored by the target camera, based on the association relationship, determining a linkage security device associated with the target camera from the security device set; and

[0316] The controlling one or more linkage security devices to perform monitoring operations on the target object includes:

[0317] In the case where the linkage security device includes an audio output device, the audio output device is controlled to output the prompt audio corresponding to the target object to perform the monitoring operation.

[0318] In a possible implementation manner, when the monitoring operation is used to perform image acquisition, the device further includes:

[0319] A second acquisition unit (not shown in the figure) is used to acquire an image obtained by the linked security device performing the monitoring operation to obtain a monitoring image;

[0320] A second extraction unit (not shown in the figure) is used to extract at least one of the following feature information of the target object from the monitoring image: face image, license plate number, movement trajectory, first appearance time, first appearance location, departure time, and departure location;

[0321] A sending unit (not shown in the figure) is used to send the characteristic information to a preset user terminal so that the user terminal displays event information determined based on the characteristic information; or to determine event information based on the characteristic information, and send the event information to a preset user terminal so that the user terminal displays the event information; wherein the event information represents an event triggered by the target object.

[0322] The control device of the security equipment provided in this embodiment can be as follows Figure 7 The control device of the security equipment shown in can execute all steps of the control method of each security equipment described above, thereby achieving the technical effects of the control method of each security equipment described above. Please refer to the above related description for details. For the sake of brevity, it will not be repeated here.

[0323] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application, Figure 8 The electronic device 500 shown includes: at least one processor 501, a memory 502, at least one network interface 504 and other user interfaces 503. The various components in the electronic device 500 are coupled together via a bus system 505. It is understood that the bus system 505 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 505 is not shown in FIG. Figure 8 Various buses are labeled as bus system 505 .

[0324] The user interface 503 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).

[0325] It can be understood that the memory 502 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 502 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0326] In some implementations, the memory 502 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 5021 and an application program 5022 .

[0327] Among them, the operating system 5021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 5022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present application can be included in the application 5022.

[0328] In this embodiment, by calling the program or instruction stored in the memory 502, specifically, the program or instruction stored in the application 5022, the processor 501 is used to execute the method steps provided by each method embodiment, for example, including:

[0329] Get the target image set corresponding to the security equipment set;

[0330] Extracting a calibration object from the target image set;

[0331] Establishing an association relationship between the security devices based on the calibration object;

[0332] In the case where a target object is detected in the security area monitored by the security device set, one or more linked security devices are determined from the security device set based on the association relationship and the target information of the target object;

[0333] Control one or more of the linked security devices to perform monitoring operations on the target object.

[0334] The method disclosed in the above embodiment of the present application can be applied to the processor 501, or implemented by the processor 501. The processor 501 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 501. The above processor 501 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502 and completes the steps of the above method in combination with its hardware.

[0335] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the above functions of the present application, or a combination thereof.

[0336] For software implementation, the technology described above in this article can be implemented by a unit that performs the functions described above in this article. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0337] The electronic device provided in this embodiment may be Figure 8 The electronic device shown in can execute all steps of the control method of each security device described above, thereby achieving the technical effects of the control method of each security device described above. Please refer to the above related description for details. For the sake of brevity, it will not be repeated here.

[0338] The embodiment of the present application also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.

[0339] When one or more programs in the storage medium can be executed by one or more processors, the control method of the security device executed on the electronic device side can be implemented.

[0340] The processor is used to execute the control program of the security device stored in the memory to implement the following steps of the control method of the security device executed on the electronic device side:

[0341] Get the target image set corresponding to the security equipment set;

[0342] Extracting a calibration object from the target image set;

[0343] Establishing an association relationship between the security devices based on the calibration object;

[0344] In the case where a target object is detected in the security area monitored by the security device set, one or more linked security devices are determined from the security device set based on the association relationship and the target information of the target object;

[0345] Control one or more of the linked security devices to perform monitoring operations on the target object.

[0346] The professionals should also be further aware that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0347] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0348] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0349] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A method for controlling a security device, characterized in that: The method comprises: Get the target image set corresponding to the security equipment set; Extracting a calibration object from the target image set; Establishing an association relationship between the security devices based on the calibration object; In the case where a target object is detected in the security area monitored by the security device set, one or more linked security devices are determined from the security device set based on the association relationship and the target information of the target object; Control one or more of the linked security devices to perform monitoring operations on the target object.

2. The method according to claim 1, characterized in that The security equipment includes a camera; and The step of obtaining a target image set corresponding to a security device set includes: Acquire images captured by the security devices in the security device set to obtain a target image set, wherein the security devices and the target images correspond one to one; and The establishing of the association relationship between the security devices based on the calibration object includes: Determining a capture time of the target image in the target image set; An association relationship between the security devices in the security device set is established based on the determined collection time and the calibration object.

3. The method according to claim 2, characterized in that The establishing of an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes: Based on the determined acquisition time and the calibration object, determining whether the target image set includes a first target image subset, wherein the acquisition time of each target image in the first target image subset is the same, and at least part of the calibration objects of each target image in the first target image subset indicates a same photographed object; In a case where the target image set includes the first target image subset, determining that the association relationship of the security devices in the first security device subset represents a first relationship, wherein the first relationship represents a shared field of view, and the security devices in the first security device subset acquire the target images in the first target image subset.

4. The method according to claim 3, characterized in that: The determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes: In a case where the association relationship represents the first relationship and the target object is located in a security area monitored by the first security device subset, determining, from the first security device subset, a security device corresponding to the security area to be entered by the target object for monitoring as a linkage security device; and The controlling one or more linkage security devices to perform monitoring operations on the target object includes: After waking up the linkage security device, the linkage security device is controlled to collect images of the target object to perform the monitoring operation.

5. The method according to claim 2, characterized in that: The establishing of an association relationship between the security devices in the security device set based on the determined collection time and the calibration object includes: Based on the determined acquisition time and the calibration object, determining whether the target image set includes a second target image subset, wherein the second target image subset includes a telephoto image and a wide-angle image of the same photographed object; In a case where the target image set includes the second target image subset, determining that the association relationship of the security devices in the second security device subset represents a second relationship, wherein the second relationship represents a telephoto camera and a wide-angle camera working in pair, the telephoto camera is used to capture telephoto images, and the wide-angle camera is used to capture wide-angle images.

6. The method according to claim 5, characterized in that The determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes: In a case where the association relationship indicates the second relationship, respectively determining the security devices in the second security device subset as linked security devices; and The controlling one or more linkage security devices to perform monitoring operations on the target object includes: Controlling the telephoto camera to capture a telephoto image of the target object; The wide-angle camera is controlled to capture a wide-angle image of the target object.

7. The method according to claim 1, characterized in that The target information includes at least the following information: the object type of the target object, the security device that detects the target object; as well as The controlling one or more linkage security devices to perform monitoring operations on the target object includes: Based on the target information, identifying an event triggered by the target object; The linked security device is controlled to perform the monitoring operation for monitoring the event.

8. The method according to claim 2, characterized in that: The determining one or more linked security devices from the security device set based on the association relationship and the target information of the target object includes: Determine whether the target object is located in a security area monitored by a target camera; the target camera is any one of the security device set; In a case where the target object is located in a security area monitored by the target camera, based on the association relationship, determining a linkage security device associated with the target camera from the security device set; and The controlling one or more linkage security devices to perform monitoring operations on the target object includes: In the case where the linkage security device includes an audio output device, the audio output device is controlled to output the prompt audio corresponding to the target object to perform the monitoring operation.

9. The method according to any one of claims 1 to 8, characterized in that: In the case where the monitoring operation is used for image acquisition, the method further includes: Acquire an image obtained by the linked security device performing the monitoring operation to obtain a monitoring image; Extract at least one of the following feature information of the target object from the surveillance image: face image, license plate number, movement trajectory, first appearance time, first appearance location, departure time, and departure location; Sending the characteristic information to a preset user terminal so that the user terminal displays event information determined based on the characteristic information; or determining event information based on the characteristic information, and sending the event information to a preset user terminal so that the user terminal displays the event information; wherein the event information represents an event triggered by the target object.

10. A security system, characterized in that: The system comprises: a security device set and a control device; wherein the control device is used to execute any of the methods described in claims 1-9 above.

11. A control device for security equipment, characterized in that: The device comprises: A first acquisition unit is used to acquire a target image set corresponding to a security device set; A first extraction unit, used to extract a calibration object from the target image set; An establishing unit, configured to establish an association relationship between the security devices based on the calibration object; a determining unit, configured to determine one or more linked security devices from the security device set based on the association relationship and target information of the target object when detecting that a target object exists in the security area monitored by the security device set; A control unit is used to control one or more of the linked security devices to perform monitoring operations on the target object.

Images