Video processing method, electronic device and system in security scenario

Abstract

Embodiments of the present application relate to a video processing method in a security scene, an electronic device and a system. The video processing method in the security scene is applied to a server. The server is in communication connection with a security device through a local storage device. Security videos collected by the security device are stored in the local storage device. The method comprises: the server determining whether a remote monitoring terminal in communication connection with the server has a video access right in response to a received alarm signal. The alarm signal is triggered by the local storage device. The video access right is the right of the remote monitoring terminal to access the security videos corresponding to the alarm device. In the case that the remote monitoring terminal has the video access right, the remote monitoring terminal is authorized to access the security videos corresponding to the alarm signal. Thus, the security of accessing the security videos can be improved.

Description

Technical Field

[0001] This application relates to the field of security technology, and in particular to a video processing method, electronic device and system for security scenarios. Background Technology

[0002] In related technologies, security scenarios typically involve a single remote monitoring terminal connecting to multiple security devices located in different locations. For example, remote monitoring terminal 1 might connect to multiple security devices installed in user 1's home, user 2's home, and user 3's home. These security devices can be, for example, cameras. Typically, these security devices have the function of capturing security video.

[0003] Currently, security video data collected by security equipment is stored remotely, such as in the cloud. Therefore, remote monitoring terminals need to access the security video through cloud APIs (Application Programming Interfaces).

[0004] However, accessing security videos in the above ways is less secure and less effective in protecting user privacy. Summary of the Invention

[0005] In view of this, in order to solve some or all of the above-mentioned technical problems, embodiments of this application provide a video processing method, electronic device and system in a security scenario.

[0006] In a first aspect, embodiments of this application provide a video processing method in a security scenario, applied to a server. The server and security equipment are communicatively connected via a local storage device, and the security video collected by the security equipment is stored in the local storage device. The method includes:

[0007] In response to the received alarm signal, the server determines whether the remote monitoring terminal communicating with the server has video access permissions; wherein, the alarm signal is triggered by the local storage device; the video access permissions are: the permission of the remote monitoring terminal to access the security video corresponding to the alarm device;

[0008] If the remote monitoring terminal has the video access permission, it is authorized to access the security video corresponding to the alarm signal.

[0009] In one possible implementation, determining whether the remote monitoring terminal communicating with the server has video access permissions includes:

[0010] Obtain the target type of security video that is accessible to the authorized remote monitoring terminal;

[0011] Determine whether the type of the security video is the target type to obtain a first determination result;

[0012] Based on the first determination result, it is determined whether the remote monitoring terminal has video access permissions.

[0013] In one possible implementation, determining whether the remote monitoring terminal communicating with the server has video access permissions includes:

[0014] Obtain the generation duration corresponding to the security video;

[0015] Determine whether the generation duration is greater than or equal to a preset duration to obtain a second determination result;

[0016] Based on the second determination result, it is determined whether the remote monitoring terminal communicating with the server has video access permissions.

[0017] In one possible implementation, there are multiple security devices, and the security videos collected by the multiple security devices are stored in the local storage device.

[0018] In one possible implementation, determining whether the remote monitoring terminal communicating with the server has video access permissions includes:

[0019] A third determination result is obtained by determining whether the security video requested by the remote monitoring terminal communicating with the server is the target security video, wherein the target security video is acquired through security equipment authorized to be accessed by the remote monitoring terminal;

[0020] Based on the third determination result, it is determined whether the remote monitoring terminal communicating with the server has video access permissions.

[0021] In one possible implementation, determining whether the remote monitoring terminal communicating with the server has video access permissions includes:

[0022] Determine whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated to obtain a fourth determination result;

[0023] Based on the fourth determination result, it is determined whether the remote monitoring terminal communicating with the server has video access permissions.

[0024] In one possible implementation, determining whether the remote monitoring terminal communicating with the server has video access permissions includes:

[0025] The following steps are performed by at least one of the security equipment and the remote monitoring terminal to determine whether the remote monitoring terminal has video access rights based on at least one of a first determination result, a second determination result, a third determination result, and a fourth determination result:

[0026] Obtain the target type of security video that the remote monitoring terminal is authorized to access; determine whether the type of the security video is the target type to obtain the first determination result;

[0027] Obtain the generation duration corresponding to the security video; determine whether the generation duration is greater than or equal to a preset duration to obtain the second determination result;

[0028] The third determination result is obtained by determining whether the security video requested by the remote monitoring terminal communicating with the server is the target security video, wherein the target security video is acquired through security equipment authorized to be accessed by the remote monitoring terminal.

[0029] Determine whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated to obtain the fourth determination result.

[0030] In one possible implementation, determining whether the remote monitoring terminal communicating with the server has video access permissions includes:

[0031] Determine whether the remote monitoring terminal communicating with the server has video access permissions at the current moment; and

[0032] If the remote monitoring terminal has the video access permission at the current time, the method further includes:

[0033] Monitor whether the remote monitoring terminal has the video access permission at subsequent times, wherein the subsequent times are times after the current time;

[0034] In response to the remote monitoring terminal not having access to the video, the page used to access the security video is closed.

[0035] Secondly, embodiments of this application provide an electronic device, including:

[0036] Memory, used to store computer programs;

[0037] A processor is configured to execute a computer program stored in the memory, and when the computer program is executed, to implement the method of any embodiment of the video processing method in the security scenario of the first aspect of this application.

[0038] Thirdly, embodiments of this application provide a system having a computer program stored thereon, which, when executed by a processor, implements the method of any embodiment of the video processing method in the security scenario described in the first aspect above.

[0039] Fourthly, embodiments of this application provide a computer program product, the computer program product including computer-readable code, which, when executed on a device, causes a processor in the device to implement the method of any embodiment of the video processing method in the security scenario described in the first aspect above.

[0040] The video processing method in a security scenario provided in this application is applied to a server. The server and security equipment are connected via a local storage device. The security video collected by the security equipment is stored in the local storage device. In the method, the server responds to a received alarm signal and determines whether a remote monitoring terminal connected to the server has video access permissions. The alarm signal is triggered by the local storage device. The video access permissions are: the remote monitoring terminal's permission to access the security video corresponding to the alarm device; and then, if the remote monitoring terminal has the video access permissions, it is authorized to access the security video corresponding to the alarm signal. Therefore, by storing the security video in a local storage device, a security video is formed. Then, if the remote monitoring terminal has video access permissions, it can access the security video, thus improving the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios. Attached Figure Description

[0041] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0042] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0043] One or more embodiments are illustrated by way of example with reference numerals in the accompanying drawings. These illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the drawings are not to be limited by scale.

[0044] Figure 1A flowchart illustrating a video processing method in a security scenario provided in an embodiment of this application;

[0045] Figure 2 A flowchart illustrating another video processing method in a security scenario provided in this application embodiment;

[0046] Figure 3 This application provides a schematic diagram of device interaction in a video processing method for a security scenario, as illustrated in an embodiment of the present application.

[0047] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0048] Various exemplary embodiments of this application will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of this application.

[0049] Those skilled in the art will understand that the terms "first" and "second" in the embodiments of this application are only used to distinguish different steps, devices or modules, and do not represent any specific technical meaning, nor do they indicate the logical order between them.

[0050] It should also be understood that in this embodiment, "multiple" can refer to two or more, and "at least one" can refer to one, two or more.

[0051] It should also be understood that any component, data or structure mentioned in the embodiments of this application can generally be understood as one or more unless explicitly defined or given contrary guidance in the context.

[0052] Furthermore, the term "and / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this application generally indicates that the preceding and following related objects have an "or" relationship.

[0053] It should also be understood that the description of the various embodiments in this application emphasizes the differences between the various embodiments, and the similarities or similarities can be referred to each other. For the sake of brevity, they will not be described in detail.

[0054] The following description of at least one exemplary embodiment is merely illustrative and is not intended to limit the scope of this application or its application or use.

[0055] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0056] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0057] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. To facilitate understanding of the embodiments of this application, the application will be described in detail below with reference to the accompanying drawings and embodiments. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0058] To address the technical problems of low security and low effectiveness of user privacy protection in existing technologies for accessing security videos, this application provides a video processing method, electronic device, and system for security scenarios, which can improve the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0059] Figure 1 This is a flowchart illustrating a video processing method in a security scenario provided by an embodiment of this application. This method can be applied to a server, where the server and security equipment are communicatively connected via a local storage device, and the security videos collected by the security equipment are stored in the local storage device.

[0060] The server can be a physical server or a cloud server.

[0061] Here, each user's home can be equipped with a local storage device. After the security equipment collects video footage from the user's home (such as security video), the collected video can be stored in the local storage device.

[0062] like Figure 1 As shown, the method specifically includes:

[0063] Step 101: In response to the received alarm signal, the server determines whether the remote monitoring terminal communicating with the server has video access permissions; wherein, the alarm signal is triggered by the local storage device; the video access permissions are: the permission of the remote monitoring terminal to access the security video corresponding to the alarm device.

[0064] In this embodiment, the alarm signal can be triggered directly by a user or other object through a local storage device, or indirectly by a user or other object through a smart terminal (such as a mobile phone, computer, etc.) controlling the local storage device.

[0065] A remote monitoring terminal can be a terminal that is set up remotely and has monitoring functions. In security scenarios, a single remote monitoring terminal typically connects to multiple security devices located in different locations. For example, remote monitoring terminal 1 connects to multiple security devices installed in user 1's home, user 2's home, and user 3's home. These security devices can be, for example, cameras, alarm devices, etc.

[0066] Security videos can be: videos stored on local storage devices in a security scenario. For example, security videos can be: security videos indicating abnormal events (such as fires) or security videos indicating abnormal behavior (such as intentional injury).

[0067] One or more security videos can correspond to one alarm signal. For example, monitoring a security video can trigger an alarm signal. Or, monitoring multiple security videos within a preset time period can trigger one alarm signal.

[0068] Alarm signals can be used to trigger remote monitoring terminals to access security videos.

[0069] In remote monitoring terminals, "remote" is used in contrast to "local" in local storage devices.

[0070] Typically, multiple security devices in multiple locations can be connected to a single remote monitoring terminal. This remote monitoring terminal can then be used to provide monitoring and other services to users of the security devices.

[0071] In some optional implementations of this embodiment, the following methods can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions:

[0072] The first step is to determine whether the alarm device is in a service subscription state.

[0073] The aforementioned service subscription status indicates whether the remote monitoring terminal provides monitoring and other services to users of the alarm equipment. For example, the alarm equipment may be in a service subscription state after the user clicks the preset subscription button or pays the subscription fee. If the user does not click the preset subscription button or pay the subscription fee, the alarm equipment may be in a non-service subscription state.

[0074] The second step, when the alarm device is in the service subscription state, is to determine whether the remote monitoring terminal communicating with the server has video access permissions.

[0075] It is understood that in the above-mentioned optional implementation methods, after the alarm signal is triggered, it can first be determined whether the alarm device is in a service subscription state. Then, if the alarm device is in a service subscription state, it can be further determined whether the remote monitoring terminal communicating with the server has video access permissions. If the alarm device is not in a service subscription state, it is not necessary to determine whether the remote monitoring terminal communicating with the server has video access permissions. This reduces the frequency of verifying whether the remote monitoring terminal has video access permissions, thereby reducing verification costs.

[0076] Here, various methods can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions. Please refer to the description below for details, which will not be elaborated upon here.

[0077] Step 102: If the remote monitoring terminal has the video access permission, authorize the remote monitoring terminal to access the security video corresponding to the alarm signal.

[0078] In this embodiment, after the remote monitoring terminal is authorized to access the security video, the remote monitoring terminal can access the security video corresponding to the alarm signal so as to display and / or analyze the security video on the remote monitoring terminal.

[0079] In this embodiment, the security videos can all be stored in local storage devices, rather than in remote monitoring terminals or servers. For example, the security videos obtained by cameras 1 and 2 can be stored in local storage device 1, and the security videos obtained by cameras 3 and 4 can be stored in local storage device 2.

[0080] In some optional implementations of this embodiment, the following method can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions:

[0081] The first step is to obtain the target type of security video that the remote monitoring terminal is authorized to access.

[0082] The target type can be the type of security video that is authorized to be accessed by the remote monitoring terminal. As an example, the target type can represent the identifier, type, function (e.g., live streaming, recording, PTZ control, two-way intercom), and location of the security device that collects the security video.

[0083] The second step is to determine whether the type of the security video is the target type, so as to obtain the first determination result.

[0084] The first determination result can indicate whether the type of the security video is the target type. For example, if the target type represents the identifier of the security device that collects the security video, and if the identifier is the same as the identifier of the security device that collects the security video, then the type of the security video can be determined to be the target type; if the identifier is different from the identifier of the security device that collects the security video, then the type of the security video can be determined not to be the target type.

[0085] The third step is to determine, based on the first determination result, whether the remote monitoring terminal has video access permissions.

[0086] As an example, if the first determination result indicates that the type of the security video is the target type, it can be determined that the remote monitoring terminal has the video access permission. If the first determination result indicates that the type of the security video is not the target type, it can be determined that the remote monitoring terminal does not have the video access permission.

[0087] In addition, it can be determined whether the remote monitoring terminal communicating with the server has video access permissions based on the first determination result and at least one of the second determination result, the third determination result, and the fourth determination result.

[0088] It is understood that, in the above-mentioned optional implementation methods, determining whether the type of the security video matches the target type can help determine whether the remote monitoring terminal communicating with the server has video access permissions. This can further improve the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0089] In some optional implementations of this embodiment, the following method can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions:

[0090] The first step is to obtain the generation duration corresponding to the security video.

[0091] The aforementioned generation duration can represent the time between the generation time of the security video and the current time, the time between the generation time of the alarm signal corresponding to the security video and the current time, or the time between the generation time of the access link to the security video and the current time.

[0092] The second step is to determine whether the generation duration is greater than or equal to the preset duration, so as to obtain a second determination result.

[0093] The preset duration can be a pre-defined duration. For example, the preset duration could be 1 hour.

[0094] The second determination result can indicate whether the generation duration is greater than or equal to the preset duration.

[0095] The third step is to determine, based on the second determination result, whether the remote monitoring terminal communicating with the server has video access permissions.

[0096] As an example, if the second determination result indicates that the generation duration is greater than or equal to a preset duration, it can be determined that the remote monitoring terminal does not have the video access permission. If the second determination result indicates that the generation duration is less than the preset duration, it can be determined that the remote monitoring terminal has the video access permission.

[0097] In addition, it can be determined whether the remote monitoring terminal communicating with the server has video access permissions based on the second determination result and at least one of the first determination result, the third determination result, and the fourth determination result.

[0098] It is understood that, in the above-mentioned optional implementation methods, the validity of the remote monitoring terminal communicating with the server can be determined by checking whether the generation time of the security video has expired. This further improves the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0099] In some optional implementations of this embodiment, the number of security devices is multiple, and the security videos collected by the multiple security devices are all stored in the local storage device.

[0100] It is understood that in the above-mentioned optional implementation methods, a single local storage device can be used to store multiple security videos collected by multiple security devices. Therefore, multiple security videos collected by multiple security devices can be managed uniformly, improving the convenience of security video maintenance.

[0101] In some application scenarios of the above optional implementation methods, the following methods can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions:

[0102] The first step is to determine whether the security video requested by the remote monitoring terminal communicating with the server is the target security video, in order to obtain a third determination result.

[0103] The target security video is obtained through security equipment that is authorized to be accessed by the remote monitoring terminal.

[0104] The third determination result can indicate whether the security video requested by the remote monitoring terminal communicating with the server is the target security video.

[0105] The second step is to determine, based on the third determination result, whether the remote monitoring terminal communicating with the server has video access permissions.

[0106] As an example, if the third determination result indicates that the security video requested by the remote monitoring terminal communicating with the server is not the target security video, it can be determined that the remote monitoring terminal does not have the video access permission. If the third determination result indicates that the security video requested by the remote monitoring terminal communicating with the server is the target security video, it can be determined that the remote monitoring terminal has the video access permission.

[0107] In addition, it can be determined whether the remote monitoring terminal communicating with the server has video access permissions based on the third determination result and at least one of the first determination result, the second determination result, and the fourth determination result.

[0108] It is understandable that in the above application scenario, whether the remote monitoring terminal communicating with the server has video access permissions can be determined by checking whether the security video requested for access by the remote monitoring terminal is the target security video. This further improves the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0109] In some optional implementations of this embodiment, the following method can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions:

[0110] The first step is to determine whether the identifiers of the alarm device and the remote monitoring terminal have been associated, in order to obtain the fourth determination result.

[0111] The fourth determination result can indicate whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated.

[0112] Here, the identifiers of the associated alarm devices and remote monitoring terminals can be associated and stored on the server, the alarm device, or the remote monitoring terminal.

[0113] The second step is to determine, based on the fourth determination result, whether the remote monitoring terminal communicating with the server has video access permissions.

[0114] As an example, if the fourth determination result indicates that the identifier of the alarm device and the identifier of the remote monitoring terminal are associated, it can be determined that the remote monitoring terminal has the video access permission. If the second determination result indicates that the identifier of the alarm device and the identifier of the remote monitoring terminal are not associated, it can be determined that the remote monitoring terminal does not have the video access permission.

[0115] In addition, it can be determined whether the remote monitoring terminal communicating with the server has video access permissions based on the fourth determination result and at least one of the first determination result, the second determination result, and the third determination result.

[0116] It is understood that, in the above-mentioned optional implementation methods, the remote monitoring terminal communicating with the server can be determined to have video access permissions by checking whether the identifiers of the alarm device and the remote monitoring terminal are associated. This can further improve the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0117] In some optional implementations of this embodiment, the following method can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions:

[0118] The following steps are performed by at least one of the security equipment and the remote monitoring terminal to determine whether the remote monitoring terminal has video access rights based on at least one of a first determination result, a second determination result, a third determination result, and a fourth determination result:

[0119] The first step is to obtain the target type of security video that the remote monitoring terminal is authorized to access; and to determine whether the type of the security video is the target type, so as to obtain the first determination result.

[0120] The first determination result can indicate whether the type of the security video is the target type. For example, if the target type represents the identifier of the security device that collects the security video, and if the identifier is the same as the identifier of the security device that collects the security video, then the type of the security video can be determined to be the target type; if the identifier is different from the identifier of the security device that collects the security video, then the type of the security video can be determined not to be the target type.

[0121] The second step is to obtain the generation duration corresponding to the security video; and to determine whether the generation duration is greater than or equal to the preset duration, so as to obtain the second determination result.

[0122] Wherein, it indicates whether the generation time is greater than or equal to the preset time.

[0123] The third step is to determine whether the security video requested by the remote monitoring terminal communicating with the server is the target security video, in order to obtain the third determination result. The target security video is acquired through security equipment authorized for access by the remote monitoring terminal.

[0124] The third determination result can be: whether the security video requested by the remote monitoring terminal communicating with the server is the target security video.

[0125] The fourth step is to determine whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated, in order to obtain the fourth determination result.

[0126] The fourth determination result can indicate whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated.

[0127] As an example, the security device can perform at least one of the first, second, third, and fourth steps described above, and the remote monitoring terminal can perform at least one of the first, second, third, and fourth steps described above, thereby obtaining the corresponding determination result, and determining whether the remote monitoring terminal has video access rights.

[0128] For example, security equipment can execute the first, second, third, and fourth steps described above to obtain the first, second, third, and fourth determination results corresponding to the security equipment; a remote monitoring terminal can execute the first, second, third, and fourth steps described above to obtain the first, second, third, and fourth determination results corresponding to the remote monitoring terminal. Therefore, based on the first, second, third, and fourth determination results corresponding to the security equipment and the remote monitoring terminal, it can be determined whether the remote monitoring terminal has video access permissions.

[0129] It is understood that, in the above-mentioned optional implementation methods, at least one of the security equipment and the remote monitoring terminal can be used to determine whether the remote monitoring terminal communicating with the server has video access permissions. This can further improve the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0130] In some optional implementations of this embodiment, the determination of whether the remote monitoring terminal communicating with the server has video access permissions can be carried out in the following way: determining whether the remote monitoring terminal communicating with the server has video access permissions at the current moment.

[0131] Based on this, if the remote monitoring terminal has the video access permission at the current time, the following steps can also be performed:

[0132] The first step is to monitor whether the remote monitoring terminal has the video access permission at subsequent times.

[0133] Wherein, the subsequent time is the time after the current time.

[0134] The second step is to close the page used to access the security video in response to the remote monitoring terminal not having the video access permission.

[0135] Here, during real-time monitoring, once the remote monitoring terminal no longer has access to the video (e.g., the generation duration is greater than or equal to the preset duration, or the user or other object closes the access permission), the page used to access the security video can be closed immediately. For example, the access link can be disconnected.

[0136] In some cases, the access link can be closed in response to the remote monitoring terminal not having the video access permission.

[0137] It is understood that, in the above-mentioned optional implementation methods, the remote monitoring terminal can continuously monitor whether it has the video access permission. Once the remote monitoring terminal no longer has the video access permission, the communication connection can be disconnected immediately. This further improves the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0138] It should be noted that, where there is no conflict, the technical features described in different alternative implementations can be included in the same embodiment. For the sake of brevity, they will not be elaborated here.

[0139] The video processing method in a security scenario provided in this application embodiment is applied to a server. The server and security equipment are communicatively connected via a local storage device. The security video collected by the security equipment is stored in the local storage device. The method includes: the server responding to a received alarm signal to determine whether a remote monitoring terminal communicatively connected to the server has video access permissions; wherein the alarm signal is triggered by the local storage device; the video access permissions are: the remote monitoring terminal's permission to access the security video corresponding to the alarm device; if the remote monitoring terminal has the video access permissions, it is authorized to access the security video corresponding to the alarm signal. Therefore, by storing the security video in a local storage device, a security video is formed, and then, if the remote monitoring terminal has video access permissions, it can access the security video. This improves the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0140] Figure 2 This is a flowchart illustrating another video processing method in a security scenario provided in an embodiment of this application.

[0141] The method is applied to the server, which communicates with the security device through a local storage device, and the security video collected by the security device is stored in the local storage device.

[0142] like Figure 2 As shown, the method specifically includes:

[0143] Step 201: In response to the received alarm signal, the server determines whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated to obtain a fourth determination result; wherein the alarm signal is triggered by the local storage device.

[0144] In this embodiment, step 201 and Figure 1 Step 101 in the corresponding embodiment is basically the same, and will not be repeated here.

[0145] In this embodiment, the fourth determination result can indicate whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated.

[0146] Here, the identifiers of the associated alarm devices and the identifiers of the remote monitoring terminals can be associated and stored in at least one of the server and the remote monitoring terminal.

[0147] Step 202: Based on the fourth determination result, determine whether the remote monitoring terminal communicating with the server has video access permissions; wherein, the video access permissions are: the permission of the remote monitoring terminal to access the security video corresponding to the alarm device.

[0148] In this embodiment, if the fourth determination result indicates that the identifier of the alarm device and the identifier of the remote monitoring terminal are associated, it can be determined that the remote monitoring terminal has the video access permission. If the second determination result indicates that the identifier of the alarm device and the identifier of the remote monitoring terminal are not associated, it can be determined that the remote monitoring terminal does not have the video access permission.

[0149] In addition, it can be determined whether the remote monitoring terminal communicating with the server has video access permissions based on the fourth determination result and at least one of the first determination result, the second determination result, and the third determination result.

[0150] Step 203: If the remote monitoring terminal has the video access permission, authorize the remote monitoring terminal to access the security video corresponding to the alarm signal.

[0151] Step 203 and Figure 1 Step 102 in the corresponding embodiment is basically the same, and will not be repeated here.

[0152] It should be noted that, in addition to the contents described above, this embodiment may also include... Figure 1 The corresponding technical features described in the corresponding embodiments, thereby achieving Figure 1 For details on the technical effects of the video processing method in the security scenario shown, please refer to [link / reference]. Figure 1 The relevant descriptions are presented concisely and will not be elaborated upon here.

[0153] The video processing method in a security scenario provided in this application can determine whether a remote monitoring terminal communicating with the server has video access permissions by determining whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated. This further improves the security of remote access to security videos and the effectiveness of user privacy protection in security scenarios.

[0154] The following describes the embodiments of this application by way of example. However, it should be noted that the following content is only used to understand the technical solutions of the embodiments of this application and does not constitute a limitation on the protection scope of the embodiments of this application.

[0155] Before introducing this plan, the following explanations are provided for the technical terms used in it:

[0156] 1. Alarm Portal: A webpage provided by security service providers to the monitoring and alarm center for customer service to view alarm information, which is set up on the remote monitoring terminal.

[0157] 2. URL (Uniform Resource Locator): Web link, here referring to the access address of AlarmPortal.

[0158] 3. Hub: A central control device (such as the aforementioned local storage device or the aforementioned alarm device) that connects to security equipment and stores alarm data, serving as the data source for the Alarm Portal in this scheme.

[0159] 4. WebRTC: A real-time communication technology that establishes peer-to-peer connections without the aid of an intermediary, enabling the transmission of video and / or audio streams as well as other arbitrary data. In this scheme, it serves as an access channel for Hub and Alarm Portal.

[0160] 5. API (Application Programming Interface): A set of predefined methods and protocols used to interact with a software component or system.

[0161] 6. IP (Internet Protocol): A unique identifier assigned to each device connected to the Internet, used for communication between devices on the network.

[0162] 7. SN: Abbreviation for Serial Number, referring to the product serial number.

[0163] 8. ID: (Identifier) ​​is an identifier used to uniquely identify an entity (such as a person, device, account, record, etc.).

[0164] Currently, security service providers store camera data in the cloud (i.e., the aforementioned server). Therefore, Alarm Portal directly accesses the camera's live stream and recordings via cloud APIs. This method is simple and straightforward, but it presents many security risks:

[0165] 1. If data is not encrypted during transmission, it may be intercepted and stolen by hackers;

[0166] 2. Data is stored in the cloud. If the cloud service provider's security measures are not adequate, it may lead to data leakage.

[0167] 3. Cloud APIs themselves may contain vulnerabilities that hackers can exploit to launch attacks;

[0168] Cloud API access control is not strict, and unauthorized users may also access camera data.

[0169] The application scenarios for this solution are as follows: In professional home security monitoring services, when a user's home device triggers an alarm signal, the alarm signal can be pushed to the monitoring center (i.e., the aforementioned remote monitoring terminal), where customer service can verify the alarm. To better verify the alarm, an Alarm Portal webpage is required, on which customer service can view the real-time stream and recordings of the user's home camera.

[0170] The main method of this solution is as follows: all cameras are connected through a Hub (central control device), and the data is stored on the Hub's local hard drive (i.e., the aforementioned local storage device or alarm device). The Hub then connects to AlarmPortal via WebRTC, allowing it to access the internal data.

[0171] The main problem this solution addresses is that the monitoring center's customer service, as a third party, needs to access users' local data while ensuring users' privacy and security.

[0172] The implementation method of this solution is as follows:

[0173] a. Alarm Portal Video Access Control:

[0174] i. Cameras that are authorized by the user to be accessed by the monitoring center customer service. Unauthorized cameras will not appear in the Alarm Portal.

[0175] ii. The user authorizes the available functions within the camera (including live streaming, recording, PTZ control, and two-way intercom). Unauthorized functions are unavailable in the Alarm Portal. The system obtains the target type of security video that the remote monitoring terminal is authorized to access; determines whether the type of the security video matches the target type to obtain a first determination result; based on the first determination result, it determines whether the remote monitoring terminal has video access permissions.

[0176] b. Alarm Portal access time control:

[0177] i. Before clicking the access link: When requesting source verification (to determine whether it is an authorized remote monitoring terminal), the alarm generation time is verified simultaneously. Alarms generated more than 1 hour ago (configurable) cannot pass the verification.

[0178] ii. During browsing: Once Alarm Portal is opened, it will start a timer and automatically time out and close after 1 hour (configurable).

[0179] iii. After clicking the link: The Hub monitors the WebRTC connection validity period. Regardless of whether the Alarm Portal actively closes the connection, the WebRTC connection will be automatically disconnected after 1 hour (based on Hub firmware configuration).

[0180] c. Data privacy and security protection:

[0181] i. IP Whitelist Verification: Require partner monitoring centers to provide the IP address ranges of customer service computers and add them to a whitelist. Access from IPs not on the whitelist will be denied.

[0182] ii. Request source verification (cloud):

[0183] 1. Subscription status verification: Verify whether the user has subscribed to the service through the Hub's SN. If not, connection to the Hub is not allowed.

[0184] 2. Alarm ID Verification: Verify whether the alarm was generated by the associated Hub using the alarm ID. If the verification fails, connection to the Hub is not allowed.

[0185] iii. Request Source Verification (Device Hub): Verify whether the alarm was generated by the current Hub using the alarm ID. If the verification fails, return an error code and do not perform any action.

[0186] iv. Video Watermarking: When agents view customer live streams / recordings (i.e., security videos), they can watermark the video data, identify the monitoring center's name, and cover the entire screen to support potential subsequent data tracing.

[0187] Customer Service Operation Log: Records the operation logs of customer service representatives in the monitoring center on the Alarm Portal. This log is used for security auditing and is available for users to view and download.

[0188] Specifically, see Figure 3 This solution includes the following steps:

[0189] 1. Subscription information synchronization: Users subscribe to services in the eufy App, and the subscription information is synchronized to the Central Station (i.e., the remote monitoring terminal mentioned above) through the eufy cloud.

[0190] a. The Central Station stores subscription information for receiving subsequent alarms.

[0191] b.eufy Cloud will record the user's subscription status and associate it with the App account, and Hub will also synchronize the subscription status from the cloud.

[0192] 2. Alarm Signal + URL Push: When an alarm is triggered in a user's home, the Hub will generate an alarm signal, which, after being processed by eufy cloud to generate a URL, will be pushed to Central Station. Here, at the beginning of step 2, the subscription from step 1 can be verified first to control costs.

[0193] a.Hub will verify:

[0194] i. Whether the user has subscribed; if not, push notifications will be rejected.

[0195] b.eufy cloud will verify:

[0196] i. Is the Hub an eufy device (to determine if the local storage device is an authorized device)? If not, push notifications will be rejected.

[0197] ii. Whether the user has subscribed; if not, push notifications will be rejected.

[0198] iii. Whether the alarm signal was generated by this Hub; if not, the push will be rejected.

[0199] 3. Customer Service Access URL: After receiving an alarm, Central Station's customer service representatives open the URL to access AlarmPortal. Here, at the beginning of step 3, the agent's identity from step 2 and the subscription from step 1 can be verified first to control costs and ensure security.

[0200] a.eufy cloud will verify:

[0201] i. Check if the customer service computer's IP address is on the whitelist; otherwise, deny access.

[0202] ii. Check if the URL is still valid; otherwise, deny access.

[0203] iii. Is the Hub an eufy device? If not, access will be denied.

[0204] iv. Whether the user has subscribed; if not, access will be denied.

[0205] v. Determine if the alarm signal was generated by this Hub; if not, access will be denied.

[0206] 4. Access User Live Stream and Recordings: The Alarm Portal establishes a WebRTC link with the Hub to obtain the user's live stream and recordings from the camera. At the beginning of step 4, user authorization and the source of the alarm signal can be verified first to ensure limited access to sensitive resources (i.e., security video) within the scope of customer authorization, thus guaranteeing security.

[0207] a.Hub will verify:

[0208] i. Check if the URL is still valid; otherwise, deny access.

[0209] ii. Whether the alarm signal was generated by this Hub; if not, access will be denied.

[0210] iii. Direct communication after authorization;

[0211] iii. User authorization scope: Only cameras and functions authorized by the user will be displayed in the Alarm Portal;

[0212] b. Alarm Portal will verify:

[0213] The link is kept active for a specified time and will automatically close after the timeout. It should be noted that, in addition to the contents described above, this embodiment may also include the technical features described in the above embodiments, thereby achieving the technical effects of the video processing method in the security scenario shown above. Please refer to the above description for details; for brevity, further elaboration is not provided here.

[0214] In this solution, security video data is stored locally on the Hub's hard drive, eliminating the risk of data leakage from the cloud. It employs a WebRTC protocol for end-to-end encrypted communication. Through strategies such as IP whitelisting, request source verification, video watermarking, and customer service operation logs, user data privacy and security are maximized.

[0215] Figure 4This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 4 The illustrated electronic device 500 includes at least one processor 501, a memory 502, at least one network interface 504, and other user interfaces 503. The various components in the electronic device 500 are coupled together via a bus system 505. It is understood that the bus system 505 is used to implement communication between these components. In addition to a data bus, the bus system 505 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 4 The general designated all buses as Bus System 505.

[0216] The aforementioned electronic devices may include, for example, at least one of the following: alarm devices, remote monitoring terminals, and servers.

[0217] The user interface 503 may include a display, keyboard, or clicking device (e.g., mouse, trackball, touchpad, or touchscreen).

[0218] It is understood that the memory 502 in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memory 502 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0219] In some implementations, memory 502 stores elements, executable units or data structures, or subsets thereof, or extended sets thereof: operating system 5021 and application program 5022.

[0220] The operating system 5021 includes various system programs, such as the framework layer, core library layer, and driver layer, used to implement various basic business functions and handle hardware-based tasks. The application program 5022 includes various applications, such as a media player and a browser, used to implement various application functions. Programs implementing the methods of this application embodiment can be included in application program 5022.

[0221] In this embodiment, by calling the program or instructions stored in memory 502, specifically the program or instructions stored in application program 5022, processor 501 executes the method steps provided in each method embodiment, including, for example:

[0222] In response to the received alarm signal, the server determines whether the remote monitoring terminal communicating with the server has video access permissions; wherein, the alarm signal is triggered by the local storage device; the video access permissions are: the permission of the remote monitoring terminal to access the security video corresponding to the alarm device;

[0223] If the remote monitoring terminal has the video access permission, it is authorized to access the security video corresponding to the alarm signal.

[0224] The methods disclosed in the embodiments of this application can be applied to or implemented by processor 501. Processor 501 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in processor 501 or by instructions in the form of software. The processor 501 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software units in the decoding processor. The software units may be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature systems in the art. The system is located in memory 502. The processor 501 reads the information in memory 502 and, in conjunction with its hardware, completes the steps of the above method.

[0225] It is understood that the embodiments described herein can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described above in this application, or combinations thereof.

[0226] For software implementation, the techniques described herein can be implemented by units that perform the functions described above. The software code can be stored in memory and executed by a processor. The memory can be implemented within the processor or external to the processor.

[0227] The electronic device provided in this embodiment may be as follows: Figure 4 The electronic device shown can execute all the steps of the video processing methods in the various security scenarios described above, thereby achieving the technical effects of the video processing methods in the various security scenarios described above. For details, please refer to the relevant descriptions above. For the sake of brevity, further details are not provided here.

[0228] This application also provides a system. The system stores one or more programs. The system may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid-state drive; the memory may also include combinations of the above types of memory.

[0229] When one or more programs in a system can be executed by one or more processors to implement the video processing method in the security scenario executed on the electronic device side.

[0230] The aforementioned processor is used to execute video processing programs for security scenarios stored in memory, to implement the following steps of a video processing method for security scenarios executed on the electronic device side:

[0231] In response to the received alarm signal, the server determines whether the remote monitoring terminal communicating with the server has video access permissions; wherein, the alarm signal is triggered by the local storage device; the video access permissions are: the permission of the remote monitoring terminal to access the security video corresponding to the alarm device;

[0232] If the remote monitoring terminal has the video access permission, it is authorized to access the security video corresponding to the alarm signal.

[0233] Furthermore, the computer program product provided in this application embodiment may include computer-readable code, which, when executed on a device, causes a processor in the device to implement the following steps of a video processing method in a security scenario executed on the electronic device side:

[0234] In response to the received alarm signal, the server determines whether the remote monitoring terminal communicating with the server has video access permissions; wherein, the alarm signal is triggered by the local storage device; the video access permissions are: the permission of the remote monitoring terminal to access the security video corresponding to the alarm device;

[0235] If the remote monitoring terminal has the video access permission, it is authorized to access the security video corresponding to the alarm signal.

[0236] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0237] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented in hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other system of any form known in the art.

[0238] It should be understood that the terminology used herein is for the purpose of describing particular exemplary embodiments only and is not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms “a,” “an,” and “described” as used herein may also include the plural forms. The terms “comprising,” “including,” “containing,” and “having” are inclusive and therefore indicate the presence of the stated features, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, elements, components, and / or combinations thereof. The method steps, processes, and operations described herein are not construed as requiring them to be performed in a particular order described or illustrated unless the order of performance is explicitly indicated. It should also be understood that additional or alternative steps may be used.

[0239] The above description is merely a specific embodiment of this application, enabling those skilled in the art to understand or implement this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A video processing method in a security scenario, characterized in that, Applied to the server side, the server communicates with the security device via a local storage device, and the security video collected by the security device is stored in the local storage device. The method includes: In response to the received alarm signal, the server determines whether the remote monitoring terminal communicating with the server has video access permissions; wherein, the alarm signal is triggered by the local storage device; the video access permissions are: the permission of the remote monitoring terminal to access the security video corresponding to the alarm device; If the remote monitoring terminal has the video access permission, it is authorized to access the security video corresponding to the alarm signal.

2. The method according to claim 1, characterized in that, Determining whether the remote monitoring terminal communicating with the server has video access permissions includes: Obtain the target type of security video that is accessible to the authorized remote monitoring terminal; Determine whether the type of the security video is the target type to obtain a first determination result; Based on the first determination result, it is determined whether the remote monitoring terminal has video access permissions.

3. The method according to claim 1, characterized in that, Determining whether the remote monitoring terminal communicating with the server has video access permissions includes: Obtain the generation duration corresponding to the security video; Determine whether the generation duration is greater than or equal to a preset duration to obtain a second determination result; Based on the second determination result, it is determined whether the remote monitoring terminal communicating with the server has video access permissions.

4. The method according to claim 1, characterized in that, The number of security devices is multiple, and the security videos collected by the multiple security devices are stored in the local storage device.

5. The method according to claim 4, characterized in that, Determining whether the remote monitoring terminal communicating with the server has video access permissions includes: A third determination result is obtained by determining whether the security video requested by the remote monitoring terminal communicating with the server is the target security video, wherein the target security video is acquired through security equipment authorized to be accessed by the remote monitoring terminal; Based on the third determination result, it is determined whether the remote monitoring terminal communicating with the server has video access permissions.

6. The method according to claim 1, characterized in that, Determining whether the remote monitoring terminal communicating with the server has video access permissions includes: Determine whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated to obtain a fourth determination result; Based on the fourth determination result, it is determined whether the remote monitoring terminal communicating with the server has video access permissions.

7. The method according to claim 1, characterized in that, Determining whether the remote monitoring terminal communicating with the server has video access permissions includes: The following steps are performed by at least one of the security equipment and the remote monitoring terminal to determine whether the remote monitoring terminal has video access rights based on at least one of a first determination result, a second determination result, a third determination result, and a fourth determination result: Obtain the target type of security video that the remote monitoring terminal is authorized to access; determine whether the type of the security video is the target type to obtain the first determination result; Obtain the generation duration corresponding to the security video; determine whether the generation duration is greater than or equal to a preset duration to obtain the second determination result; The third determination result is obtained by determining whether the security video requested by the remote monitoring terminal communicating with the server is the target security video, wherein the target security video is acquired through security equipment authorized to be accessed by the remote monitoring terminal; Determine whether the identifier of the alarm device and the identifier of the remote monitoring terminal have been associated to obtain the fourth determination result.

8. The method according to any one of claims 1-7, characterized in that, Determining whether the remote monitoring terminal communicating with the server has video access permissions includes: Determine whether the remote monitoring terminal communicating with the server has video access permissions at the current moment; and If the remote monitoring terminal has the video access permission at the current time, the method further includes: Monitor whether the remote monitoring terminal has the video access permission at subsequent times, wherein the subsequent times are times after the current time; In response to the remote monitoring terminal not having access to the video, the page used to access the security video is closed.

9. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor is configured to execute a computer program stored in the memory, wherein when the computer program is executed, it implements the video processing method in the security scenario according to any one of claims 1-7.

10. A system having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the video processing method in the security scenario according to any one of claims 1-7.

Images