Video monitoring system, monitoring method thereof, storage medium and program product

Abstract

The invention relates to a video monitoring system and a monitoring method thereof, a storage medium and a program product, and the monitoring method comprises the steps that a monitoring control platform sends a first monitoring instruction to a target streaming media server and sends a second monitoring instruction to a target camera according to a received monitoring task; the target streaming media server generates a third monitoring instruction according to the first monitoring instruction, and sends the third monitoring instruction to the target camera; and the target camera generates video stream data according to the third monitoring instruction, adds security level information representing the security level of the task into the video stream data according to the first monitoring instruction, and encrypts the video stream data to obtain an encrypted monitoring video. According to the method and the device, the problem of secret leakage possibly caused by lack of security and secrecy measures of a video monitoring system in a secret-related monitoring scene can be solved, the use configuration of the system is flexible and diverse while the security and controllability of the video data can be ensured, and the method and the device can adapt to monitoring tasks with different secrecy degrees.

Description

Technical Field

[0001] The present disclosure relates to the fields of computer technology and artificial intelligence, and in particular to a video monitoring system and a monitoring method thereof, a storage medium, and a program product. Background Art

[0002] With the development and popularization of video technology, video surveillance has been widely used in various fields and scenarios. In some monitoring scenarios involving confidentiality, higher requirements are placed on the security of video surveillance.

[0003] For example, during the production process of some equipment that has not yet been made public or released, it may be necessary to experiment or test the equipment to verify and improve its performance. Depending on the requirements of the test scenario, the test process can be completed through video surveillance, and the confidentiality of the video needs to be ensured during the monitoring process.

[0004] However, in the related art, since the video surveillance system itself lacks security and confidentiality protection measures, there is a risk of leakage of the monitored content. Summary of the invention

[0005] The present disclosure provides a video surveillance system and a surveillance method thereof, a storage medium and a program product, so as to at least solve the problem that the video surveillance system lacks security and confidentiality measures in the related art and may lead to leakage. The technical solution of the present disclosure is as follows:

[0006] According to a first aspect of the present disclosure, a monitoring method of a video monitoring system is provided, wherein the video monitoring system includes a monitoring control platform, multiple cameras and multiple streaming media servers, wherein the monitoring method includes: the monitoring control platform sends a first monitoring instruction to a target streaming media server among the multiple streaming media servers according to a received monitoring task, and sends a second monitoring instruction to a target camera among the multiple cameras, wherein the first monitoring instruction includes the monitoring task and the task confidentiality level of the monitoring task, and the second monitoring instruction includes the task confidentiality level of the monitoring task; the target streaming media server generates a third monitoring instruction according to the first monitoring instruction, and sends the third monitoring instruction to the target camera to control the target camera to perform the monitoring task, wherein the third monitoring instruction includes information for controlling the camera action of the target camera; the target camera generates video stream data according to the third monitoring instruction, and according to the first monitoring instruction, adds confidentiality information representing the task confidentiality level to the video stream data, and encrypts the video stream data to obtain an encrypted monitoring video.

[0007] Optionally, each of the multiple cameras has a camera security level, and the camera security level indicates the highest task security level that the camera can add to the video stream data, wherein the monitoring control platform determines the target camera in the following manner: according to the monitoring task, determining an associated camera among the multiple cameras whose camera security level is higher than the task security level of the monitoring task; in response to the associated camera not existing in other monitoring tasks, using the associated camera as the target camera.

[0008] Optionally, each camera corresponds to one of the multiple streaming media servers, and each streaming media server receives surveillance video from a corresponding camera, wherein the monitoring control platform further performs the following operations: in response to the monitoring task including recording plan information, obtaining the storage space occupancy rate of the target streaming media server; in response to the storage space occupancy rate of the target streaming media server being less than or equal to a preset occupancy threshold, executing the step of sending the second monitoring instruction to the target camera among the multiple cameras, and sending the recording plan information and the task level to the target streaming media server; in response to the storage space occupancy rate of the target streaming media server being greater than the preset occupancy threshold, terminating the monitoring task.

[0009] Optionally, the monitoring method also includes: the target streaming media server receives the monitoring video from the target camera according to the recording plan information; the target streaming media server stores the monitoring video in a storage location corresponding to the task confidentiality level according to the task confidentiality level, wherein different task confidentiality levels correspond to different storage locations.

[0010] Optionally, the second monitoring instruction also includes confidentiality level display information, the confidentiality level display information indicating whether the target camera superimposes and displays the confidentiality level information in the video screen of the monitoring video, the monitoring video carries the confidentiality level display information, the video monitoring system also includes a monitoring client, the monitoring client receives the monitoring video, wherein the monitoring method further includes: in response to the confidentiality level display information indicating that the target camera does not display the confidentiality level information in the video screen of the monitoring video, the monitoring client superimposes and displays the confidentiality level information on the video screen when playing or downloading the monitoring video.

[0011] Optionally, the monitoring client also performs the following operations: replays historical monitoring videos, and during the playback process, decrypts the historical monitoring videos, and caches the videos in a preset time window before the current video screen, including the current video screen; during the playback process, in response to receiving a start download instruction input by the user, decodes the video in the preset time window and the video after the current video screen, and encodes the decoded video according to a preset encoding format until receiving an end download instruction input by the user, and stores the encoded video.

[0012] Optionally, the video surveillance system has multiple roles, each role corresponds to one or more users, and the monitoring method also includes: the monitoring control platform determines the task access rights of each role according to the task control function, wherein the monitoring control platform only allows the role to use the task control function authorized to the role; the monitoring control platform determines the video access rights of each role according to the video control function, wherein the monitoring control platform only allows the role to use the video control function authorized to the role; the monitoring control platform determines the video access rights of each role according to the camera, wherein the monitoring control platform only allows the role to access the video data of the camera authorized to the role, wherein the task control function and the task access rights respectively include at least one of creating a new monitoring task, editing a monitoring task and viewing a monitoring task, and the video control function and the video access rights respectively include at least one of real-time viewing, video playback, video download and cloud mirror control.

[0013] According to a second aspect of the present disclosure, a video surveillance system is provided, the video surveillance system comprising a monitoring control platform, a plurality of cameras and a plurality of streaming media servers, the monitoring control platform sending a first monitoring instruction to a target streaming media server among the plurality of streaming media servers according to a monitoring task, and sending a second monitoring instruction to a target camera among the plurality of cameras, wherein the first monitoring instruction includes the monitoring task and the task confidentiality level of the monitoring task, and the second monitoring instruction includes the task confidentiality level of the monitoring task; the target streaming media server generates a third monitoring instruction according to the first monitoring instruction, and sends the third monitoring instruction to the target camera to control the target camera to perform the monitoring task, wherein the third monitoring instruction includes information for controlling the camera action of the target camera; the target camera generates video stream data according to the third monitoring instruction, and adds confidentiality information representing the task confidentiality level to the video stream data according to the first monitoring instruction to obtain a monitoring video.

[0014] According to a third aspect of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the monitoring method of the video surveillance system according to the present disclosure.

[0015] According to a fourth aspect of the present disclosure, a computer program product is provided, comprising computer executable instructions, which, when executed by at least one processor, implement the monitoring method of the video surveillance system according to the present disclosure.

[0016] The technical solution provided by the present disclosure brings at least the following beneficial effects:

[0017] By adopting the video monitoring solution according to the present invention, the monitoring control platform can send different monitoring instructions to the target streaming media server and the target camera respectively according to the monitoring task, wherein the monitoring instruction including the task confidentiality level of the monitoring task can be sent to the target streaming media server, and the monitoring instruction including the task confidentiality level can be sent to the target camera, so that the target streaming media server can control the action of the target camera according to the third control instruction to obtain video stream data, and the target camera can add confidentiality information representing the task confidentiality level to the video stream data, and encrypt the video stream data to obtain an encrypted monitoring video. In this way, by issuing monitoring instructions containing task confidentiality levels to the streaming media server and the camera respectively, the monitoring video output by the camera is encrypted, thereby improving the confidentiality of video transmission, and the confidentiality level information carried in the monitoring video is associated with the confidentiality requirements of the monitoring task, and corresponds to the confidentiality level obtained by the target streaming media server. While ensuring the security and controllability of video data, the camera makes the encryption of the video stream more flexible, and the system's usage configuration is also flexible and diverse. This ensures that the video itself has a confidentiality level corresponding to the monitored content, and the processing of the video can refer to the confidentiality level. While improving the encryption reliability, it also makes the encryption method more flexible, which can adapt to monitoring tasks with different confidentiality levels and improve the security of video monitoring systems in confidential monitoring scenarios.

[0018] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0020] Figure 1 is a schematic block diagram of an example of a video surveillance system according to an exemplary embodiment of the present disclosure.

[0021] Figure 2 is a schematic flowchart of a monitoring method of a video monitoring system according to an exemplary embodiment of the present disclosure.

[0022] Figure 3 is a schematic flowchart of an example of controlling a task state of a monitoring task in a monitoring method of a video monitoring system according to an exemplary embodiment of the present disclosure.

[0023] Figure 4 is a schematic flowchart of a state change of a monitoring task in a monitoring method of a video monitoring system according to an exemplary embodiment of the present disclosure.

[0024] Figure 5 is a schematic block diagram of a video surveillance system according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the present application will clearly and completely describe the technical solutions in the embodiments of the present disclosure in conjunction with the accompanying drawings.

[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0027] It should be noted that the phrase "at least one of the items" in the present disclosure includes three types of parallel situations: "any one of the items", "a combination of any number of the items", and "all of the items". For example, "including at least one of A and B" includes the following three parallel situations: (1) including A; (2) including B; (3) including A and B. Another example is "executing at least one of step 1 and step 2" which means the following three parallel situations: (1) executing step 1; (2) executing step 2; (3) executing step 1 and step 2.

[0028] As mentioned above, in the related art, there is a problem that the video surveillance system lacks security and confidentiality measures, which may lead to leakage.

[0029] Taking monitoring scenarios involving military industry, medical treatment, scientific research, etc. as an example, many test scenarios are confidential and lack relevant video surveillance technologies due to security and confidentiality requirements. A few test sites have built independent monitoring systems, but because the video surveillance system itself lacks security and confidentiality protection measures, there is a risk of leaks.

[0030] Traditional video surveillance systems are unable to fully and completely perform security access control for confidential surveillance tasks. Specifically, traditional video surveillance systems are unable to mark confidential videos, change the video classification based on the confidentiality of the surveillance task, or store recorded videos at different classification levels. In addition, traditional video surveillance systems are unable to perform comprehensive security access control based on classification levels, functions, and equipment. In addition, there is a lack of complete access control for the generated confidential real-time and historical video data.

[0031] In view of the above problems, exemplary embodiments of the present disclosure provide a monitoring method of a video monitoring system, a video monitoring system, a computer-readable storage medium, and a computer program product, which can solve or at least alleviate the above problems.

[0032] In a first aspect of an exemplary embodiment of the present disclosure, a monitoring method of a video monitoring system is provided.

[0033] First refer to Figure 1 An example structure of a video surveillance system according to an exemplary embodiment of the present disclosure is described.

[0034] like Figure 1 As shown, the video surveillance system 100 may include a surveillance control platform 110 , a plurality of cameras 120 , and a plurality of streaming media servers 130 .

[0035] The monitoring control platform 110 can send a first monitoring instruction to a target streaming server among the multiple streaming servers 130 based on the received monitoring task, and send a second monitoring instruction to a target camera among the multiple cameras 120, wherein the first monitoring instruction may include the monitoring task and the task level of the monitoring task, and the second monitoring instruction may include the task level of the monitoring task but does not include information about the monitoring task.

[0036] The target streaming media server can generate a third monitoring instruction based on the first monitoring instruction, and send the third monitoring instruction to the target camera to control the target camera to perform the monitoring task, wherein the third monitoring instruction includes information for controlling the camera action of the target camera.

[0037] The target camera among the multiple cameras 120 can generate video stream data according to the third monitoring instruction, and according to the first monitoring instruction, add the confidentiality information representing the task confidentiality to the video stream data, and encrypt the video stream data to obtain an encrypted monitoring video. Here, the target camera can be one or more.

[0038] Specifically, the monitoring control platform 110 can communicate with each camera 120 to send monitoring instructions to the camera 120. The monitoring control platform 110 can receive monitoring tasks, which can be input to the monitoring control platform 110 by a user or sent to the monitoring control platform 110 from other systems.

[0039] The camera 120 can, for example, encrypt and sign the video code stream in accordance with the C-level protection requirements agreed upon in the GB 35114 protocol, and regularly replace the video key and the video key encryption key. In an embodiment of the present disclosure, the camera can respond to the second monitoring instruction and the third monitoring instruction, and store the current task level locally in the camera, which will not be lost when the power is off. The camera 120 can include various forms (such as gun cameras, ball cameras, hemisphere cameras, etc.) and various lens parameter models to meet the needs of different usage scenarios. The embodiments of the present disclosure do not place special restrictions on the specific type of camera, the way of capturing images, and the content of the shooting. As an example, multiple cameras 120 can be used to capture different video content, for example, they can be arranged in different positions.

[0040] In addition, each camera 120 may correspond to a streaming media server 130, and each streaming media server 130 may correspond to at least one of the multiple cameras 120, for example, one streaming media server 130 may correspond to multiple cameras 120. The streaming media server 130 may be connected in communication with the corresponding camera 120 to receive the surveillance video from the corresponding camera 120. The streaming media server 130 may store the received surveillance video, and may also send the received or stored surveillance video.

[0041] As an example, the streaming media server 130 may also be connected in communication with the monitoring control platform 110 to receive control instructions from the monitoring control platform 110 .

[0042] In addition, the video surveillance system 100 may further include a surveillance client 140 , which receives the surveillance video generated by the camera 120 , for example, may receive the surveillance video of the camera 120 corresponding to the streaming media server 130 from the streaming media server 130 .

[0043] The monitoring client 140 may also be connected to the monitoring control platform 110 for communication, for example, it may send identity authentication information to the monitoring control platform 110 or receive authorization information from the monitoring control platform 110 or obtain monitoring tasks and associated camera information from the monitoring control platform.

[0044] The specific configuration and specific operation of the above-mentioned video monitoring system 100 will be described in detail in the embodiment of the monitoring method described below.

[0045] In addition, the monitoring control platform and streaming media server described above can be a terminal desktop, a rack server, etc. Here, the electronic device can be an independent electronic device, or an electronic device cluster, or a cloud computing platform or a virtualization center. However, the video monitoring system described above is only an example, and the monitoring method of the video monitoring system according to the exemplary embodiment of the present disclosure can also be applied to other systems.

[0046] The following will refer to Figure 2 Describe the example steps of the monitoring method of the video monitoring system according to the embodiment of the present disclosure. The video monitoring system may include a monitoring control platform, multiple cameras and multiple streaming media servers, such as Figure 2 As shown, the monitoring method of the video monitoring system may include the following steps:

[0047] In step S210, the monitoring control platform may send a first monitoring instruction to a target streaming server among multiple streaming servers based on the received monitoring task, and send a second monitoring instruction to the target camera, wherein the first monitoring instruction may include the monitoring task and the task level of the monitoring task, and the second monitoring instruction may include the task level of the monitoring task.

[0048] Specifically, the monitoring task can be monitoring in any field or scenario, and the monitoring control platform can create a new monitoring task in response to the task creation instruction input by the user. The task creation instruction may include, for example, but is not limited to, task number, task name, task confidentiality level, task knowledge person, task-related camera, recording plan, and other information.

[0049] As an example, a monitoring task can only add cameras to which the task aware person has access rights as associated cameras. After the task is created, the task confidentiality level cannot be modified. Specifically, when creating or modifying a monitoring task, the monitoring control platform can only add personnel whose confidentiality level is not lower than the task confidentiality level as the task aware person. The confidentiality level of the video stream (or "code stream") generated by the camera can be switched as the monitoring task changes. Specifically, the confidentiality level of the video stream generated by the camera is not fixed, but is determined based on the task confidentiality level of the currently executed monitoring task each time a monitoring task is received. The same camera generates different video streams when executing monitoring tasks with different task confidentialities. In addition, the same monitoring task can be associated with cameras under different streaming media servers.

[0050] In step S220, the target streaming server may generate a third monitoring instruction based on the first monitoring instruction, and send the third monitoring instruction to the target camera to control the target camera to perform the monitoring task, wherein the third monitoring instruction includes information for controlling the camera action of the target camera.

[0051] Here, the target streaming media server may be a streaming media server corresponding to the target camera.

[0052] The camera action may include, for example, camera opening, camera closing, camera angle adjustment, etc. The information for controlling the camera action of the target camera may be obtained based on the task requirements of the monitoring task, for example, the camera action of the target camera may be controlled according to the requirements of the monitoring task.

[0053] Specifically, the target streaming media server generates information for controlling the camera action of the target camera based on the monitoring task given in the first monitoring instruction, so that the target camera performs monitoring according to the monitoring task. For example, the monitoring task may include a recording plan, and the information for controlling the camera action of the target camera may instruct the target camera to obtain video stream data within the recording time set in the recording plan.

[0054] In step S230, the target camera may generate video stream data according to the third monitoring instruction, and according to the first monitoring instruction, add confidentiality information representing the task confidentiality level to the video stream data, and encrypt the video stream data to obtain an encrypted monitoring video.

[0055] In step S230, the target camera can capture the video screen and generate video stream data according to the control information in the third monitoring instruction. When generating the video stream data, the target camera can add the confidentiality information to the video stream (also called "code stream"), and can also add signature anti-tampering information to protect the integrity of the video data. As an example, the video data is encrypted when the camera outputs it, and it is not decrypted in subsequent transmission, forwarding, and storage. It is only allowed to perform decryption operations when the monitoring video is finally viewed and downloaded.

[0056] According to the monitoring method of the video monitoring system of the exemplary embodiment of the present disclosure, by respectively sending monitoring instructions containing the task confidentiality level to the streaming media server and the camera, the monitoring video output by the camera is encrypted, thereby improving the confidentiality of video transmission, and the confidentiality level information carried in the monitoring video is associated with the confidentiality requirement of the monitoring task, and corresponds to the confidentiality level obtained by the target streaming media server. While improving confidentiality, the camera makes the encryption of the video stream more flexible, which makes the video itself have a confidentiality level corresponding to the monitored content, and the processing of the video can be carried out with reference to the confidentiality level, while improving the encryption reliability, the encryption method is also made more flexible and can be adapted to monitoring tasks with different confidentiality levels.

[0057] An example configuration of a video surveillance system according to an exemplary embodiment of the present disclosure will be described in detail below.

[0058] The monitoring task may include, for example, four task states: not started, started, paused, and completed. The control of the task state will be described in detail below.

[0059] As an example, a monitoring task may be set with a recording plan, and the monitoring control platform may control the start and stop status of the recording for the target camera added to the monitoring task without changing the task status. As an example, in response to the setting of a recording plan in the monitoring task, the monitoring control platform may send the confidentiality information along with the recording plan information to the streaming media servers corresponding to all target cameras.

[0060] For example, the recording plan can be divided into a single recording mode, a daily cycle recording mode, a weekly cycle recording mode, etc. Among them, the cycle recording mode can set the number of days for recording storage. Videos that exceed the number of days for recording storage will be automatically deleted to meet the requirements of different important tasks for the number of days for recording storage. For example, the monitoring control platform can traverse all monitoring tasks at a fixed time (for example, 0:00 every day) and perform automatic deletion of recordings.

[0061] In single recording mode, you can set a pair of recording start date and time and recording stop date and time.

[0062] In the daily cycle recording mode, you can set multiple pairs of recording start time and recording stop time. There is no overlap between the recording start time and recording stop time. For example, you can set a pair of recording start date and time and recording stop date and time to "0:00:00-24:00:00", which means 24-hour uninterrupted recording.

[0063] The weekly loop recording mode can add multiple pairs of recording start time and recording stop time for each day from Monday to Sunday.

[0064] In an exemplary embodiment of the present disclosure, the video surveillance system may have multiple roles, each role corresponds to one or more users, and the monitoring method may further include: the monitoring control platform determines the task access rights of each role based on the task control function, wherein the monitoring control platform only allows the role to use the task control function authorized to the role; the monitoring control platform determines the video access rights of each role based on the video control function, wherein the monitoring control platform only allows the role to use the video control function authorized to the role; the monitoring control platform determines the video access rights of each role based on the camera, wherein the monitoring control platform only allows the role to access the video data of the camera authorized to the role.

[0065] Here, the task control function and task access rights may respectively include at least one of creating a new monitoring task, editing a monitoring task, and viewing a monitoring task; the video control function and video access rights may respectively include at least one of real-time viewing, video playback, video downloading, pan / tilt and lens control.

[0066] Specifically, in the embodiments of the present disclosure, functions can be authorized for roles, and the functions can include task access control permissions such as creating new tasks, editing tasks, and viewing tasks, as well as camera / video resource access control permissions such as real-time monitoring, cloud mirror control, video playback, and video downloading. Each role can only operate authorized functions.

[0067] As an example, personnel with "Real-time Viewing" and Know permissions can view the real-time monitoring screen of the camera in the started monitoring task; personnel with "Historical Playback" and Know permissions can view and play the historical video files generated by the task; personnel with "File Download" and Know permissions can view and download the historical video files generated by the task; personnel with "Real-time Viewing", "Pan-tilt and Lens Control" and Know permissions can adjust the pan-tilt and lens of the camera being played.

[0068] By dividing the access and control rights of roles and related users according to functions, the confidentiality measures of the video surveillance system can be refined, and related functions can be opened according to the job requirements of the roles, thereby further improving the security of the system.

[0069] However, the embodiments of the present disclosure are not limited thereto, and alternatively or additionally, device authorization may be performed on the role, for example, the role can only access video resources of an authorized camera.

[0070] As an example, the monitoring control platform can realize the control and interaction of the camera, the monitoring client (to be described below), and the streaming media server based on the GB / T28181 protocol, and the security characteristics of the video monitoring system of the embodiment of the present disclosure can, for example, meet the C-level protection requirements (i.e., the highest level of security protection) stipulated in the GB 35114 protocol. The registration process of the video monitoring system can meet the provisions of the GB 35114 standard, and can interact and communicate with other devices after registration through two-way authentication based on digital certificates.

[0071] Here, in the process of encrypting the video stream data by the camera, the encryption key of the video key and the generation, transmission, and change of the video encryption key can comply with the provisions of the GB 35114 standard. The encryption, decryption, and signature verification of the video stream data can also comply with the provisions of the GB 35114 standard. In addition, in the video surveillance system, the signature of all control signaling can be verified in accordance with the provisions of the GB35114 standard, and in response to the failure of the signature verification, the corresponding operation can be prohibited.

[0072] As an example, the monitoring and control platform can implement the confidentiality level distribution by extending the signaling of the GB / T28181 protocol. For example, the "CmdType" field value can be SetSecurityInfo. For example, the SecurityInfo field can be added in the signaling. Different field values ​​can represent different confidentiality levels. For example, the value "0" represents public, the value "1" represents internal level, the value "2" represents secret level, and the value "3" represents confidential level.

[0073] In the video surveillance system according to the embodiment of the present disclosure, the security of confidential video data and the controllable scope of knowledge can be ensured by comprehensively controlling the system security level, camera security level, personnel security level, test task security level, video stream security level, etc. An example of security level setting in the video surveillance system according to the embodiment of the present disclosure is described below.

[0074] As an example, a video surveillance system may have multiple roles, which may include but are not limited to administrators and users. The division of authority of the roles may comply with the hierarchical protection requirements for confidential information systems required or specified in the scenario to be monitored.

[0075] Here, the confidentiality level of the system / camera / task / video stream may include but is not limited to at least one of public, internal, secret, confidential and top secret.

[0076] Specifically, the video surveillance system may be pre-set with a system security level. During the use of the system, the camera security level, personnel security level, monitoring task security level and monitoring video stream security level are not allowed to exceed the system security level.

[0077] The task classification can be set when creating a new monitoring task, and cannot be modified after the monitoring task is created. The task classification cannot be higher than the system classification. In the monitoring task, personnel with a classification lower than the task classification and cameras with a classification lower than the task classification cannot be added or associated.

[0078] The personnel classification level may indicate the highest classification level of data that a person can access, and may be set, for example, by a system administrator. The personnel classification level may include, but is not limited to, at least one of non-confidential, general, important, and core, wherein non-confidential means that a person can access public and internal data resources, general means that a person can access public, internal, and secret data resources, important means that a person can access public, internal, secret, and confidential data resources, and core means that a person can access data resources of all levels.

[0079] The camera level can represent the highest task level that the camera can add to the video stream data, which can be set by the system administrator, for example. The camera video stream level can be determined based on the level of the monitoring task, which can vary according to the monitoring task to which it belongs. The camera video stream level does not exceed its own camera level.

[0080] Specifically, when creating or modifying a monitoring task, the monitoring control platform can only add cameras with a highest security level not lower than the task security level as associated cameras. The highest security level of a camera can be set by the administrator of the monitoring control platform when adding or creating a camera. For example, if the highest security level of a camera is secret, it cannot be used as an associated camera for a confidential-level task.

[0081] The confidentiality level of the video recording file may indicate that the streaming media server (described below) stores the video stream according to the confidentiality level of the currently issued monitoring task and the recording plan information, and generates a file with confidentiality level information marked according to the hierarchical protection requirements.

[0082] Here, the signaling in the GB / T28181 protocol can be extended to realize the sending of recording plan and confidentiality information. Specifically, the GB / T28181 protocol only stipulates the start and stop control of recording, and does not stipulate the sending of recording plan / confidentiality information. In the embodiments of the present disclosure, the stability, flexibility and abnormal recovery ability of the recording function of the streaming media server can be enhanced by extending the signaling.

[0083] As an example, the value of the first monitoring instruction CmdType field can be "RecordControl". The field "DeviceID" can indicate the ID of the streaming media server that receives the recording plan; the field "ControlType" can indicate the recording control type, and its value "Start" can indicate starting the recording, and its value "Stop" can indicate pausing / stopping the recording. The field "PlanType" can indicate the recording plan type, and its value "OneTime" can indicate a single recording, and its value "Daily" can indicate a daily loop recording, and its value "Weekly" can indicate a weekly loop recording.

[0084] When the recording plan is a single recording, the value of the field "StartTime" can be the date and time when the recording starts, and the value of the field "StopTime" can be the date and time when the recording ends; when the recording plan is a loop recording, the value of the field "PlanTime" can indicate the loop time information, and multiple times can be separated by delimiters. When the recording plan is a weekly loop recording, a week indication can be added to the recording start and end date and time. For example, "00:00:00-01:00:00" and "03:00:00-04:00:00" indicate that the recording starts from 0:00 to 1:00 and 3:00 to 4:00 every day; "1-01:00:00-05:00:0" and "5-15:00:00-17:00:00" indicate that the recording starts from 1:00 to 5:00 every Monday and from 15:00 to 17:00 every Friday.

[0085] The value of the field "TaskID" can be the monitoring task ID. The value of the field "TaskName" can be the monitoring task name. The value of the field "Cameras" can be the camera ID included in the recording plan. Multiple cameras can be separated by separators. The value of the field "Secrecy" can be the confidentiality level information, where the value "0" indicates public, the value "1" indicates internal level, the value "2" indicates secret level, and the value "3" indicates confidential level.

[0086] Other examples of the monitoring method of the video monitoring system according to the exemplary embodiments of the present disclosure will be described in detail below.

[0087] According to an exemplary embodiment of the present disclosure, the monitoring control platform can determine the target camera in the following manner: according to the monitoring task, determine an associated camera among multiple cameras whose camera security level is higher than the task security level of the monitoring task; in response to the associated camera not existing in other monitoring tasks, use the associated camera as the target camera.

[0088] Specifically, in a monitoring task, an associated camera with a camera security level higher than the task security level of the monitoring task can be added or associated, and such an associated camera can be used to perform the monitoring task. There can be one or more associated cameras.

[0089] When determining the associated camera, it is also necessary to consider whether the associated camera already exists in other monitoring tasks besides the current monitoring task. In response to the associated camera not existing in other monitoring tasks, the associated camera can be used as the target camera; in response to the associated camera already existing in other monitoring tasks, the current monitoring task can be prohibited, and the camera conflict information can be prompted.

[0090] In this way, when starting the current monitoring task, you can first determine whether its associated camera exists in other started monitoring tasks, so that monitoring tasks associated with the same camera cannot be started at the same time, to ensure that the confidentiality level of the camera video resources is correct and the scope of knowledge is controllable, thereby ensuring the reliability of the monitoring system operation.

[0091] In the video monitoring system according to the exemplary embodiment of the present disclosure, each camera may correspond to a streaming media server, and the streaming media server may receive monitoring videos from the corresponding camera. As an example, the monitoring control platform may be configured to add multiple streaming media servers according to the on-site environment to be monitored and business requirements, and the administrator of the monitoring control platform may set the streaming media servers corresponding to the cameras, for example, the streaming media servers corresponding to the cameras may be divided according to the geographical locations where the cameras are deployed.

[0092] In this example, the monitoring control platform can also perform the following operations: in response to the monitoring task including recording plan information, obtaining the storage space occupancy rate of the target streaming media server; in response to the storage space occupancy rate of the target streaming media server being less than or equal to a preset occupancy threshold, executing the step of sending a second monitoring instruction to the target camera among multiple cameras, and sending the recording plan information and the task classification to the target streaming media server; in response to the storage space occupancy rate of the target streaming media server being greater than the preset occupancy threshold, ending the monitoring task.

[0093] Specifically, in some monitoring tasks, it may be necessary to record the captured video data and save the recorded video. This process can be achieved through a streaming media server. The streaming media server corresponding to the target camera can receive the monitoring video from the target camera and store it, thereby saving the recorded video to allow operations such as playback and downloading of such video.

[0094] When a recording plan is set for a monitoring task, the storage space occupancy rate of all target streaming media servers can be queried when the monitoring task is started.

[0095] In response to the storage space occupancy rate of any target streaming media server being less than or equal to the preset occupancy threshold, the monitoring task can be continued, and the recording plan information and the task classification can be sent to the target streaming media server. Here, the recording plan information may include, but is not limited to, at least one of the recording type, start and stop time, cycle time, and recording camera number. As an example, the target streaming media server may locally record the recording plan information and record the real-time monitoring screen into a recording file according to the recording plan information, so that the recording plan can be automatically restored when an abnormality occurs in the device or service.

[0096] In response to the storage space occupancy rate of any target streaming media server being greater than a preset occupancy threshold, the current monitoring task may be prohibited, and a prompt may be given that the storage space occupancy rate of the target streaming media server exceeds the preset occupancy threshold.

[0097] Here, the preset occupancy threshold may be set according to actual needs, for example, may be but is not limited to 95%.

[0098] Through the above method, it is possible to determine whether the storage space of the target streaming media server is sufficient before starting the monitoring task, so as to ensure that the recording plan in the task can be implemented smoothly.

[0099] According to an exemplary embodiment of the present disclosure, the monitoring method may further include: the target streaming media server receives the monitoring video from the target camera according to the recording plan information; the target streaming media server stores the monitoring video to a storage location corresponding to the task level according to the task level.

[0100] Specifically, after receiving the video recording plan information of the monitoring task, the target streaming media server can record the target camera according to the setting type and time in the video recording plan information to generate a video recording file. The name of the video recording file can include the camera's identity document (ID), the file generation time, and the confidentiality level information corresponding to the monitoring task. For example, the name of the video recording file can be "34020000001320000236-20240801153000 (public).gsf".

[0101] In this example, different task levels may correspond to different storage locations. Specifically, video files of different levels may be stored in different paths or external storage spaces, so that different important video files can be stored and backed up separately, thereby facilitating management and viewing of video files.

[0102] In addition, as an example, each streaming media server can store a local lightweight database (e.g., database sqlite3) built into the service so as to query and delete the generated video files, and record the video plan information of the monitoring task. When network abnormalities, device abnormalities, program abnormalities, etc. occur, the streaming media server can automatically resume recording according to the recorded video plan information.

[0103] The video file information may include, but is not limited to, at least one of the device name, monitoring task ID, video file start time, video file end time, video file path, video file name, and video file size. The video plan information may include, but is not limited to, at least one of the monitoring task ID, video plan type, video plan time, and video single / cycle start and stop time.

[0104] For example, the table name of the recording file information may be "RecordFileInfo", which may include field information such as device name (DevID), monitoring task ID (TaskID), recording file start time (StartTime), recording file end time (EndTime), recording file path (FilePath), recording file name (TaskName), and recording file size (FileSize); the table name of the recording plan information may be "RecordPlanInfo", which may include field information such as TaskID, PlanType, PlanTime, and recording single / cycle start and stop time.

[0105] In addition, according to an exemplary embodiment of the present disclosure, the streaming media server can delete the video files according to the video deletion instruction received from the monitoring control platform, and can also automatically delete the expired video files according to the preset deletion instruction.

[0106] Specifically, in the example of deleting video files according to video deletion instructions, video files can only be actively deleted by personnel with deletion authority and knowledge of monitoring tasks by sending video deletion instructions through the monitoring control platform. When deleting recorded videos, you can first select the monitoring task and the associated target streaming media server, and then you can choose to specify the camera and deletion time range.

[0107] As an example, the monitoring control platform can send a video deletion instruction to the streaming media server to instruct the streaming media server to delete the stored video files, wherein the video deletion instruction includes a video deletion condition, and the streaming media server can delete the video files that meet the video deletion condition based on the video deletion condition in the received video deletion instruction.

[0108] As an example, the video deletion condition may include but is not limited to at least one of the monitoring task ID, the camera ID designated to delete the video, the start date and time of the deletion range, and the end date and time of the deletion range. The monitoring task ID cannot be empty, the camera ID designated to delete the video can be empty, and when there are multiple cameras designated to delete the video, the IDs of the cameras can be separated by separators such as ";", and the start date and time and end date and time of the deletion range can be unlimited, for example, they can be represented by a value of "0".

[0109] For example, the monitoring control platform can implement the control of video deletion files by designing and extending the signaling in the GB / T28181 protocol. The field value of the video deletion instruction "CmdType" can be, for example, "RecordDelete", which can delete the video files that meet the requirements by configuring the monitoring task ID (TaskId), specifying the camera ID (Cameras) to delete the video, the start date and time of the deletion range (StartTime), and the end date and time of the deletion range (EndTime).

[0110] In the example of deleting the video file according to the preset deletion instruction, different video validity periods can be set for different confidentiality levels or task requirements according to the usage scenario requirements of different monitoring tasks. For example, the video validity period of confidential tasks can be set to 360 days, the video validity period of secret tasks can be set to 180 days, and the video validity period of internal / public tasks can be set to 90 days. If the video validity period is not set or set to 0, the video file will be permanently saved and no automatic deletion operation will be performed. The monitoring control platform can issue file deletion operation instructions to all started monitoring tasks at a fixed time every day (for example, 0 o'clock), and the instruction carries the date range of the video to be deleted.

[0111] In addition, according to an exemplary embodiment of the present disclosure, the video monitoring system also includes a monitoring client), and the monitoring client can receive monitoring videos from cameras and streaming media servers.

[0112] As an example, the administrator of the video surveillance system can configure the terminal device to which the available monitoring client belongs (or is loaded to) for each user. For example, it can be bound by information such as IP and MAC address. After configuration, the user can only log in to the monitoring client and perform related operations on the configured terminal device. There is no login restriction when information such as IP and MAC address is empty.

[0113] Administrators can also authorize monitoring clients for major functions such as "real-time playback", "video playback", "video download", and "cloud mirror control" through the monitoring control platform. For example, after a role with "real-time playback" permission logs in to a monitoring client, real-time playback operations can only be performed if the monitoring client also has "real-time playback permission".

[0114] After the user logs in to the monitoring client, the monitoring client can obtain the current user's functional permissions. In the logged-in state, in response to changes in functional permissions, the monitoring client can receive the user's latest functional permissions issued by the monitoring control platform, and can control the functions corresponding to the latest functional permissions. For example, if the user is playing the real-time monitoring screen, the playback of the screen can be terminated after the "real-time playback" permission is revoked.

[0115] In addition, the monitoring client can set the confidentiality level individually. The confidentiality level of the monitoring client shall not be higher than the confidentiality level of the terminal device to which it belongs. The monitoring client cannot access video streams with a confidentiality level higher than that of its own monitoring client. For example, if the client terminal is configured as "secret", the client terminal is prohibited from viewing information related to "confidential" level tasks.

[0116] In this example, the second monitoring instruction may also include confidentiality level display information, which may indicate whether the target camera superimposes and displays the confidentiality level information in the video screen of the monitoring video. The monitoring video may carry the confidentiality level display information.

[0117] Here, according to the monitoring method of the embodiment of the present disclosure, it is allowed to modify traditional or existing cameras. For example, cameras supporting the GB / T28181 protocol and the GB 35114 standard can be modified.

[0118] Specifically, the monitoring control platform can send a second monitoring instruction to the target camera. For example, the value of the "CmdType" field can be SetSecurityInfo, and the camera can parse the confidentiality information (SecurityInfo) and confidentiality display information (OSDShowSecurityInfo) in the control instruction. After the monitoring control platform sends the second monitoring instruction to the target camera, in response to receiving the instruction execution success information returned by the target camera, the monitoring control platform can control the normal start of the monitoring task; in response to not receiving the instruction execution success information returned by the target camera, the monitoring control platform can prohibit the start of the monitoring task.

[0119] The camera can add the corresponding security level parsed from the security level information to a fixed position in the output code stream, for example but not limited to adding the security level information to each frame of the code stream data. In addition, the camera can also store the security level information inside the camera, and the stored security level information cannot be modified from the outside, and the security level information will not be lost after the camera is powered off or restarted.

[0120] The confidentiality level display information can be indicated by different flags to turn on or off the confidentiality level information overlay. For example, in the confidentiality level display information, when the value is 1, it indicates that the confidentiality level information overlay is turned on; when the value is 0, it indicates that the confidentiality level information overlay is turned off. As an example, when the confidentiality level display information indicates that the confidentiality level information overlay is turned on, the camera can add the confidentiality level information to the bitstream and directly overlay the text information corresponding to the confidentiality level on the generated video screen.

[0121] In addition, the camera can also add confidentiality information signature information to the video stream data. When playing the surveillance video, the confidentiality information signature information can be reverse verified to achieve integrity verification.

[0122] As described above, since the camera can turn on or off the superposition of confidentiality information, accordingly, different videos can be played on the monitoring client according to different confidentiality display information.

[0123] As an example, the monitoring method may also include: in response to the classification display information indicating that the target camera does not display the classification information in the video screen of the monitoring video, the monitoring client superimposes the classification information on the video screen when playing or downloading the monitoring video.

[0124] Specifically, when playing or downloading a video, in one example, when the confidentiality display information in the control instruction sent by the monitoring control platform to the camera indicates that the confidentiality information is not displayed in the video screen, for example, the value of the above field OSDShowSecurityInfo is "0", the monitoring client can overlay the field information corresponding to the confidentiality mark in the upper left corner of the screen when playing / downloading the monitoring video;

[0125] In another example, when the confidentiality level display information indicates that the confidentiality level information is displayed in the video screen, for example, the value of the above-mentioned field OSDShowSecurityInfo is "1", which means that the camera has superimposed the confidentiality level field information in the screen, and the monitoring client does not need to do separate processing when playing / downloading.

[0126] Through the above method, the monitoring client can obtain the confidentiality display information sent to the camera by the monitoring control platform, and can determine whether to superimpose the confidentiality mark on the screen when playing or downloading the video based on the information, thereby realizing information sharing and collaboration among the monitoring control platform, camera and monitoring client, and completing the display of the confidentiality mark.

[0127] In addition, the monitoring client can verify the signature information of the confidentiality mark in the code stream when playing or downloading to perform integrity verification. In response to the failure of the signature verification, it can be considered that the confidentiality mark has been tampered with, and the monitoring client can prohibit playing or downloading the current monitoring video.

[0128] As an example, when the monitoring client finally plays or downloads the monitoring video, it can perform a decryption operation according to the agreement such as GB 35114 protocol, and verify the signature of the video stream at the same time. In response to the failure of the signature verification, the monitoring client can terminate the playback or downloading.

[0129] Specifically, the monitoring client can parse the confidentiality information in the code stream during the video playback or download process, and compare it with the preset confidentiality identification signature for signature verification. If the signature verification fails, it can be considered that the confidentiality identification has been tampered with, and the playback / download is terminated. In addition, the monitoring client can also compare the confidentiality information in the code stream with the task confidentiality of the monitoring task to which the video belongs. In response to the confidentiality information in the code stream not matching the task confidentiality, the monitoring client can terminate the playback or download.

[0130] In some embodiments, the camera can be in a special encoding format such as the SVAC encoding format. These special encoding formats can only be played in a dedicated player after simple decryption and downloading. If they are transcoded into a universal encoding format during downloading, they can be easily played in a universal player. However, this requires decoding the video and then re-encoding it, which is very inefficient. In this regard, according to an exemplary embodiment of the present disclosure, the monitoring client can also perform the following operations: playback historical monitoring videos, and during the playback process, decrypt the historical monitoring videos, and cache the videos of the preset time window before the current video screen, including the current video screen; during the playback process, in response to receiving a start download instruction input by the user, decode the videos of the preset time window and the videos after the current video screen, and encode the decoded videos according to the preset encoding format until receiving an end download instruction input by the user, and store the encoded videos.

[0131] For example, you can first select a historical surveillance video for historical video playback. During playback, you can cache the video screen of a preset time window (for example, 5 seconds). When playing (for example, you can accelerate or drag to) the screen of interest to be downloaded, the user can click the "Start Download" button on the monitoring client. The monitoring client responds to the instruction, decodes the cache of the preset time window and the video played after that, and then performs encoding operations according to a preset encoding format (for example, a common encoding format) to obtain an encoded video, which can be encoded into an MP4 common format through an open source ffmpeg tool. During the encoding process, the replayed video screen continues to play. When the playback ends at the screen of interest, the user can click the "End Download" button on the monitoring client, or when the video playback is completed, during this period, the video can be stored after transcoding, for example, its file name can have the format of "camera number_operator_time (classification level)".

[0132] Through the above method, the user is allowed to transcode and download only the key videos that he is interested in in the recording, thereby improving the efficiency of video transcoding.

[0133] In addition, according to an exemplary embodiment of the present disclosure, the monitoring method may further include: the monitoring client queries a target streaming server corresponding to the monitoring task according to the monitoring task; and the monitoring client obtains a monitoring video of the monitoring task from the target streaming server.

[0134] Specifically, when querying the video files of a monitoring task, you can first select the streaming media server associated with the task. As an example, you can also selectively specify the camera to be queried, the start and end time of the query range, and other information. The video query can query the generated video file information based on the task's associated camera, associated streaming media server, start and end time and other parameters. If the associated streaming media server is not specified, the query command can be sent to all associated streaming media, and the query results can be integrated and displayed.

[0135] When querying, the monitoring client can send query parameter information to the streaming media server associated with the monitoring task. The query parameter information may include the monitoring task number to be queried, and may also include but is not limited to the camera ID of the query, the start and end date range of the query, the page of the query, and at least one of the number of files on each page.

[0136] As an example, the video query instruction type can be represented by the field "Query", and the field value of the field "CmdType" is "RecordInfo"; the value of the field "TaskID" can be the monitoring task number of the query (which cannot be empty); the fields "StartTime" and "EndTime" can be the start and end date and time range of the query respectively, where "0" can indicate no restriction; the field "Cameras" can be the specified query camera ID (it can be empty, and when querying multiple cameras, the camera IDs can be separated by separators such as ";"); the field "PageNum" can indicate the page of the query; the field "PageSize" can indicate the number of files on each page.

[0137] Accordingly, the streaming media server can respond to the query parameter information received from the monitoring client and feedback the query response information to the monitoring client. The query response information may include, but is not limited to, the number of file information queried and the information of each video file. The information of each video file may include, but is not limited to, the camera ID, the absolute path for storing the video file, the start time of the video file, the end time of the video file, the confidentiality level of the video file, and the size of the video file.

[0138] As an example, in the response message of the video query instruction, the field "SumNum" can represent the number of file information queried, and the information of each file is described as follows: the field "DeviceID" can represent the camera ID, the field "FilePath" can represent the absolute path of the stored video file, "StartTime" can represent the start time of the video file, the field "EndTime" can represent the end time of the video file, the field "Secrecy" can represent the confidentiality level of the video file, and the field "FileSize" can represent the size of the video file) information.

[0139] The following will refer to Figure 3 and Figure 4 An example of controlling a task state of a monitoring task in a monitoring method of a video monitoring system according to an exemplary embodiment of the present disclosure is described.

[0140] like Figure 3 As shown, in step S310, the monitoring control platform can create a new monitoring task in response to the task creation instruction input by the user. As an example, the task status of the monitoring task can include "not started" (the status code can be, for example, 0), "started" (the status code can be, for example, 1), "paused" (the status code can be, for example, 2), and "stopped" (the status code can be, for example, 3).

[0141] After a task is created, its task status is "Not Started". In addition, after a task is created, the task classification cannot be modified. Personnel with monitoring task control authority and knowledge authority can control the task status.

[0142] The monitoring control platform may receive a task start instruction input by a user, where the task start instruction indicates a monitoring task to be started. In step S320, the monitoring control platform may determine whether there is a conflict with an associated camera associated with the monitoring task according to the monitoring task to be started, where the conflict means that the camera is already in other started monitoring tasks.

[0143] When a monitoring task is set with a recording plan, in response to there being no conflict with the associated camera, the associated camera can be used as the target camera, and in step S330, the monitoring control platform can determine whether the storage space occupancy rate of the target streaming media server corresponding to the target camera exceeds a preset occupancy threshold; in response to there being a conflict with the associated camera, the current monitoring task can be prohibited, and the conflict information of the camera can be prompted.

[0144] In response to the storage space occupancy rate of the target streaming server not exceeding the preset occupancy threshold, the monitoring control platform can send the recording plan information to the target streaming server, and in step S340, the monitoring control platform can set the task status of the monitoring task to the "started" state; in response to the storage space occupancy rate of the target streaming server exceeding the preset occupancy threshold, the current monitoring task can be prohibited and the corresponding information can be prompted.

[0145] The target streaming media server can record the real-time monitoring screen of the target camera into a video file for storage according to the video recording plan information. In addition, the target streaming media server can also store the video recording plan information locally.

[0146] For monitoring tasks in the "started" state, the monitoring control platform can respond to receiving a pause / complete command input by the user (for example, the user can enter the pause / complete command by clicking the "Pause" / "Complete" button in the platform interface) and send a recording pause / complete control command to all target streaming media servers, and in step S350, confirm whether the recording pause command of all target streaming media servers has been sent successfully; or in step S360, confirm whether the recording completion command of all target streaming media servers has been sent successfully.

[0147] In response to the failure of sending the recording pause instruction or the recording completion instruction to all target streaming media servers, the monitoring control platform may keep the monitoring task in the "started" state.

[0148] In response to the successful delivery of the recording pause instruction to all target streaming servers, the monitoring control platform may change the task status of the monitoring task to "paused" in step S370. In response to receiving the completion instruction input by the user, the monitoring control platform may change the task status of the monitoring task to "completed" in step S380. Alternatively, in response to the successful delivery of the recording completion instruction to all target streaming servers, the monitoring control platform may change the task status of the monitoring task to "completed" in step S380.

[0149] In the above process, the monitoring control platform can terminate the real-time playback of the target camera of the monitoring task in the monitoring client while changing the monitoring task from the "started" state to the "paused" or "stopped". In addition, when the monitoring task is in the "paused" state, the control platform can restore the task state of the monitoring task to the "started" state in response to receiving the start instruction input by the user.

[0150] In addition, as an example, when the command from the monitoring and control platform is not successfully issued, the task status change is prohibited. In this way, it is possible to prevent the abnormal state of the streaming media server recording execution process from being uncontrollable. The recording status of the camera corresponding to the streaming media server that has returned successful execution becomes "not recording", otherwise the camera recording status is "recording".

[0151] According to the embodiments of the present disclosure, Figure 4 As shown in the figure, the monitoring control platform can check whether the target camera in the monitoring task conflicts with other started tasks. If not, the monitoring task can be started. When the monitoring task is in the "started" state, the monitoring control platform can send the confidentiality level information to the target camera, and the target camera can add the confidentiality level information to the output code stream, and the output code stream is an encrypted code stream.

[0152] When the monitoring task is in the "started" state, the monitoring client can provide real-time monitoring images or cloud mirror control to personnel with corresponding permissions and within the scope of knowledge for viewing, and decrypt the video stream during playback. The monitoring client can also provide the generated video files to personnel with corresponding permissions and within the scope of knowledge for playback, and decrypt the video stream during playback. The monitoring client can also provide the generated video files to personnel with corresponding permissions and within the scope of knowledge for downloading, and decrypt the video stream during downloading.

[0153] In addition, the monitoring control platform can only delete monitoring tasks in the "completed" state, and when deleting, the monitoring control platform can also delete the recorded video data generated by the monitoring task. The monitoring control platform can modify the awareness scope and / or associated cameras for monitoring tasks in the "not started" or "paused" states. The monitoring control platform cannot issue configuration instructions such as network parameters and video parameters to the associated cameras of monitoring tasks in the "started" state.

[0154] According to the exemplary embodiments of the present disclosure, a comprehensive method can be proposed that is applicable to confidential scenarios and meets relevant confidentiality requirements while ensuring the security and controllability of video data. It can solve the problem of defining the confidentiality level of video stream data generated in confidential scenarios, and propose a management and control method for confidential monitoring tasks to solve the problem of monitoring data access control generated in confidential scenarios.

[0155] In the monitoring method according to the exemplary embodiment of the present disclosure, the camera can generate a video data classification, and it can change with the task change. In the video monitoring system, personnel / roles cannot access unauthorized cameras and video data resources, cannot perform unauthorized functional operations, and cannot access cameras and video data resources with a higher classification than their own.

[0156] In addition, in the video surveillance system, people / roles without the right of knowledge cannot control the tasks, and cannot access the real-time and historical video data generated by the tasks. The video data is encrypted throughout the entire process and is only decrypted during the final playback and download to ensure the security of the video data.

[0157] According to a second aspect of the present disclosure, a video monitoring system is provided. Figure 5 As shown, the video surveillance system 500 may include a surveillance control platform 510 , a plurality of cameras 520 , and a plurality of streaming media servers 530 .

[0158] The monitoring control platform 510 can send a first monitoring instruction to a target streaming server among multiple streaming servers 530 and send a second monitoring instruction to a target camera among multiple cameras 520 based on the monitoring task, wherein the first monitoring instruction includes the monitoring task and the task level of the monitoring task, and the second monitoring instruction includes the task level of the monitoring task.

[0159] The target streaming media server generates a third monitoring instruction according to the first monitoring instruction, and sends the third monitoring instruction to the target camera to control the target camera to perform the monitoring task, wherein the third monitoring instruction includes information for controlling the camera action of the target camera.

[0160] The target camera can generate video stream data according to the third monitoring instruction, and add the confidentiality information representing the confidentiality level of the task to the video stream data according to the first monitoring instruction to obtain the monitoring video.

[0161] Regarding the video surveillance system in the above embodiment, the structure of each part and the specific method of performing operations have been described in detail in the embodiment of the above monitoring method, and will not be elaborated here.

[0162] According to a third aspect of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the monitoring method of the video surveillance system according to the present disclosure.

[0163] In an exemplary embodiment, the computer-readable storage medium may be, for example, a memory including instructions. Alternatively, the computer-readable storage medium may be: a read-only memory (ROM), a random access memory (RAM), a random access programmable read-only memory (PROM), an electrically erasable programmable read-only memory (EEPROM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash memory, a nonvolatile memory, a CD-ROM, a CD-R, a CD+R, a CD-RW, a CD+RW, a DVD-ROM, a DVD-R, a DVD+R, a DVD-RW, a DVD+RW, a DVD-RAM, a BD-ROM, a BD-R, a BD-R LTH, BD-RE, Blu-ray or optical disk storage, hard disk drive (HDD), solid state drive (SSD), card storage (such as, multimedia card, secure digital (SD) card or extreme digital (XD) card), magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk and any other device, any other device is configured to store computer programs and any associated data, data files and data structures in a non-transitory manner and provide the computer programs and any associated data, data files and data structures to a processor or computer so that the processor or computer can execute the computer program. The computer program in the above-mentioned computer-readable storage medium can be run in an environment deployed in a computer device such as a client, a host, an agent device, a server, etc. In addition, in one example, the computer program and any associated data, data files and data structures are distributed on a networked computer system, so that the computer program and any associated data, data files and data structures are stored, accessed and executed in a distributed manner by one or more processors or computers.

[0164] According to a fourth aspect of the present disclosure, a computer program product is provided, comprising computer executable instructions, which implement the monitoring method of the video surveillance system according to the present disclosure when the computer executable instructions are executed by at least one processor.

[0165] In the above exemplary embodiments, the electronic device may include a processor and a memory for storing processor executable instructions. Here, when the processor executable instructions are executed by the processor, the processor is prompted to execute the monitoring method of the video surveillance system or the multimodal information detection method as described in the above exemplary embodiments.

[0166] As an example, the electronic device does not have to be a single device, but can also be any collection of devices or circuits that can execute the above instructions (or instruction sets) individually or in combination. The electronic device can also be part of an integrated control system or system manager, or can be configured as a server that is interconnected with a local or remote (e.g., via wireless transmission) interface.

[0167] In electronic devices, the processor may include a central processing unit (CPU), a graphics processing unit (GPU), a programmable logic device, a dedicated processor system, a microcontroller or a microprocessor. As an example and not limitation, the processor may also include an analog processor, a digital processor, a microprocessor, a multi-core processor, a processor array, a network processor, etc.

[0168] The processor can execute instructions or codes stored in the memory, wherein the memory can also store data. Instructions and data can also be sent and received through the network via the network interface device, wherein the network interface device can adopt any known transmission protocol.

[0169] The memory may be integrated with the processor, for example, RAM or flash memory is arranged within an integrated circuit microprocessor or the like. In addition, the memory may include a separate device, such as an external disk drive, a storage array, or any other storage device that can be used by a database system. The memory and the processor may be operatively coupled, or may communicate with each other, such as through an I / O port, a network connection, etc., so that the processor can read files stored in the memory.

[0170] In addition, the electronic device may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, a mouse, a touch input device, etc.) All components of the electronic device may be connected to each other via a bus and / or a network.

[0171] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0172] In addition, it should be noted that although several examples of each step are described above with reference to specific drawings, it should be understood that the embodiments of the present disclosure are not limited to the combinations given in the examples, and the steps appearing in different drawings may be combined, which are not exhaustively listed here.

[0173] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A monitoring method of a video monitoring system, characterized in that: The video monitoring system includes a monitoring control platform, multiple cameras and multiple streaming media servers, wherein the monitoring method includes: The monitoring control platform sends a first monitoring instruction to a target streaming media server among the multiple streaming media servers according to the received monitoring task, and sends a second monitoring instruction to a target camera among the multiple cameras, wherein the first monitoring instruction includes the monitoring task and the task classification of the monitoring task, and the second monitoring instruction includes the task classification of the monitoring task; The target streaming media server generates a third monitoring instruction according to the first monitoring instruction, and sends the third monitoring instruction to the target camera to control the target camera to perform the monitoring task, wherein the third monitoring instruction includes information for controlling the camera action of the target camera; The target camera generates video stream data according to the third monitoring instruction, and according to the first monitoring instruction, adds the confidentiality information representing the confidentiality level of the task to the video stream data, and encrypts the video stream data to obtain an encrypted monitoring video.

2. The monitoring method according to claim 1, characterized in that: Each of the plurality of cameras has a camera security level, wherein the camera security level indicates the highest task security level that the camera can add to the video stream data, wherein the monitoring control platform determines the target camera in the following manner: According to the monitoring task, determining an associated camera among the multiple cameras whose camera security level is higher than the task security level of the monitoring task; In response to the associated camera not existing in other monitoring tasks, the associated camera is used as the target camera.

3. The monitoring method according to claim 1 or 2, characterized in that: Each camera corresponds to one of the plurality of streaming media servers, and each streaming media server receives monitoring video from a corresponding camera, wherein the monitoring control platform further performs the following operations: In response to the monitoring task including recording plan information, obtaining a storage space occupancy rate of the target streaming media server; In response to the storage space occupancy rate of the target streaming media server being less than or equal to a preset occupancy threshold, executing the step of sending the second monitoring instruction to the target camera among the multiple cameras, and sending the recording plan information and the task classification to the target streaming media server; In response to the storage space occupancy rate of the target streaming media server being greater than the preset occupancy threshold, the monitoring task is terminated.

4. The monitoring method according to claim 3, characterized in that: The monitoring method further comprises: The target streaming media server receives the monitoring video from the target camera according to the recording plan information; The target streaming media server stores the monitoring video in a storage location corresponding to the task confidentiality level according to the task confidentiality level, wherein different task confidentiality levels correspond to different storage locations.

5. The monitoring method according to claim 1, characterized in that: The second monitoring instruction also includes confidentiality level display information, and the confidentiality level display information indicates whether the target camera superimposes and displays the confidentiality level information in the video screen of the monitoring video, and the monitoring video carries the confidentiality level display information. The video monitoring system further includes a monitoring client, and the monitoring client receives the monitoring video, wherein the monitoring method further includes: In response to the confidentiality level display information instructing the target camera not to display the confidentiality level information in the video screen of the monitoring video, the monitoring client superimposes the confidentiality level information on the video screen when playing or downloading the monitoring video.

6. The monitoring method according to claim 5, characterized in that: The monitoring client also performs the following operations: Playing back the historical surveillance video, and during the playback process, decrypting the historical surveillance video, and caching the video of the preset time window before the current video screen including the current video screen; During the playback process, in response to receiving a start download instruction input by the user, the video in the preset time window and the video after the current video screen are decoded, and the decoded video is encoded according to a preset encoding format until an end download instruction input by the user is received and the encoded video is stored.

7. The monitoring method according to claim 1, characterized in that: The video monitoring system has multiple roles, each role corresponds to one or more users, and the monitoring method further includes: The monitoring control platform determines the task access rights of each role according to the task control function, wherein the monitoring control platform only allows the role to use the task control function authorized for the role; The monitoring control platform determines the video access rights of each role according to the video control function, wherein the monitoring control platform only allows the role to use the video control function authorized for the role; The monitoring control platform determines the video access rights of each role according to the camera, wherein the monitoring control platform only allows the role to access the video data of the camera authorized by the role, Among them, the task control function and the task access rights respectively include at least one of creating a new monitoring task, editing a monitoring task and viewing a monitoring task, and the video control function and the video access rights respectively include at least one of real-time viewing, video playback, video downloading and cloud mirror control.

8. A video surveillance system, characterized in that: The video monitoring system includes a monitoring control platform, multiple cameras and multiple streaming media servers. The monitoring control platform sends a first monitoring instruction to a target streaming media server among the multiple streaming media servers according to the monitoring task, and sends a second monitoring instruction to a target camera among the multiple cameras, wherein the first monitoring instruction includes the monitoring task and the task classification of the monitoring task, and the second monitoring instruction includes the task classification of the monitoring task; The target streaming media server generates a third monitoring instruction according to the first monitoring instruction, and sends the third monitoring instruction to the target camera to control the target camera to perform the monitoring task, wherein the third monitoring instruction includes information for controlling the camera action of the target camera; The target camera generates video stream data according to the third monitoring instruction, and adds the confidentiality information representing the confidentiality level of the task to the video stream data according to the first monitoring instruction to obtain a monitoring video.

9. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the monitoring method of a video monitoring system according to any one of claims 1 to 7.

10. A computer program product comprising computer executable instructions, characterized in that: When the computer executable instructions are executed by at least one processor, the monitoring method of the video monitoring system according to any one of claims 1 to 7 is implemented.

Images