Security protection method and system for screen display dynamic content

Abstract

The invention discloses a security protection method and system for screen display dynamic content, belongs to the technical field of multimedia content security, and is used for solving the technical problem that a video stream played or put by an existing outdoor LED large screen has a security risk of being tampered easily. The method comprises the following steps: acquiring a preset configuration file, and extracting a watermark parameter and an interception strategy from the preset configuration file; embedding a blind watermark into a to-be-played video stream according to the watermark parameter, and transmitting the to-be-played video stream embedded with the blind watermark; and triggering the interception strategy in response to a verification result of the blind watermark so as to display a preset pure color screen. According to the method, the to-be-played video stream is transmitted from the server to the terminal, and then security protection in the whole transmission process of the terminal decoder and the large-screen equipment is realized, so that the risk that the video stream is easily tampered is avoided, the concealment, the anti-interference performance and the multi-equipment compatibility are considered, and the security of the to-be-played video stream is improved. The method is widely applicable to outdoor large-screen content safety protection in scenes such as smart cities and transportation hubs.

Description

Technical Field

[0001] This application relates to the technical field of multimedia content security, and particularly to a security protection method and system for screen display dynamic content. Background Art

[0002] With the continuous improvement of the national economy, the advertising industry has developed vigorously. As the main form of placing or playing video advertisements, outdoor LED large screens have been widely used.

[0003] However, during the video stream transmission process, there may be situations of malicious tampering or being easily tampered with. To address this problem, a scheme of adding watermarks to the video stream has been proposed to ensure the security of the video stream by adding watermarks. But currently, the traditional watermarks added to the video stream are all of relatively high visibility, and these watermarks are extremely easy to be maliciously removed or damaged. The risk of the video stream being tampered with is still relatively high, making it difficult to meet the high security requirements of the video stream. At the same time, even if some watermarks with high visibility are removed or damaged, or some video streams are tampered with, it is possible to intercept them before the video stream is played to avoid playing the tampered video stream. However, in the current technology, there is a lack of a feedback mechanism after intercepting illegal video streams, and the interception results cannot be reported in a timely or real-time manner, which greatly reduces the operation and maintenance efficiency during the video stream placement or playback process. Summary of the Invention

[0004] This application provides a security protection method and system for screen display dynamic content to solve the following technical problems: the technical problem that the video stream placed or played on the existing outdoor LED large screen has a security risk of being easily tampered with.

[0005] This application adopts the following technical solutions: On the one hand, this application provides a security protection method for screen display dynamic content. The method includes: obtaining a preset configuration file, and extracting watermark parameters and an interception strategy from the preset configuration file; embedding a blind watermark into the video stream to be played according to the watermark parameters, and transmitting the video stream to be played with the blind watermark embedded; triggering the interception strategy in response to the verification result of the blind watermark to display a preset solid color screen.

[0006] In a possible implementation manner of this application, the blind watermark is composed of encrypted pixel points, and the watermark parameters at least include the starting coordinates of the blind watermark and the RGB value sequence of the encrypted pixel points; the interception strategy at least includes the RGB value of the preset solid color screen.

[0007] In a possible implementation manner of the present application, when embedding a blind watermark into the video stream to be played according to the watermark parameters, the method further includes: determining the blind watermark embedding area of the video stream to be played, including: dividing the video stream to be played into 8×8 pixel blocks by using an adaptive grid division algorithm, and extracting the luminance component matrix of each block in the YUV color space; performing an 8×8 discrete cosine transform on the luminance component matrix corresponding to each block; determining the middle frequency band in the frequency domain according to the result of the discrete cosine transform, so as to determine the blind watermark embedding area according to the corresponding position of the middle frequency band in the video stream data to be played.

[0008] In a possible implementation manner of the present application, the preset configuration file adopts a JSON configuration file. Obtaining the preset configuration file includes: importing the JSON configuration file through a management software or an SDK, and setting the watermark parameters and the interception policy; performing persistent storage on the JSON configuration file, and setting automatic loading after restart.

[0009] In a possible implementation manner of the present application, when storing the JSON configuration file, the method further includes: encrypting the JSON configuration file by using the AES algorithm, and storing it after the encryption is completed.

[0010] In a possible implementation manner of the present application, after the video stream to be played with the blind watermark embedded is transmitted, the method further includes: extracting blind watermark pixel points frame by frame from the video stream to be played; comparing the sequence of RGB values corresponding to the extracted pixel points with preset configuration information, where the preset configuration information is obtained from the preset configuration file and / or is obtained by loading the configuration of the integrated SDK; if the two are consistent, then passing the verification, and normally transmitting and displaying the video stream to be played.

[0011] In a possible implementation manner of the present application, after comparing the sequence of RGB values corresponding to the extracted pixel points with the preset configuration information, the method further includes: determining that the sequence of RGB values is inconsistent with the preset configuration information; interrupting the transmission of the video stream to be played, and switching to a preset solid color screen, and simultaneously recording a playback log; uploading the playback log in response to a viewing instruction of the playback log, and / or uploading the playback log periodically.

[0012] On the other hand, the present application also provides a security protection system for screen display dynamic content. The system includes a cloud server, a decoder, and a sending device; the decoder obtains a preset configuration file from the cloud server, and extracts watermark parameters and interception policies from the preset configuration file; the decoder embeds a blind watermark into the video stream to be played according to the watermark parameters, and transmits the video stream to be played with the blind watermark embedded; the sending device triggers the interception policy in response to the verification result of the blind watermark to display a preset solid color screen.

[0013] In a possible implementation manner of the present application, when the sending device is started for the first time, verification is not enabled by default, and the video stream to be played is directly transmitted to the receiving device.

[0014] In a possible implementation manner of the present application, the sending device integrates an SDK to implement configuration loading, and periodically reports playback logs through a callback interface.

[0015] A security protection method and system for screen display dynamic content provided by the present application have the following beneficial effects: 1) Improved security: By adding a blind watermark to the video stream to be played through a preset configuration file, the video stream can be protected during the entire transmission process from the server to the terminal and then through the terminal decoder and the large screen device. The watermark during the transmission process has low visibility, reducing the risk of the watermark being removed or damaged, thereby effectively reducing the risk of the video stream being maliciously tampered with.

[0016] 2) Real-time feedback can be provided: If the verification of the blind watermark embedded in the video stream fails, the interception policy is triggered to intercept the maliciously tampered video stream in a timely manner to avoid playback errors. At the same time, after interception, the abnormal playback status can be reported in real time, facilitating timely adjustment of the watermark policy or execution of operation and maintenance.

[0017] The above description is only an overview of the technical solution of the present application. In order to be able to understand the technical means of the present application more clearly, it can be implemented according to the content of the specification. And in order to make the above and other purposes, features, and advantages of the present application more obvious and understandable, the following specifically illustrates the specific implementation manners of the present application. Description of the Drawings

[0018] In order to more clearly illustrate the technical solutions in the present application or the prior art, the following will briefly introduce the drawings required for the implementation examples or the prior art descriptions. Obviously, the drawings described below are only some of the embodiments recorded in the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings. In the drawings: Figure 1Flowchart of a security protection method for screen display dynamic content provided by this application; Figure 2 Schematic diagram of device interaction within a security protection system for screen display dynamic content provided by this application. Detailed implementation manners

[0019] To enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in this application will be clearly and completely described below in conjunction with the accompanying drawings in this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all of the embodiments. Based on the embodiments of this specification, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0020] The method in this application will be described in detail below with reference to the drawings.

[0021] Figure 1 Flowchart of a security protection method for screen display dynamic content provided by this application, as Figure 1 shown, the security protection method for the screen display dynamic content in this application at least includes the following execution steps: Step 101, obtain a preset configuration file, and extract watermark parameters and interception policies from the preset configuration file.

[0022] The execution subject of the execution method in this application is a video encoder. During the encoding process, the video encoder extracts watermark parameters and interception policies from the preset configuration file obtained from the cloud server, and embeds a blind watermark in the video stream to be played according to the watermark parameters when encoding the video to be played.

[0023] In a possible implementation manner, the blind watermark is composed of encrypted pixel points, and the watermark parameters at least include the starting coordinates (x, y) of the blind watermark and the RGB value sequence of the encrypted pixel points. Thus, when generating the blind watermark for the video stream to be played, during the video encoding stage, encrypted pixel points are horizontally embedded according to the starting coordinates (x, y) in the preset configuration file, and the RGB values of the encrypted pixel points are determined according to the aforementioned RGB value sequence.

[0024] Further, to ensure the watermark stability of LED screens of different sizes, when embedding the blind watermark in the video stream to be played, this application preferably supports resolution adaptive adjustment.

[0025] In a possible implementation, the aforementioned preset configuration file preferably adopts a JSON configuration file. When obtaining the JSON configuration file, import the JSON configuration file through management software or an SDK, and set the watermark parameters and interception policies. After importing the JSON configuration file, use the AES algorithm to encrypt the imported JSON configuration file to prevent the configuration file from being maliciously tampered with or reverse-cracked, affecting the security of the video stream to be played, and perform persistent storage on the JSON configuration file after encryption is completed. At the same time, set the policy of automatically loading the file after restart.

[0026] Step 102: Embed a blind watermark into the video stream to be played according to the watermark parameters, and transmit the video stream to be played with the blind watermark embedded.

[0027] In a possible implementation of the present application, before embedding a blind watermark into the video stream to be played according to the watermark parameters, it is necessary to first determine the embedding area of the blind watermark. Specifically: First, use the adaptive grid division algorithm to divide the video stream to be played into 8×8 pixel blocks, and extract the luminance component matrix of each block in the YUV color space; perform an 8×8 discrete cosine transform on the luminance component matrix corresponding to each block; finally, determine the middle frequency band in the frequency domain according to the result of the discrete cosine transform, so as to determine the blind watermark embedding area according to the corresponding position of the middle frequency band in the video stream data to be played.

[0028] The video encoder embeds a blind watermark into the video stream to be played according to the watermark parameters. After completion, transmit the video stream to be played with the blind watermark embedded.

[0029] In an example, the receiving end of this transmission is a video sending device. After the video sending device receives the video stream to be played from the video encoder, extract the blind watermark pixel points frame by frame, and perform real-time comparison on the RGB value sequence corresponding to the extracted blind watermark pixel points to verify the blind watermark. The reference object for comparison is the local configuration information of the video sending device. This configuration information contains the watermark parameters in the aforementioned configuration file and can be obtained by loading the configuration through the SDK integrated in the video sending device. If the comparison results of the two are consistent, it means that the video stream to be played passes the watermark verification, and at this time it can be normally played. However, if the comparison results of the two are inconsistent, it means that the video stream to be played fails the watermark verification, and at this time the interception policy will be triggered. In an example, the configuration information used by the aforementioned video sending device to verify the blind watermark information can also be implemented through a configuration read-back operation, and the configuration read-back can ensure the consistency of the parameter effectiveness.

[0030] Step 103: Trigger the interception policy in response to the verification result of the blind watermark to display a preset solid color screen.

[0031] In a possible implementation of the present application, the interception policy at least includes the RGB values of a preset solid color screen. Therefore, when the video stream to be played fails the blind watermark verification, the interception policy is triggered to immediately interrupt the transmission of the video stream to be played and switch to the preset solid color screen according to the interception policy.

[0032] In a possible implementation of the present application, the video sending device also records the playback situation of the video stream through the playback log and periodically uploads or real-time uploads the playback log, so that the cloud server can understand the playback situation of the video stream and make adjustments to the playback policy or upgrade the playback security, etc.

[0033] Based on the same inventive concept, the present application also provides a security protection system for screen display dynamic content, and its internal interaction process is as Figure 2 shown.

[0034] In a possible implementation of the present application, the system includes: a cloud server, referring to the cloud system in Figure 2 , a decoder, a sending device, referring to the sending box in Figure 2 ; and also includes a receiving device and an LED large screen.

[0035] Among them, referring to Figure 2 , the cloud system can perform encryption configuration, set the rules and related instruction parameters of the encrypted blind watermark, and after the configuration is completed, encrypt and send them to the decoder, so that the decoder obtains the blind watermark related parameters and adds encrypted pixels to the picture or video stream to be played, so that the video stream to be played is successfully embedded with the blind watermark. Then, the video stream to be played is transmitted to the sending box, and the encrypted pixels and instructions are sent down. After receiving, the sending box verifies the blind watermark in the video stream to be played according to the instructions and performs corresponding operations according to the verification results. For example, when the verification fails, the interception policy is triggered to be executed, so that the LED screen displays a preset solid color screen to protect the security of the video stream to be played and prevent the delivery or playback of damaged video streams.

[0036] At the same time, the decoder can regularly query the verification result, and the sending box can also actively return the verification result to the decoder periodically or in real time. Then, the decoder returns the verification result to the cloud system, and the cloud system analyzes the verification result and notifies the user in time when there is an abnormality in the delivery or playback, which is convenient for the user to adjust the playback policy or perform operations such as upgrading the security of the video stream to be played in time.

[0037] In a possible implementation of the present application, each device in the above system can also be configured as a synchronous device or an asynchronous device. Among them, the asynchronous device realizes parameter loading and status callback through the SDK. The so-called parameter loading means that the configuration information can be loaded through the integrated SDK to obtain the blind watermark parameters, and the status callback is to report the verification result and support the status callback, which is also convenient for the cloud system to perform remote alarm and log analysis. The synchronous device can configure the blind watermark parameters and illegal processing policies through the PC-side management software, and supports the read-back of the configuration file to ensure the consistency of parameter effectiveness, which is convenient for subsequent verification of the blind watermark.

[0038] In a possible implementation of the present application, the sending device in the aforementioned system does not enable verification by default when it is first started, that is, it does not perform blind watermark verification after receiving the video stream to be played, but directly transmits and plays it. After the configuration is loaded, the protection mechanism is activated and verification is enabled to ensure the compatibility during the device initialization phase. Taking the outdoor large screen in the transportation hub as an example, after executing the above method or system in the present application, if the video stream to be played is a legal advertisement video: after embedding the blind watermark, it is played normally and the watermark is invisible; but if the content of the video stream to be played is maliciously tampered with: due to the failure of watermark verification, the screen switches to a blue solid color screen. At this time, the cloud system will receive the alarm and locate the abnormal device. A method and system for protecting the security of dynamic content on a screen display proposed in the present application also have the following technical effects: Improved security: The blind watermark has strong concealment, and the anti-removal attack ability is increased by 80%; Optimized operation and maintenance efficiency: Real-time feedback of abnormal status, and the fault response time is shortened to within 5 seconds; Extended compatibility: Support the collaborative work of multiple models of devices on the market.

[0039] In addition, the technical solution in the present application can also be presented in the form of a device, that is, a device for protecting the security of dynamic content on a screen display. The device mainly includes: Blind watermark embedding module: In the video encoding stage, encrypted pixel points are horizontally embedded according to the pixel coordinates (x, y) in the JSON configuration file, and their RGB values are set or encrypted according to preset rules; this module also supports resolution adaptive adjustment to ensure the stability of the watermark on LED screens of different sizes.

[0040] Real-time verification module: Extract blind watermark pixel points frame by frame and compare whether the RGB value sequence is consistent with the configuration information; the verification results here are divided into two categories: legal content: normally transmitted to the receiving card and displayed or played; illegal content: immediately interrupt the transmission, switch the LED screen to a preset solid color screen (such as blue), and record the abnormal play log.

[0041] Multi-device Management Module: Synchronous Device Management: Import JSON configuration through the PC management software, supporting parameter read-back and firmware upgrade; Asynchronous Device Management: Integrate the SDK to achieve configuration loading, and periodically report the playback status (normal / illegal) through the callback interface.

[0042] Security Enhancement Module: The configuration file is stored encrypted with AES to prevent tampering; The blind watermark verification is default closed at the first startup to avoid false interception caused by unloaded configuration.

[0043] It should be noted that the division of modules in this embodiment is illustrative, only a logical function division, and there may be other division methods in actual implementation.

[0044] Through the description of the above embodiments or examples, those skilled in the art can understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0045] In the embodiments or examples provided in this application, it should be understood that the disclosed device, method, and system can be implemented in other ways. For example, the embodiments of the device and system described above are only illustrative. For example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point, the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in electrical, mechanical or other forms.

[0046] In the description of the embodiments or examples provided in this application, it should be understood that if terms such as "upper", "lower", "front", "rear", "left", and "right" are used to indicate the orientation or position relationship, it is based on the orientation or position relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the indicated position or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present disclosure.

[0047] It should be noted that, in the embodiments or examples provided in this application, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, commodity or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, commodity or device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the existence of additional identical elements in the process, method, commodity or device comprising the element.

[0048] The above are only the embodiments or examples of this application and are not used to limit this application. For those skilled in the art, various changes and modifications can be made to this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the protection scope of this application.

Claims

1. A method for protecting the security of dynamic content displayed on a screen, characterized in that: The method comprises: Obtain a preset configuration file, and extract watermark parameters and interception strategies from the preset configuration file; Embedding a blind watermark into the video stream to be played according to the watermark parameters, and transmitting the video stream to be played with the embedded blind watermark; The interception strategy is triggered in response to the verification result of the blind watermark to display a preset solid color screen.

2. A method for protecting the security of dynamic content displayed on a screen according to claim 1, characterized in that: The blind watermark is composed of encrypted pixels, and the watermark parameters include at least the blind watermark starting coordinates and the RGB value sequence of the encrypted pixels; The interception strategy at least includes the RGB value of the preset pure color screen.

3. A method for protecting the security of dynamic content displayed on a screen according to claim 1, characterized in that: When embedding a blind watermark into the playback video stream according to the watermark parameters, the method further comprises: Determining a blind watermark embedding area of ​​the video stream to be played includes: The video stream to be played is divided into 8×8 pixel blocks by using an adaptive grid partitioning algorithm, and a brightness component matrix of each block in a YUV color space is extracted; Perform 8×8 discrete cosine transform on the brightness component matrix corresponding to each block; The intermediate frequency band in the frequency domain is determined according to the result of the discrete cosine change, so as to determine the blind watermark embedding area according to the corresponding position of the intermediate frequency band in the video stream data to be played.

4. A method for protecting the security of dynamic content displayed on a screen according to claim 1, characterized in that: The preset configuration file adopts a JSON configuration file, and obtaining the preset configuration file includes: Import the JSON configuration file through management software or SDK, and set the watermark parameters and interception strategy; The JSON configuration file is persistently stored and set to be automatically loaded after restart.

5. A method for protecting the security of dynamic content displayed on a screen according to claim 4, characterized in that: When storing the JSON configuration file, the method further includes: The JSON configuration file is encrypted using the AES algorithm and stored after encryption.

6. A method for protecting the security of dynamic content displayed on a screen according to claim 1, characterized in that: After transmitting the video stream to be played embedded with the blind watermark, the method further comprises: Extracting blind watermark pixels from the video stream to be played frame by frame; Comparing the RGB value sequence corresponding to the extracted pixel point with preset configuration information, wherein the preset configuration information is obtained from the preset configuration file and / or loaded by configuring the integrated SDK; If the two are consistent, the verification is passed, and the video stream to be played is transmitted and displayed normally.

7. A method for protecting the security of dynamic content displayed on a screen according to claim 6, characterized in that: After comparing the RGB value sequence corresponding to the extracted pixel point with the preset configuration information, the method further includes: Determining that the RGB value sequence is inconsistent with the preset configuration information; Interrupt the transmission of the video stream to be played, switch to a preset solid color screen, and record the playback log; The play log is uploaded in response to a review instruction of the play log, and / or the play log is uploaded periodically.

8. A security protection system for displaying dynamic content, characterized in that: The system includes a cloud server, a decoder and a sending device; The decoder obtains a preset configuration file from the cloud server, and extracts watermark parameters and interception strategies from the preset configuration file; The decoder embeds a blind watermark into the video stream to be played according to the watermark parameters, and transmits the video stream to be played embedded with the blind watermark; The sending device triggers the interception strategy in response to the verification result of the blind watermark to display a preset solid color screen.

9. A security protection system for displaying dynamic content according to claim 8, characterized in that: The sending device does not enable verification by default when it is started for the first time, and directly transmits the video stream to be played to the receiving device.

10. A security protection system for displaying dynamic content according to claim 8, characterized in that: The sending device integrates SDK to implement configuration loading and periodically reports the playback log through the callback interface.

Images