Video watermark adding device, method, equipment and system

Abstract

The embodiment of the invention provides a video watermark adding device, method, equipment and system, the adding device is applied to a secure element chip, and the device comprises a video decryption module which is used for decrypting a received video key ciphertext and decrypting a received video file ciphertext by using a plaintext video key, obtaining a video file plaintext; the video data analysis module is used for performing data analysis on the video file plaintext to obtain a watermark embedding strategy of the video file plaintext; the watermark information generation module is used for processing the watermark content to be embedded based on the watermark embedding strategy to generate watermark information data; and the watermark information writing module is used for writing the watermark information data into the video file plaintext according to the watermark embedding strategy to obtain the video file plaintext embedded with the watermark so as to be played by the playing terminal. According to the embodiment of the invention, the intellectual property of the video product in the played video can be effectively protected.

Description

Technical Field

[0001] This disclosure relates to video processing technology, and more particularly to a device, method, apparatus, and system for adding video watermarks. Background Technology

[0002] To protect the intellectual property rights of video products, cinemas typically use watermarks and supervisory staff to reduce piracy during screenings. However, online video streaming often takes place on personal devices in unregulated environments, making these devices more susceptible to experimentation and allowing circumvention of protection mechanisms.

[0003] Therefore, how to protect the intellectual property rights of video products played in videos has become an urgent technical problem to be solved. Summary of the Invention

[0004] In view of this, the present disclosure provides a video watermarking apparatus, method, device, and system that can effectively protect the intellectual property rights of video products in playing videos.

[0005] According to a first aspect of the present disclosure, a video watermarking device is provided, applied to a secure element chip. The device includes: a video decryption module, used to decrypt received ciphertext of a video key and to decrypt received ciphertext of a video file using the plaintext video key to obtain plaintext video file; a video data analysis module, used to perform data analysis on the plaintext video file to obtain a watermark embedding strategy for the plaintext video file; a watermark information generation module, used to process the watermark content to be embedded based on the watermark embedding strategy to generate watermark information data; and a watermark information writing module, used to write the watermark information data into the plaintext video file according to the watermark embedding strategy to obtain a plaintext video file with an embedded watermark for playback by a playback terminal.

[0006] According to a second aspect of the present disclosure, a method for adding a video watermark is provided, applied to a secure element. The method includes: decrypting received ciphertext of a video key, and using the video key in plaintext to decrypt received ciphertext of a video file to obtain plaintext of the video file; performing data analysis on the plaintext of the video file to obtain a watermark embedding strategy for the plaintext of the video file; processing the watermark content to be embedded based on the watermark embedding strategy to generate watermark information data; and writing the watermark information data into the plaintext of the video file according to the watermark embedding strategy to obtain a plaintext video file with an embedded watermark for playback by a playback terminal.

[0007] According to a third aspect of the present disclosure, an electronic device is provided, including: a video watermarking device according to the first aspect.

[0008] According to a fourth aspect of the present disclosure, a system is provided, the system including a video service system and an electronic device of the third aspect.

[0009] This embodiment employs a secure element to decrypt the received ciphertext of the video key, and then uses the plaintext video key to decrypt the received ciphertext of the video file, obtaining the plaintext video file. Data analysis is performed on the plaintext video file to obtain a watermark embedding strategy. Based on this strategy, the content to be embedded with the watermark is processed to generate watermark information data. The watermark information data is then written into the plaintext video file according to the watermark embedding strategy, resulting in a watermarked plaintext video file for playback on a playback terminal. This embodiment uses a secure element to implement the watermark embedding operation, leveraging the high security of the secure element to ensure that the plaintext video file without the watermark remains within the secure element, preventing leakage of the plaintext video file. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings.

[0011] Figure 1 This is a schematic diagram of a typical video watermarking device.

[0012] Figure 2 This is a schematic diagram of a video watermarking device and its application scenario in one embodiment of the present disclosure;

[0013] Figure 3 This is a schematic diagram of a video watermarking device and its application scenario in another embodiment of this disclosure;

[0014] Figure 4 This is a schematic diagram of a video watermarking device and its application scenario in another embodiment of the present disclosure;

[0015] Figure 5 This is a schematic diagram of a video watermarking device and its application scenario in another embodiment of the present disclosure;

[0016] Figure 6 This is a flowchart of a video watermarking method in one embodiment of the present disclosure;

[0017] Figure 7 This is a schematic diagram of a playback terminal in one embodiment of the present disclosure;

[0018] Figure 8 This is a schematic diagram of a connection device in one embodiment of the present disclosure. Detailed Implementation

[0019] The technical solutions in the embodiments of this disclosure will now be described with reference to the accompanying drawings. For ease of explanation, in the embodiments of this disclosure, the same reference numerals denote the same components, and for the sake of brevity, detailed descriptions of the same components are omitted in different embodiments.

[0020] It should be noted that, without conflict, the various embodiments and / or technical features described in this disclosure can be arbitrarily combined with each other, and the resulting technical solutions should also fall within the protection scope of this disclosure.

[0021] It should be understood that the specific examples in the embodiments of this disclosure are only intended to help those skilled in the art to better understand the embodiments of this disclosure, and are not intended to limit the scope of the embodiments of this disclosure.

[0022] It should also be understood that, in the various embodiments of this disclosure, the sequence number of each process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this disclosure.

[0023] It should also be understood that the terminology used in this disclosure and the appended claims is for the purpose of describing particular embodiments only and is not intended to limit the embodiments of this disclosure. For example, the singular forms “a,” “the,” and “the” used in this disclosure and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0024] As used herein, terms such as “first,” “second,” and “third” describe various components, parts, areas, layers, and / or sections, but such components, parts, areas, layers, and / or sections should not be limited by such terms. These terms are used only to distinguish one component, part, area, layer, or section from another. For example, the use of terms such as “first,” “second,” and “third” herein does not imply sequence or order unless explicitly indicated by the context.

[0025] To protect the intellectual property rights of video creators, cinemas have adopted watermarking technology and management patrols to reduce piracy. However, videos played online are often streamed through personal devices in unregulated environments, making these devices more susceptible to experimentation and allowing circumvention of protection mechanisms.

[0026] Specifically, when playing videos online, the video service system divides the video into many data packets and sends them to the playback terminal as a data stream. The player on the playback terminal receives and plays the data packets simultaneously. If the playback terminal needs to add a watermark while playing the video without affecting the smoothness of playback, it requires high computing power and often needs to be done on an application processor (AP). However, application processors are not secure environments. Even using a trusted execution environment (TEE) on the application processor cannot resist physical attacks such as side-channel attacks and error injection. Furthermore, trusted execution environments have known security vulnerabilities and cannot guarantee the confidentiality of the video.

[0027] Specifically, see Figure 1 When watermarking is implemented using the trusted execution environment of the application processor, the playback terminal 11 communicates with the video service system 12. The playback terminal 11 includes a video retrieval module 111, a video playback module 112, a decoder 113, a watermarking module 114, and a display module 115. The video service system 12 stores the original video file and sends it to the video retrieval module 111 of the playback terminal 11. The video retrieval module 111 sends the obtained original video file to the video playback module 112. If decryption is required, the video playback module 112 decrypts the obtained original video file to obtain the plaintext video file, sends the plaintext video file to the decoder 113 for decoding, and sends the decoded video file to the watermarking module 114 for watermarking. The watermarked video file is then played through the display module 115. Because the trusted execution environment of the application processor cannot resist physical attacks such as side-channel attacks and error injection, its security is insufficient. This results in the plaintext video file being leaked before the watermarking module 114 adds the watermark, making it impossible to effectively protect the intellectual property rights of video products.

[0028] To enhance the confidentiality of video playback, some solutions employ dedicated hardware to add watermarks during video playback. However, due to the high cost of such hardware, and the fact that this is typically done in specific locations such as cinemas, these solutions are often limited to this purpose.

[0029] To at least partially address the aforementioned problems, this disclosure provides a video watermarking device 21 applied to a secure element chip. The video watermarking device 21 receives a video key ciphertext and a video file ciphertext, and generates a plaintext video file with an embedded watermark. The video watermarking device 21 uses a secure element to implement the watermark embedding operation, leveraging the high security of the secure element to ensure that the plaintext video file without the watermark remains solely within the secure element, preventing leakage of the plaintext video file.

[0030] The Secure Element (SE) is typically provided in chip form. To prevent external malicious parsing attacks and protect data security, it contains encryption / decryption logic circuitry.

[0031] The safety element can be a chip in the playback terminal 11, that is, a component soldered onto the circuit board of the playback terminal 11. The safety element connects to other modules in the playback terminal 11 via a circuit board-level interface such as SPI. The safety element can also be a chip in other electronic devices, which can be external connection devices with communication interfaces (e.g., USB keys). The safety element connects to other modules in the playback terminal 11 via the communication interface.

[0032] Specifically, the playback terminal 11 can be any terminal capable of video playback, such as a mobile phone, tablet computer, TV box, or television set. The playback terminal 11 can be a playback device that supports screen mirroring. The playback terminal 11 communicates with the video service system 12 to obtain the encrypted video key and video file provided by the video service system 12. It then instructs the secure element in the playback terminal 11 to process the encrypted video key and video file, or sends the encrypted video key and video file to the secure element in other electronic devices for processing.

[0033] See Figure 2 The playback terminal 11 includes: a video retrieval module 111, a video playback module 112, a decoder 113, and a display module 115.

[0034] In this embodiment, the video retrieval module 111 sends the encrypted video key and the encrypted video file to the video watermarking device 21. The video playback module 112 receives the plaintext video file with the embedded watermark generated by the video watermarking device 21. The video playback module 112 sends the plaintext video file to the decoder 113 for decoding, and the decoded watermarked video file is played through the display module 115.

[0035] See Figure 2 The video watermarking device 21 includes:

[0036] The video decryption module 211 is used to decrypt the received video key ciphertext and use the plaintext video key to decrypt the received video file ciphertext to obtain the plaintext video file.

[0037] The video data analysis module 212 is used to perform data analysis on the plaintext of the video file to obtain the watermark embedding strategy of the plaintext of the video file.

[0038] The watermark information generation module 213 is used to process the watermark content to be embedded based on the watermark embedding strategy and generate watermark information data.

[0039] The watermark information writing module 214 is used to write the watermark information data into the plaintext of the video file according to the watermark embedding strategy, so as to obtain the plaintext of the video file with embedded watermark for playback terminal to play.

[0040] This embodiment of the disclosure uses a secure element to receive the ciphertext of the video key and the ciphertext of the video file, and generates plaintext video file with an embedded watermark. The plaintext video file is stored in the secure element before the watermark is added. Therefore, this embodiment of the disclosure uses a secure element to implement the watermark embedding operation, utilizing the high security of the secure element to prevent the leakage of the plaintext video file.

[0041] In some specific implementations of the embodiments of this disclosure, the video file encrypted by the video decryption module 211 is a video file encrypted after watermark preprocessing.

[0042] Specifically, see Figure 2 The video service system 12 includes: a watermark preprocessing component 121, a key management component 122, and a video encryption component 123.

[0043] The watermark preprocessing component 121 is used to preprocess the obtained video original file with watermarks and send the watermark preprocessed video original file to the video encryption component 123.

[0044] The key management component 122 is used to generate video encryption keys and encrypt the generated encryption keys.

[0045] Specifically, the key management component 122 generates a unique video encryption key for each video file. Therefore, using a unique video encryption key for each video improves the confidentiality of the video files, ensuring that even if the video encryption key of one video file is leaked, the confidentiality of other video files remains unaffected.

[0046] The video encryption component 123 is used to encrypt the watermark preprocessed video data sent by the watermark preprocessing component 121 using the video encryption key generated by the key management component 122, and also to encrypt the video encryption key to obtain the ciphertext of the video file and the ciphertext of the video key.

[0047] Specifically, the video encryption component 123 uses either a symmetric or asymmetric encryption algorithm for encryption. The encryption algorithm can be, for example, AES, TDES, SM4, RSA, ECC, SM2, SM9, etc. Because symmetric encryption algorithms are fast and efficient, they are more suitable for files with large amounts of data; therefore, this embodiment selects a symmetric encryption algorithm for encryption.

[0048] The encrypted video file and the encrypted video key are stored on the video service system 12 for users to access on the playback terminal 11.

[0049] The video retrieval module 111 on the playback terminal 11 requests the video file from the video service system 12. After verifying the user identity of the playback terminal 11, the video service system 12 sends the encrypted video file and the corresponding encrypted video key to the playback terminal 11.

[0050] The video retrieval module 111 in the playback terminal 11 sends the watermark-preprocessed video file ciphertext and video key ciphertext to the video decryption module 211 of the video watermarking device 21.

[0051] See some possible specific implementations. Figure 3 There is also a watermark preprocessing device 13, which is connected to the watermark preprocessing component 121 on the video service system 12 to assist the watermark preprocessing component 121 in completing watermark preprocessing.

[0052] Specifically, in this embodiment of the present disclosure, a watermark preprocessing device 13 can be used to supplement the watermark preprocessing computing power of the watermark preprocessing component 121. The watermark preprocessing device 13 can be a separate server or a cloud server.

[0053] See some possible specific implementations. Figure 4 There is also a video resource server 14. The video resource server 14 receives encrypted video files from the video service system 12 and displays these encrypted video files to the playback terminal 11 for playback as needed.

[0054] Specifically, the video resource server 14 in this embodiment can be a standalone server or a cloud server for distributing encrypted video files. Those skilled in the art can configure it as needed.

[0055] This embodiment utilizes the watermark preprocessing component 121 in the video service system 12 to perform watermark preprocessing, thereby saving the computing power of the security element and reducing the computing power requirements of the security element.

[0056] In other specific implementations of the embodiments disclosed herein, see [link to relevant documentation]. Figure 5 The video watermarking device 21 also includes:

[0057] The watermark preprocessing module 215 is used to preprocess the plaintext of the decrypted video file with watermarks and send the preprocessed plaintext video file to the video data analysis module.

[0058] In this embodiment of the disclosure, when the computing power of the secure element is sufficient, the watermark preprocessing module 215 in the secure element performs the watermark preprocessing, and the video service system no longer needs to perform watermark preprocessing. Thus, the entire process of adding watermarks, including watermark preprocessing, is carried out in the secure element, further reducing the risk of plaintext video files being leaked.

[0059] Specifically, the watermark preprocessing includes:

[0060] Analyze video data and structural features to perform calculations and processing for watermarking; and,

[0061] The watermarking attack methods are evaluated, and the processing parameters below the evaluation threshold are adjusted. The evaluation threshold is used to represent the difficulty of watermarking attacks.

[0062] The evaluation of watermark attack methods specifically includes pre-evaluating various watermark attack methods such as changing resolution, bitrate, frame rate, brightness, and color. Processing parameters that are deemed vulnerable in the evaluation are replaced and optimized. Then, the watermark attack methods are reprocessed and evaluated, and finally, a plaintext video file with watermark preprocessing that can resist multiple attacks is obtained.

[0063] In some specific implementations of the embodiments of this disclosure, the encrypted video file received by the video decryption module 211 is a encrypted video file received in a packet-stream manner. That is, the encrypted video file is divided into multiple data packets, which are sent to the video decryption module 211 in the form of a data stream. Since the encrypted video file received by the video retrieval module 111 from the video encryption component 123 of the video service system 12 is a packet-stream encrypted video file, the embodiments of this disclosure do not require changes to the way the video service system 12 and the video retrieval module 111 send the encrypted video file, and are applicable to the protection of video intellectual property rights in online video playback scenarios.

[0064] In some specific implementations of the embodiments disclosed herein, the watermark content includes:

[0065] User identity identifier, device identity identifier, video playback timestamp, IP address, system version, or at least one of the above; or, a hash value of at least one of the above information.

[0066] The watermark content of this disclosure is presented in a variety of ways, making it easy to select watermark content according to the watermark embedding strategy.

[0067] Corresponding to the above-mentioned device, this disclosure also provides a method for adding video watermarks, which is applied to security components.

[0068] See Figure 6 The methods include:

[0069] Step S1: Decrypt the received video key ciphertext, and use the plaintext video key to decrypt the received video file ciphertext to obtain the plaintext video file.

[0070] Step S2: Perform data analysis on the plaintext of the video file to obtain the watermark embedding strategy for the plaintext of the video file.

[0071] Step S3: Process the watermark content to be embedded based on the watermark embedding strategy to generate watermark information data.

[0072] Step S4: Write the watermark information data into the plaintext of the video file according to the watermark embedding strategy to obtain the plaintext of the video file with the embedded watermark for playback terminal to play.

[0073] In some specific implementations of the embodiments of this disclosure, step S1 is preceded by:

[0074] The original video file that has undergone watermark preprocessing is encrypted to obtain the ciphertext of the video file.

[0075] This embodiment of the disclosure performs watermark preprocessing on the security element, and then encrypts the watermarked video file using a video key. This embodiment of the disclosure saves the computing power of the security element and reduces the computing power requirements of the security element.

[0076] In some specific implementations of the embodiments of this disclosure, step S1 is followed by:

[0077] The plaintext of the decrypted video file is pre-processed with a watermark to obtain the pre-watermarked plaintext of the video file.

[0078] In this embodiment of the disclosure, when the computing power of the secure element is sufficient, the preprocessing of the watermark is performed by the secure element, and the video service system no longer needs to perform watermark preprocessing. Thus, the entire process of adding watermarks, including watermark preprocessing, is carried out in the secure element, further reducing the risk of plaintext video files being leaked.

[0079] The watermark preprocessing includes:

[0080] Analyze video data and structural features to perform calculations and processing for watermark addition;

[0081] The watermark attack methods are evaluated, and the processing parameters below the evaluation threshold are adjusted. The evaluation threshold is used to represent the difficulty of watermark attacks.

[0082] Based on the apparatus described above, embodiments of this disclosure also provide an electronic device including any of the above-described means of adding video watermarks.

[0083] like Figure 7As shown, the electronic device can be a playback terminal. In addition to the video watermarking device 21 described above, the playback terminal 11 also includes:

[0084] The video retrieval module 111 is used to receive the video key ciphertext and video file ciphertext sent by the video service system, and send the received video key ciphertext and video file ciphertext to the video decryption module.

[0085] The video playback module 112 is used to receive the plaintext of the video file with embedded watermark sent by the watermark information writing module.

[0086] The video decoding module 113 is used to decode the plaintext of the video file with embedded watermark received by the video playback module.

[0087] Display module 115 is used to receive the decoded plaintext video file with embedded watermark and play it.

[0088] like Figure 8 As shown, the electronic device can be a connection device 13, which is connected to the playback terminal 11 via a communication interface 131.

[0089] Specifically, the communication interface can be SPI, I2C, USB, or other communication interfaces.

[0090] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the devices and modules described above can be referred to the corresponding process descriptions in the foregoing method embodiments, and will not be repeated here.

[0091] Based on the methods described in the above embodiments, this disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the methods described in the above embodiments.

[0092] Based on the methods described in the above embodiments, this disclosure provides a computer program product that, when executed by a processor, implements the methods described in the above embodiments.

[0093] It should be noted that, depending on the implementation needs, the various components / steps described in the embodiments of this disclosure can be broken down into more components / steps, or two or more components / steps or parts of the operation of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of this disclosure.

[0094] The methods described above according to embodiments of this disclosure can be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium (such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code originally stored on a remote recording medium or a non-transitory machine-readable medium and subsequently stored on a local recording medium, downloaded over a network. Thus, the methods described herein can be stored as software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA). It is understood that the computer, processor, microprocessor controller, or programmable hardware includes storage components (e.g., RAM, ROM, flash memory, etc.) capable of storing or receiving software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the navigation methods described herein. Furthermore, when a general-purpose computer accesses code used to implement the navigation methods shown herein, the execution of the code transforms the general-purpose computer into a dedicated computer for executing the navigation methods shown herein.

[0095] Those skilled in the art will recognize that the units and method steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments disclosed herein.

[0096] This disclosure describes embodiments, but is not intended to limit them. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of this disclosure. Therefore, all equivalent technical solutions also fall within the scope of this disclosure. The patent protection scope of this disclosure should be defined by the claims.

Claims

1. A video watermarking device, applied to a secure element chip, the device comprising: The video decryption module is used to decrypt the received video key ciphertext and use the video key in plaintext to decrypt the received video file ciphertext to obtain the video file plaintext. The video data analysis module is used to perform data analysis on the plaintext of the video file to obtain the watermark embedding strategy of the plaintext of the video file. The watermark information generation module is used to process the watermark content to be embedded based on the watermark embedding strategy and generate watermark information data. The watermark information writing module is used to write the watermark information data into the plaintext of the video file according to the watermark embedding strategy, so as to obtain the plaintext of the video file with embedded watermark for playback terminal to play.

2. The apparatus according to claim 1, wherein, The video decryption module receives encrypted video files that have undergone watermark preprocessing.

3. The apparatus according to claim 1, wherein, The device further includes: The watermark preprocessing module is used to preprocess the plaintext of the decrypted video file with watermarks, and then send the preprocessed plaintext of the video file to the video data analysis module.

4. The apparatus according to claim 2 or 3, wherein, The watermark preprocessing includes: Analyze video data and structural features to perform calculations and processing for watermark addition; The watermark attack methods are evaluated, and the processing parameters below the evaluation threshold are adjusted. The evaluation threshold is used to represent the difficulty of watermark attacks.

5. The apparatus according to claim 1, wherein, The encrypted video file received by the video decryption module is the encrypted video file received using packet streaming.

6. The apparatus according to claim 1, wherein, The watermark content includes: User identity identifier, device identity identifier, video playback timestamp, IP address, system version, or at least one of the above; or, a hash value of at least one of the above information.

7. The apparatus according to claim 1, wherein, The video key is a unique key corresponding to the video file.

8. The apparatus according to claim 7, wherein, The encryption algorithm is a symmetric encryption algorithm.

9. A method for adding a video watermark, applied to a secure element, the method comprising: The received video key ciphertext is decrypted, and the received video file ciphertext is decrypted using the video key in the plaintext to obtain the video file plaintext; Data analysis is performed on the plaintext of the video file to obtain the watermark embedding strategy for the plaintext of the video file. Based on the watermark embedding strategy, the watermark content to be embedded is processed to generate watermark information data; The watermark information data is written into the plaintext of the video file according to the watermark embedding strategy to obtain the plaintext video file with embedded watermark for playback terminal.

10. An electronic device, comprising: The video watermarking device according to any one of claims 1-8.

11. The electronic device according to claim 10, wherein, The electronic device is a playback terminal, and the playback terminal further includes: The video retrieval module is used to receive the video key ciphertext and video file ciphertext sent by the video service system, and send the received video key ciphertext and video file ciphertext to the video decryption module; The video playback module is used to receive the plaintext of the video file with the embedded watermark sent by the watermark information writing module; The video decoding module is used to decode the plaintext of the video file with embedded watermark received by the video playback module; The display module is used to receive the decoded plaintext of the video file with the embedded watermark and play it.

12. The electronic device according to claim 11, wherein, The electronic device is a connection device, which is connected to the playback terminal through a communication interface.

13. A system comprising a video service system and an electronic device as claimed in any one of claims 10 to 12.

Images