Hybrid video double-watermark method and system

Abstract

The invention provides a hybrid video double-watermark method and system, and the method comprises the steps: extracting a chrominance channel of each video frame, calculating the polar harmonic Fourier moment of the chrominance channel frame by frame, combining a calculation result with copyright information, obtaining a robust watermark video frame, dividing a robust watermark video into color channels, and carrying out the recognition of the color channels. And using an enhanced least significant bit method for each color channel in combination with the anti-counterfeiting information to obtain a mixed double-watermark video. According to the method, valuable video contents can be effectively protected, a forged area in the video can be accurately detected, and the strong resistance to various attacks such as rotation, zooming, noise and compression is shown. In addition, the watermark can be extracted without auxiliary information, the polar harmonic Fourier moment of the chroma channel of the transmitted video is calculated frame by frame to extract the robust watermark, the fragile watermark is extracted from each color channel of the video frame through the extraction function, and the subsequent copyright authentication and anti-counterfeiting authentication operation can be completed.

Description

Technical Field

[0001] The present invention relates to the technical field of video processing, and in particular to a hybrid video double watermark method and system. Background Art

[0002] With the advent of the digital age, the topic of multimedia security has attracted widespread attention, especially the security of video content. As an important part of multimedia, video has become an indispensable part of people's daily life not only because of its vividness, fun and ability to quickly and easily obtain information, but also because of its core role in information dissemination and cultural expression, making it a key focus in the field of multimedia security. In recent years, the rise of video sharing platforms has not only brought about the widespread dissemination of video content, but also brought new challenges, such as illegal copying and tampering of video content.

[0003] In this context, digital watermarking technology has emerged as one of the effective means to solve the problem of video content security. By embedding secret information into digitized multimedia data, digital watermarking technology can not only be used to verify the copyright information of the video, but also effectively detect when the video has been tampered with. However, most of the existing video watermarking technologies treat the copyright protection of video content and the detection and location of video forgery as two independent tasks. This functional division makes the traditional video watermarking scheme have the limitation of single function when dealing with complex security challenges. Therefore, it is urgent to develop a video watermarking technology that can resist various attacks to effectively protect the copyright of the video, accurately locate the tampered area, and realize video anti-counterfeiting positioning. Summary of the invention

[0004] In view of the above situation, the main purpose of the present invention is to propose a hybrid video double watermark method, system, device and storage medium to solve the above technical problems.

[0005] The present invention provides a hybrid video double watermark method, the method comprising the following steps: Step 1, convert the given video into several video frames, and extract the chrominance channel of each video frame; Step 2: Calculate the fractional harmonic Fourier moment of the chrominance channel of each video frame and normalize it, then combine the normalized result with the copyright information to perform inverse normalization and reconstruct the video frame in sequence to obtain a robust watermarked video frame; Step 3, extract each color channel of the robust watermark video frame, use the enhanced least significant bit method to combine the anti-counterfeiting information for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid dual-watermark video; Step 4: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication; Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

[0006] The present invention also proposes a hybrid video dual watermark system, the system comprising: Video frame separation module, used for: Convert a given video into several video frames and extract the chrominance channel of each video frame; Robust watermark embedding module for: The fractional-order harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized, and then the normalized result is combined with the copyright information to perform inverse normalization and reconstruct the video frame operation in sequence to obtain a robust watermarked video frame; Fragile watermark embedding module for: Extract each color channel of the robust watermark video frame, combine the anti-counterfeiting information using the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid double-watermark video; Robust watermark authentication module, used for: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication; Fragile watermark authentication module, used for: Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

[0007] The present invention also provides a terminal device, comprising a memory and a processor, wherein the processor implements the above-mentioned hybrid video double watermark method when executing a computer program stored in the memory.

[0008] The present invention also provides a computer-readable storage medium for storing a computer program, and the computer program implements the above-mentioned hybrid video double watermark method when executed by a processor.

[0009] Compared with the prior art, the present invention has the following beneficial effects: 1. The present invention converts a given video into several video frames, extracts the chrominance channel of each frame, calculates the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame and normalizes it, combines it with copyright information, inversely normalizes it, reconstructs the video frame, and obtains a robust watermarked video frame, which not only ensures good visual quality but also has high robustness.

[0010] 2. Extract each color channel of the robust watermark video, use the enhanced least significant bit method frame by frame, combine with anti-counterfeiting information, and reconstruct the video frame to obtain a hybrid double-watermark video. This achieves the dual requirements of video copyright protection and anti-counterfeiting positioning, and effectively resists geometric distortion and traditional attacks while accurately locating the forged area.

[0011] 3. After the video is transmitted, the watermark is extracted from the received video. The extreme harmonic Fourier moment of the chromaticity channel is calculated for each video frame after the denoiser to obtain a robust watermark for copyright authentication. The extraction function is used for each color channel of the video frame to obtain a fragile watermark for anti-counterfeiting authentication. The robust watermark has strong robustness, so the watermark can still be extracted after the video is attacked, ensuring the confidentiality of video data transmission. The fragile watermark has strong fragility, so after the video is forged, the tampered area of ​​the video can be accurately identified, ensuring the integrity of video data transmission.

[0012] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description or learned through embodiments of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 A flow chart of the hybrid video double watermarking method proposed by the present invention; Figure 2 Generate a fragile watermark authentication graph for the video double-watermarking of the present invention; Figure 3 The overall framework diagram of the hybrid video dual watermarking method system proposed by the present invention; Figure 4 A schematic diagram of the structure of the terminal device proposed by the present invention; In the figure, 2. terminal device, 20. processor, 21. memory, 22. computer program. DETAILED DESCRIPTION

[0014] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0015] These and other aspects of the embodiments of the present invention will be apparent with reference to the following description and accompanying drawings. In these descriptions and accompanying drawings, some specific implementations of the embodiments of the present invention are specifically disclosed to represent some ways of implementing the principles of the embodiments of the present invention, but it should be understood that the scope of the embodiments of the present invention is not limited thereto.

[0016] See also Figure 1The embodiment of the present invention provides a hybrid video double watermark method, the method comprising the following steps: Step 1, convert the given video into several video frames, and extract the chrominance channel of each video frame; Convert the video into several video frames. In this embodiment, the video uses the YUV420 format; In this embodiment, a frame rate of 25 is used to convert the video into 300 video frames. The chrominance channel of each video frame is extracted to prepare for robust watermark embedding; Step 2: Calculate the fractional harmonic Fourier moment of the chrominance channel of each video frame and normalize it, then combine the normalized result with the copyright information to perform inverse normalization and reconstruct the video frame in sequence to obtain a robust watermarked video frame; In the above scheme, the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame is calculated to ensure better visual quality. The fractional-order extreme harmonic Fourier moment has good rotation, scale and translation invariance, and has good robustness to geometric attacks such as rotation and scaling. It has higher moment calculation accuracy, which helps to build a more robust watermark. The normalization operation can adjust the size of the geometric moment to achieve scale invariance. Therefore, the fractional-order extreme harmonic Fourier moment of the chrominance channel of the video frame is calculated and normalized; combined with copyright information, inverse normalization, and the video frame is reconstructed to obtain a robust watermark video frame; The process of calculating the fractional harmonic Fourier moment of the chrominance channel of each video frame has the following relationship: ; in, represents the complex conjugate operation, A video frame function representing the original chroma channels, represents the extreme harmonic Fourier moment of the video frame, represents the basis function, represents pi, A non-negative integer representing the order of the fractional polar harmonic Fourier moment, An integer representing the number of repetitions of the fractional harmonic Fourier moment, represents the polar coordinate extremal radius, represents the extreme angle of polar coordinates, Indicates the function to which it belongs and The product of the differential elements of The basis functions have the following relationship: ; in, represents the radial basis function, represents the exponential function, represents an imaginary number, represents the fractional order parameter; The radial basis function has the following relationship: ; in, represents the sine function, Represents the cosine function.

[0017] The process of normalizing the fractional-order polar harmonic Fourier moment has the following relationship: ; in, represents the set of fractional-order extreme harmonic Fourier moments selected to be embedded in the watermark, represents the number of fractional polar harmonic Fourier moments in the set, Indicates i Moments, represents the set of normalized fractional-order polar harmonic Fourier moments, represents the proportionality coefficient, The order is p The number of repetitions is q No. i Moments; The process of combining copyright information and performing inverse normalization has the following relationship: ; in, Representation Quantizer represents the amplitude value set of the fractional-order extreme harmonic Fourier moment after the copyright information is embedded, represents the embedding strength, Indicates the jitter modulation distance where the copyright information is embedded. Indicates the specific embedded copyright information. Indicates the current state of the embedded copyright information; when When ;when When ; The quantizer has the following relationship: ; in, represents the set of amplitude values ​​of the normalized fractional-order polar harmonic Fourier moment, represents the floor function; The inverse normalization has the following relationship: ; in, represents the set of inverse normalized fractional polar harmonic Fourier moments; The following relationship exists in conjunction with the process of reconstructing the video frame: ; in, represents the original video frame, represents the reconstructed video frame combined with copyright information, The order is p The number of repetitions is q No. i The basis functions corresponding to the moments are express The complex conjugate of express The complex conjugate of express The complex conjugate of .

[0018] Step 3, extract each color channel of the robust watermark video frame, use the enhanced least significant bit method to combine the anti-counterfeiting information for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid dual-watermark video; The specific steps of the above scheme are as follows: Robust watermarking of video frames Separate each color channel to obtain each color channel video frame of the video frame, and each color channel video frame of the video frame includes a red channel of the video frame , video frame green channel , video frame blue channel ,in, represents the red channel, represents the green channel, represents the blue channel, represents a robust watermark; Given a security information bit stream, i.e., a fragile watermark; For each color channel, the security information bit stream Convert to A sequence of numbers in binary , a sequence of numbers Each number in is considered as a hidden number s; A first number is extracted from the pixel unit of each color channel using an extraction function. The corresponding process has the following relationship: ; in, Represents pixel unit No. l The pixel value of pixels, Indicates the number of pixels contained in the pixel unit, represents the remainder function, Indicates the first number; Generate a temporary value based on the first number and the hidden numbert , used to adjust the pixel unit U To hide the numbers s , the corresponding process has the following relationship: ; in, t Represents a temporary value, Indicates 3 L Power system, Represents an intermediate value, and the following relationship exists: ; In order to make the temporary value t With pixel unit U Each pixel value in Match the temporary value t Convert to Base Sequence ,in, , Representation sequence A number in According to the ternary modulation characteristics, Base Sequence Generate the binary sequence to be embedded , there is the following relationship: ; in, Represents the binary sequence to be embedded, Indicates the binary sequence to be embedded A number in Pixel unit U Each pixel is combined with the binary sequence to be embedded Generate pixel units embedded with anti-counterfeiting information , and obtain the color channels embedded with anti-counterfeiting information, wherein the color channels embedded with anti-counterfeiting information include the red channel of the video frame embedded with anti-counterfeiting information , the green channel of the video frame with the anti-counterfeiting information embedded and the blue channel of the video frame with the anti-counterfeiting information embedded ;in, , Represents pixel unit The l The pixel value of a pixel, pixel unit The l The calculation process of the pixel value of a pixel has the following relationship: ; in, The position of the number to be embedded in the binary sequence has the following relationship: ; The color channels embedded with anti-counterfeiting information are combined to obtain a mixed double-watermarked video frame.

[0019] Step 4: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication; Extract each color channel of each received video frame to obtain a fragile watermark for anti-counterfeiting authentication; After completing the hybrid video double watermark, in order to facilitate the subsequent video transmission and watermark authentication, this embodiment also discloses a specific process for subsequent watermark authentication, and the specific steps are as follows: The extreme value method is used to calculate the weights of all pixels occupied by noise points. R ,Will R = 0.005 as the boundary point of whether the video frame is affected by noise to prevent judgment errors caused by other errors; if R <0.005, it is determined that there is no noise attack and no denoising operation is performed; if R >0.005, the next step is to determine the noise type; Calculate the variance of the received video frame V and the variance of the received video frame after median filtering ,by As the boundary point, it distinguishes whether the video frame is subjected to salt and pepper noise or Gaussian noise. , it is determined to be Gaussian noise; otherwise, it is determined to be salt and pepper noise; The two types of noise are processed separately according to the determination of the noise type. If the received video frame is subjected to salt and pepper noise, the received video frame is directly subjected to median filtering to obtain a denoised video frame after removing the salt and pepper noise. If the received video frame is subjected to Gaussian noise, the window size of the median filter is set to be arrive , the received video frame is subjected to an adaptive median filtering operation to obtain a denoised video frame after removing Gaussian noise; Extract all chrominance channels of the denoised video frame and calculate the fractional-order extreme harmonic Fourier moment of the same order and repetition number as in the embedding stage to obtain the fractional-order extreme harmonic Fourier moment of the watermark to be embedded Then the inverse quantization operation is performed to obtain the amplitude value of the fractional-order harmonic Fourier moment after the copyright information is embedded , to extract copyright information, compare the extracted copyright information with the original copyright information, and perform copyright authentication; Separate the received video into each color channel frame by frame, and use an extraction function to extract a hidden number for each pixel unit in each color channel. After extracting all the hidden numbers, obtain the hidden sequence, and perform binary conversion on the hidden sequence to extract the watermark bit stream of each color channel. Compare the extracted watermark bit stream of each color channel with the original fragile watermark, i.e., the anti-counterfeiting information bit stream. If any watermark bit in the extracted watermark bit stream is different from the original watermark bit, the corresponding pixel unit is considered to be modified, and the pixel unit is marked with white, and the unmodified pixel unit is marked with dark color for anti-counterfeiting authentication.

[0020] In the above scheme, after the present invention generates the video double watermark, its fragile watermark authentication process can be Figure 2 Reflect, among which, Figure 2 (a) to Figure 2 (d) in the figure represents video frames of different color videos.

[0021] It should be noted that in the above-mentioned embodiment Figure 2 They are all color video frames. Due to the characteristics of video, they contain more video information during the double watermark operation and authentication operation.

[0022] See also Figure 3 This embodiment also discloses a hybrid video dual watermark system, the system comprising: Video frame separation module, used for: Convert a given video into several video frames and extract the chrominance channel of each video frame; Robust watermark embedding module for: The fractional-order harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized, and then the normalized result is combined with the copyright information to perform inverse normalization and reconstruct the video frame operation in sequence to obtain a robust watermarked video frame; Fragile watermark embedding module for: Extract each color channel of the robust watermark video frame, combine the anti-counterfeiting information with the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid double-watermark video; Robust watermark authentication module, used for: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication; Fragile watermark authentication module, used for: Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

[0023] See also Figure 4 This embodiment also discloses a terminal device. The terminal device 2 includes a memory 21 and a processor 20. When the processor 20 executes a computer program 22 stored in the memory 21, the above-mentioned hybrid video double watermark method is implemented.

[0024] In addition, the computer program 22 may be divided into one or more modules, which are stored in the memory 21 and executed by the processor 20 to complete the hybrid video double watermark method of the present invention. One or more modules may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 22 in the terminal device 2. The terminal device may include, but is not limited to, a processor 20 and a memory 21.

[0025] The processor 20 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0026] The memory 21 may be an internal storage unit of the terminal device 2, such as a hard disk or memory of the terminal device 2. The memory 21 may also be an external storage device of the terminal device 2, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 2. Further, the memory 21 may also include both an internal storage unit and an external storage device of the terminal device 2. The memory 21 is used to store the computer program and other programs and data required by the terminal device. The memory 21 may also be used to temporarily store data that has been output or is to be output.

[0027] In addition, each functional module in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional unit.

[0028] This embodiment also discloses a computer-readable storage medium for storing a computer program. When the computer program is executed by a processor, the above-mentioned hybrid video double watermark method is implemented.

[0029] In order to verify the superiority of the present invention in various aspects, the bit error rate (BER) is an indicator for measuring the accuracy of data transmission, and the intersection over union (IoU) is an indicator for measuring the accuracy of forgery detection. As shown in Table 1, the BER (%) after the video is subjected to non-geometric attack and geometric attack during transmission when the video size is 1920×1080 and 1280×720 in the copyright authentication stage is shown. Generally, when the bit error rate is less than 20%, it means that the watermark is detectable. The BER of the present invention does not exceed 10.4% in the following types of attack parameters, indicating the strong robustness of this embodiment. As shown in Table 2, the IoU detected after the video is forged when the video size is 1920×1080 and 1280×720 in the anti-counterfeiting authentication stage is shown. Generally, the closer the intersection over union is to 1, the higher the accuracy of forgery detection. The intersection over union of the IoU of the present invention detected after each video is forged exceeds 0.92, indicating the high accuracy of this embodiment.

[0030] Table 1 BER (%) of watermarked video after non-geometric attack and geometric attack during video transmission

[0031] Table 2 IoU of watermarked video after the video is forged during transmission

[0032] In this embodiment, a given video is converted into several video frames, the chrominance channel of each frame is extracted, the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized, and the copyright information is combined, inverse normalization is performed, and the video frame is reconstructed to obtain a robust watermark video frame, which not only ensures good visual quality but also has high robustness, extracts each color channel of the robust watermark video, uses the enhanced least significant bit method frame by frame, and combines the anti-counterfeiting information to reconstruct the video frame to obtain a hybrid double-watermark video. The dual requirements of video copyright protection and anti-counterfeiting positioning are achieved, and while accurately locating the counterfeit area, it effectively resists geometric distortion and traditional attacks. Compared with the original method, the present invention takes into account the data transmission of the video, has good performance in overcoming common attacks, and can accurately detect the counterfeit area to ensure the confidentiality and integrity of the video data transmission.

[0033] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0034] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0035] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A hybrid video double watermarking method, characterized in that: The method comprises the following steps: Step 1, convert the given video into several video frames, and extract the chrominance channel of each video frame; Step 2: Calculate the fractional harmonic Fourier moment of the chrominance channel of each video frame and normalize it, then combine the normalized result with the copyright information to perform inverse normalization operation and reconstruct the video frame operation in sequence to obtain a robust watermark video frame; Step 3, extract each color channel of the robust watermark video frame, use the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame in combination with the anti-counterfeiting information to obtain a hybrid dual-watermark video; Step 4: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication; Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

2. A hybrid video double watermarking method according to claim 1, characterized in that: In step 2, the process of calculating the fractional-order harmonic Fourier moment of the chrominance channel of each video frame has the following relationship: ； in, represents the complex conjugate operation, A video frame function representing the original chroma channels, represents the extreme harmonic Fourier moment of the video frame, represents the basis function, represents pi, A non-negative integer representing the order of the fractional polar harmonic Fourier moment, An integer representing the number of repetitions of the fractional harmonic Fourier moment, represents the polar coordinate extremal radius, represents the extreme angle of polar coordinates, Indicates the function to which it belongs and The product of the differential elements of The basis functions have the following relationship: ； in, represents the radial basis function, represents the exponential function, represents an imaginary number, represents the fractional order parameter; The radial basis function has the following relationship: ； in, represents the sine function, Represents the cosine function.

3. A hybrid video double watermarking method according to claim 2, characterized in that: In step 2, the process of normalizing the fractional-order polar harmonic Fourier moment has the following relationship: ； in, represents the set of fractional-order extreme harmonic Fourier moments selected to be embedded in the watermark, represents the number of fractional polar harmonic Fourier moments in the set, Indicates i Moments, represents the set of normalized fractional-order polar harmonic Fourier moments, represents the proportionality coefficient, The order is p The number of repetitions is q No. i A moment.

4. A hybrid video double watermarking method according to claim 3, characterized in that: In step 2, the process of combining copyright information and performing inverse normalization has the following relationship: ； in, Representation Quantizer represents the amplitude value set of the fractional-order extreme harmonic Fourier moment after the copyright information is embedded, represents the embedding strength, Indicates the jitter modulation distance where the copyright information is embedded. Indicates the specific embedded copyright information. Indicates the current state of the embedded copyright information; when When ;when When ; The quantizer has the following relationship: ； in, represents the set of amplitude values ​​of the normalized fractional-order polar harmonic Fourier moment, represents the floor function; The inverse normalization has the following relationship: ； in, represents the set of inverse-normalized fractional polar harmonic Fourier moments.

5. A hybrid video double watermarking method according to claim 4, characterized in that: In step 2, the process of reconstructing the video frame operation has the following relationship: ； in, represents the original video frame, represents the reconstructed video frame combined with copyright information, The order is p The number of repetitions is q No. i The basis functions corresponding to the moments are express The complex conjugate of express The complex conjugate of .

6. A hybrid video double watermarking method according to claim 5, characterized in that: In step 3, each color channel of the robust watermark video frame is extracted, and each color channel is combined with the anti-counterfeiting information using an enhanced least significant bit method frame by frame, and the video frame is reconstructed to obtain a hybrid dual-watermark video. The method specifically includes the following steps: Robust watermarking of video frames Separate each color channel to obtain each color channel of the video frame. represents a robust watermark; Given an anti-counterfeiting information bit stream, and the anti-counterfeiting information bit stream Convert to a Base digit sequence , a sequence of numbers Each number in is considered as a hidden number s; A first number is extracted from each pixel unit in each color channel of the video frame using an extraction function. The corresponding process has the following relationship: ； in, Represents pixel unit No. l The pixel value of pixels, Indicates the number of pixels contained in the pixel unit, represents the remainder function, Indicates the first number; A temporary value is generated based on the first number and the hidden number. The corresponding process has the following relationship: ； in, t Represents a temporary value, Indicates 3 L Power system, Represents an intermediate value, and the following relationship exists: ； The temporary value t Convert to Base Sequence ,in, , Representation sequence A number in According to the ternary modulation characteristics, Base Sequence Generate the binary sequence to be embedded , there is the following relationship: ； in, Represents the binary sequence to be embedded, Indicates the binary sequence to be embedded A number in Pixel unit U Each pixel is combined with the binary sequence to be embedded Generate pixel units embedded with anti-counterfeiting information , and obtain the color channels embedded with anti-counterfeiting information; among them, , Represents pixel unit The l The pixel value of a pixel, pixel unit The l The calculation process of the pixel value of a pixel has the following relationship: ； in, The position of the number to be embedded in the binary sequence has the following relationship: ； The color channels embedded with anti-counterfeiting information are combined to obtain a mixed double-watermarked video frame.

7. A hybrid video double watermarking method according to claim 6, characterized in that: In step 4, after receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame. The method specifically includes the following steps: The extreme value method is used to calculate the weights of all pixels occupied by noise points. R ,Will R = 0.005 as the boundary point of whether the video frame is affected by noise; like R < 0.005, it is judged that there is no noise attack and no denoising operation is performed; if R >0.005, the next step is to determine the noise type; Calculate the variance of the received video frame V and the variance of the received video frame after median filtering ,by As the boundary point, it distinguishes whether the video frame is subjected to salt and pepper noise or Gaussian noise; if , it is determined to be Gaussian noise; otherwise, it is determined to be salt and pepper noise; If the received video frame is subjected to salt and pepper noise, the received video frame is directly subjected to median filtering to obtain a denoised video frame after the salt and pepper noise is removed; If the received video frame is subject to Gaussian noise, the window size of the median filter is set to arrive , an adaptive median filtering operation is performed on the received video frame to obtain a denoised video frame after removing Gaussian noise.

8. A hybrid video double watermarking method according to claim 6, characterized in that: In step 4, the method of calculating the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame to obtain a robust watermark for copyright authentication specifically includes the following steps: The chroma channels of all denoised video frames are extracted, and the fractional-order extreme harmonic Fourier moments of the same order and repetition number as those in the embedding stage are calculated to obtain the fractional-order extreme harmonic Fourier moments of the watermark to be embedded. Then, an inverse quantization operation is performed to obtain the amplitude value of the fractional-order extreme harmonic Fourier moments after the copyright information is embedded to extract the copyright information. The extracted copyright information is compared with the original copyright information for copyright authentication.

9. A hybrid video double watermarking method according to claim 6, characterized in that: In step 4, the method of extracting each color channel of each received video frame to obtain a fragile watermark for anti-counterfeiting authentication specifically includes the following steps: Separate the received video into each color channel frame by frame, use the extraction function to extract a hidden number for each pixel unit in each color channel, obtain a hidden sequence, perform binary conversion on the hidden sequence to extract the watermark bit stream of each color channel; The extracted watermark bit stream of each color channel is compared with the original fragile watermark. If any watermark bit in the extracted watermark bit stream is different from the original watermark bit, the corresponding pixel unit is considered to be modified, and the pixel unit is marked with white, and the unmodified pixel unit is marked with dark color for anti-counterfeiting authentication.

10. A hybrid video dual watermark system, characterized in that: The system applies a hybrid video double watermark method as claimed in any one of claims 1 to 9, and the system comprises: Video frame separation module, used for: Convert a given video into several video frames and extract the chrominance channel of each video frame; Robust watermark embedding module for: The fractional-order harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized, and then the normalized result is combined with the copyright information to perform inverse normalization and reconstruct the video frame operation in sequence to obtain a robust watermarked video frame; Fragile watermark embedding module for: Extract each color channel of the robust watermark video frame, combine the anti-counterfeiting information using the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid double-watermark video; Robust watermark authentication module, used for: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication; Fragile watermark authentication module, used for: Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

Images