Hybrid video dual watermarking method and system

Abstract

The present invention proposes a hybrid video dual-watermarking method and system. The method extracts the chrominance channel of each video frame, calculates the extreme harmonic Fourier moment of the chrominance channel frame by frame, combines the calculation results with copyright information, and obtains a robust watermarked video frame. The robust watermarked video is then divided into various color channels. An enhanced least significant bit method is used for each color channel, combined with anti-counterfeiting information, to obtain a hybrid dual-watermarked video. The present invention can effectively protect valuable video content, accurately detect forged areas in the video, and demonstrate strong resistance to various attacks such as rotation, scaling, noise, and compression. In addition, the present invention can extract watermarks without the need for auxiliary information. The extreme harmonic Fourier moment of the chrominance channel of the transmitted video is calculated frame by frame to extract the robust watermark. The fragile watermark is extracted from each color channel of the video frame through an extraction function, and subsequent copyright authentication and anti-counterfeiting authentication operations can be completed.

Description

Technical Field

[0001] The present invention relates to the field of video processing technology, and in particular to a hybrid video double watermark method and system. Background Art

[0002] With the advent of the digital age, multimedia security has attracted widespread attention, particularly regarding the security of video content. As a crucial component of multimedia, video has become an integral part of daily life due to its vividness, engaging nature, and ability to quickly and easily access information. Furthermore, its central role in information dissemination and cultural expression has made it a key focus in multimedia security. The recent rise of video sharing platforms has not only enabled widespread dissemination of video content, but has also brought new challenges, such as the illegal copying and tampering of video content.

[0003] Against this backdrop, digital watermarking technology has emerged as an effective means of addressing video content security. By embedding secret information into digitized multimedia data, digital watermarking can not only verify video copyright information but also effectively detect video tampering. However, existing video watermarking technologies mostly treat copyright protection of video content and detection and location of video forgeries as two separate tasks. This functional division results in the limitation of traditional video watermarking schemes in addressing complex security challenges. Therefore, there is an urgent need to develop a video watermarking technology that can resist various attacks to effectively protect video copyrights, accurately locate tampered areas, and achieve video anti-counterfeiting positioning. Summary of the Invention

[0004] In view of the above situation, the main purpose of the present invention is to propose a hybrid video double watermarking method, system, device and storage medium to solve the above technical problems.

[0005] The present invention provides a hybrid video double watermarking method, which comprises the following steps:

[0006] Step 1: Convert the given video into several video frames and extract the chroma channel of each video frame;

[0007] Step 2: Calculate the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame and normalize it. Then, combine the normalized result with the copyright information and perform inverse normalization and video frame reconstruction operations in sequence to obtain a robust watermarked video frame.

[0008] Step 3: extract each color channel of the robust watermark video frame, use the enhanced least significant bit method to combine the anti-counterfeiting information for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid dual-watermark video;

[0009] Step 4: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chroma channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication;

[0010] Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

[0011] The present invention also proposes a hybrid video dual watermark system, the system comprising:

[0012] Video frame separation module, used for:

[0013] Convert a given video into several video frames and extract the chroma channel of each video frame;

[0014] Robust watermark embedding module for:

[0015] The fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized. The normalized result is then combined with the copyright information to perform inverse normalization and reconstruct the video frame to obtain a robust watermarked video frame.

[0016] Fragile watermark embedding module for:

[0017] Extract each color channel of the robust watermark video frame, combine the anti-counterfeiting information with the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid dual-watermark video;

[0018] Robust watermark authentication module, used for:

[0019] After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame. The extreme harmonic Fourier moment of the chroma channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication.

[0020] Fragile watermark authentication module, used for:

[0021] Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

[0022] The present invention also provides a terminal device, comprising a memory and a processor, wherein the processor implements the above-mentioned hybrid video double watermarking method when executing a computer program stored in the memory.

[0023] The present invention also provides a computer-readable storage medium for storing a computer program, which implements the above-mentioned hybrid video double watermarking method when executed by a processor.

[0024] Compared with the prior art, the present invention has the following beneficial effects:

[0025] 1. The present invention converts a given video into several video frames, extracts the chrominance channel of each frame, calculates the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame and normalizes it, combines it with copyright information, performs inverse normalization, reconstructs the video frame, and obtains a robust watermarked video frame, which not only ensures good visual quality but also has high robustness.

[0026] 2. Extract each color channel of the robust watermarked video and reconstruct the video frame by frame using an enhanced least significant bit method combined with anti-counterfeiting information to obtain a hybrid dual-watermarked video. This achieves the dual requirements of video copyright protection and anti-counterfeiting positioning, accurately locating forged areas while effectively resisting geometric distortion and traditional attacks.

[0027] 3. After video transmission, watermark extraction is performed on the received video. The extreme harmonic Fourier moment of the chrominance channel is calculated for each video frame after the denoiser to obtain a robust watermark for copyright authentication. Extraction functions are applied to each color channel of the video frame to obtain a fragile watermark for anti-counterfeiting authentication. Robust watermarks are highly robust, so they can still be extracted even after the video is attacked, ensuring the confidentiality of video data transmission. Fragile watermarks are highly fragile, so even if the video is forged, tampered areas can be accurately identified, ensuring the integrity of video data transmission.

[0028] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through embodiments of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 This is a flow chart of the hybrid video dual watermarking method proposed by the present invention;

[0030] Figure 2 Generate a fragile watermark authentication graph for the video double watermark of the present invention;

[0031] Figure 3 This is the overall framework diagram of the hybrid video dual watermarking method system proposed by the present invention;

[0032] Figure 4 This is a schematic diagram of the structure of the terminal device proposed by the present invention;

[0033] In the figure, 2. terminal device, 20. processor, 21. memory, 22. computer program. DETAILED DESCRIPTION

[0034] The following describes embodiments of the present invention in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended only to explain the present invention and are not to be construed as limiting the present invention.

[0035] These and other aspects of the embodiments of the present invention will become clear with reference to the following description and accompanying drawings. In these descriptions and accompanying drawings, some specific implementations of the embodiments of the present invention are specifically disclosed to illustrate some ways of implementing the principles of the embodiments of the present invention, but it should be understood that the scope of the embodiments of the present invention is not limited thereto.

[0036] See also Figure 1 The embodiment of the present invention provides a hybrid video double watermarking method, the method comprising the following steps:

[0037] Step 1: Convert the given video into several video frames and extract the chroma channel of each video frame;

[0038] Convert the video into several video frames. In this embodiment, the video uses the YUV420 format;

[0039] In this embodiment, a frame rate of 25 is used to convert the video into 300 video frames. The chroma channel of each video frame is extracted to prepare for robust watermark embedding;

[0040] Step 2: Calculate the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame and normalize it. Then, combine the normalized result with the copyright information and perform inverse normalization and video frame reconstruction operations in sequence to obtain a robust watermarked video frame.

[0041] In the above scheme, the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame is calculated to ensure better visual quality. The fractional-order extreme harmonic Fourier moment has good rotation, scale and translation invariance, and has good robustness to geometric attacks such as rotation and scaling. It also has higher moment calculation accuracy, which helps to build a more robust watermark. The normalization operation can adjust the size of the geometric moment to achieve scale invariance. Therefore, the fractional-order extreme harmonic Fourier moment of the chrominance channel of the video frame is calculated and normalized; combined with copyright information, inverse normalization is performed, and the video frame is reconstructed to obtain a robust watermark video frame;

[0042] The process of calculating the fractional harmonic Fourier moment of the chrominance channel of each video frame has the following relationship:

[0043] ;

[0044] in, represents the complex conjugate operation, A video frame function representing the original chroma channels, represents the extreme harmonic Fourier moment of the video frame, represents the basis function, represents pi, A non-negative integer representing the order of the fractional polar harmonic Fourier moment, An integer representing the number of repetitions of the fractional polar harmonic Fourier moment, represents the extreme radius of polar coordinates, represents the extreme angle of polar coordinates, Indicates the function to which it belongs and The product of the infinitesimals of

[0045] The basis functions have the following relationship:

[0046] ;

[0047] in, represents the radial basis function, represents the exponential function, represents an imaginary number, represents the fractional order parameter;

[0048] The radial basis function has the following relationship:

[0049] ;

[0050] in, represents the sine function, Represents the cosine function.

[0051] The process of normalizing the fractional-order extreme harmonic Fourier moment has the following relationship:

[0052] ;

[0053] in, represents the set of fractional-order extreme harmonic Fourier moments selected to be embedded in the watermark, represents the number of fractional polar harmonic Fourier moments in the set, Indicates the i Moments, represents the set of normalized fractional-order polar harmonic Fourier moments, represents the proportionality coefficient, Indicates the order p The number of repetitions is q No. i Moments

[0054] The process of combining copyright information and performing inverse normalization has the following relationship:

[0055] ;

[0056] in, Representation Quantizer represents the amplitude value set of the fractional-order extreme harmonic Fourier moment after the copyright information is embedded, represents the embedding strength, Indicates the jitter modulation distance where copyright information is embedded. Indicates the specific embedded copyright information, Indicates the current status of the embedded copyright information; when When ;when When ;

[0057] The quantizer has the following relationship:

[0058] ;

[0059] in, represents the set of amplitude values ​​of the normalized fractional-order extreme harmonic Fourier moment, represents the floor function;

[0060] The inverse normalization has the following relationship:

[0061] ;

[0062] in, represents the set of inverse-normalized fractional polar harmonic Fourier moments;

[0063] The following relationship exists in conjunction with the process of reconstructing the video frame operation:

[0064] ;

[0065] in, represents the original video frame, represents the reconstructed video frame combined with copyright information, Indicates the order p The number of repetitions is q No. i The basis functions corresponding to the moments are express The complex conjugate of express The complex conjugate of express The complex conjugate of .

[0066] Step 3: extract each color channel of the robust watermark video frame, use the enhanced least significant bit method to combine the anti-counterfeiting information for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid dual-watermark video;

[0067] The specific steps of the above solution are as follows:

[0068] Robust watermarking of video frames Separate each color channel to obtain each color channel video frame of the video frame, each color channel video frame of the video frame includes the video frame red channel , video frame green channel , video frame blue channel ,in, represents the red channel, Indicates the green channel, represents the blue channel, represents a robust watermark;

[0069] Given an anti-counterfeiting information bit stream, i.e., a fragile watermark;

[0070] For each color channel, the security information bit stream Convert to A sequence of digits in base 1 , a sequence of numbers Each number in is considered as a hidden number s;

[0071] The extraction function is used to extract a first digit from the pixel unit of each color channel. The corresponding process has the following relationship:

[0072] ;

[0073] in, Represents pixel units No. l The pixel value of each pixel, Indicates the number of pixels contained in the pixel unit, represents the remainder function, Indicates the first number;

[0074] Generate a temporary value based on the first digit and the hidden digit t , used to adjust the pixel unit U To hide numbers s , the corresponding process has the following relationship:

[0075] ;

[0076] in, t Indicates a temporary value, Represents 3 L Power system, Represents an intermediate value, and the following relationship exists:

[0077] ;

[0078] To make the temporary value t With pixel unit U Each pixel value in Match and set the temporary value t Convert to Base sequence ,in, , Representation sequence A number in

[0079] According to the ternary modulation characteristics, Base sequence Generate the binary sequence to be embedded , specifically the following relationship exists:

[0080] ;

[0081] in, Represents the base sequence to be embedded, Represents the base sequence to be embedded A number in

[0082] Pixel unit U Each pixel is combined with the binary sequence to be embedded Generate pixel units embedded with anti-counterfeiting information , get each color channel embedded with anti-counterfeiting information, each color channel embedded with anti-counterfeiting information includes the red channel of the video frame embedded with anti-counterfeiting information , green channel of video frame with embedded anti-counterfeiting information and the blue channel of the video frame with embedded anti-counterfeiting information ;in, , Represents pixel units The l The pixel value of the pixel, pixel unit The l The calculation process of the pixel value of a pixel has the following relationship:

[0083] ;

[0084] in, The position of the number to be embedded in the base sequence has the following relationship:

[0085] ;

[0086] The color channels embedded with anti-counterfeiting information are combined to obtain a hybrid double-watermarked video frame.

[0087] Step 4: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chroma channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication;

[0088] Extract each color channel of each received video frame to obtain a fragile watermark for anti-counterfeiting authentication;

[0089] After completing the hybrid video dual watermarking, in order to facilitate the subsequent video transmission and watermark authentication, this embodiment also discloses a specific process for subsequent watermark authentication, and the specific steps are as follows:

[0090] Use the extreme value method to calculate the weights of all pixels occupied by noise points R ,Will R = 0.005 as the boundary point of whether the video frame is affected by noise to prevent judgment errors caused by other errors; if R <0.005, it is determined that there is no noise attack and no denoising operation is performed; if R >0.005, then proceed to the next step of noise type determination;

[0091] Calculate the variance of the received video frame and the variance of the received video frame after median filtering ,by As the boundary point, it distinguishes whether the video frame is subjected to salt and pepper noise or Gaussian noise; if , it is determined to be Gaussian noise; otherwise, it is determined to be salt and pepper noise.

[0092] Two types of noise are processed separately according to the noise type. If the received video frame is affected by salt and pepper noise, the median filter is directly applied to the received video frame to obtain the denoised video frame after removing the salt and pepper noise. If the received video frame is affected by Gaussian noise, the window size of the median filter is set to arrive The received video frame is subjected to an adaptive median filtering operation to obtain a denoised video frame after removing Gaussian noise;

[0093] Extract all chroma channels of the denoised video frame and calculate the fractional-order extreme harmonic Fourier moment with the same order and repetition number as the embedding stage to obtain the fractional-order extreme harmonic Fourier moment to be embedded in the watermark , and then the inverse quantization operation is performed to obtain the amplitude value of the fractional-order extreme harmonic Fourier moment after the copyright information is embedded , to extract copyright information, compare the extracted copyright information with the original copyright information, and perform copyright authentication;

[0094] The received video is separated frame by frame into its individual color channels. For each pixel in each color channel, an extraction function is used to extract a hidden number. After all the hidden numbers are extracted, a hidden sequence is generated and binary converted to extract the watermark bitstream for each color channel. The extracted watermark bitstream for each color channel is compared with the original fragile watermark, or security information bitstream. If any watermark bit in the extracted watermark bitstream differs from the original watermark bitstream, the corresponding pixel is considered modified and marked in white. Unmodified pixels are marked in darker colors for security verification.

[0095] In the above scheme, after the present invention generates the video double watermark, its fragile watermark authentication process can be Figure 2 Reflect, among them, Figure 2 (a) to Figure 2 (d) in the figure shows different color video frames.

[0096] It should be noted that in this embodiment, the Figure 2 They are all color video frames. Due to the characteristics of video, they contain more video information during the double watermark operation and authentication operation.

[0097] See also Figure 3 This embodiment also discloses a hybrid video dual watermark system, the system comprising:

[0098] Video frame separation module, used for:

[0099] Convert a given video into several video frames and extract the chroma channel of each video frame;

[0100] Robust watermark embedding module for:

[0101] The fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized. The normalized result is then combined with the copyright information to perform inverse normalization and reconstruct the video frame to obtain a robust watermarked video frame.

[0102] Fragile watermark embedding module for:

[0103] Extract each color channel of the robust watermark video frame, combine the anti-counterfeiting information with the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid dual-watermark video;

[0104] Robust watermark authentication module, used for:

[0105] After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame. The extreme harmonic Fourier moment of the chroma channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication.

[0106] Fragile watermark authentication module, used for:

[0107] Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

[0108] See also Figure 4 This embodiment also discloses a terminal device. The terminal device 2 includes a memory 21 and a processor 20. When the processor 20 executes the computer program 22 stored in the memory 21, the above-mentioned hybrid video double watermark method is implemented.

[0109] In addition, the computer program 22 can be divided into one or more modules, which are stored in the memory 21 and executed by the processor 20 to implement the hybrid video double watermarking method of the present invention. One or more modules can be a series of computer program instruction segments that can perform specific functions. The instruction segments are used to describe the execution process of the computer program 22 in the terminal device 2. The terminal device may include, but is not limited to, a processor 20 and a memory 21.

[0110] The processor 20 may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0111] The memory 21 can be an internal storage unit of the terminal device 2, such as a hard drive or memory of the terminal device 2. The memory 21 can also be an external storage device of the terminal device 2, such as a plug-in hard drive, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. equipped with the terminal device 2. Furthermore, the memory 21 can include both an internal storage unit of the terminal device 2 and an external storage device. The memory 21 is used to store the computer program and other programs and data required by the terminal device. The memory 21 can also be used to temporarily store data that has been output or is about to be output.

[0112] In addition, the functional modules in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0113] This embodiment also discloses a computer-readable storage medium for storing a computer program. When the computer program is executed by a processor, the above-mentioned hybrid video dual watermarking method is implemented.

[0114] To demonstrate the superiority of the present invention in various aspects, the bit error rate (BER) is used to measure data transmission accuracy, and the intersection over union (IoU) is used to measure forgery detection accuracy. Table 1 shows the BER (%) for videos with sizes of 1920×1080 and 1280×720 in the copyright authentication phase, after being subjected to non-geometric and geometric attacks during transmission. Generally, a BER less than 20% indicates that the watermark is detectable. The BER of the present invention does not exceed 10.4% for the following attack parameters, demonstrating the robustness of this embodiment. Table 2 shows the IoU detected for videos with sizes of 1920×1080 and 1280×720 in the anti-counterfeiting authentication phase, after being forged. Generally, the closer the IoU is to 1, the higher the accuracy of forgery detection. The IoU of the present invention detected after forgery in each video exceeded 0.92, demonstrating the high accuracy of this embodiment.

[0115] Table 1 BER (%) of watermarked video after non-geometric attack and geometric attack during transmission

[0116]

[0117] Table 2 IoU of watermarked video after video is forged during transmission

[0118]

[0119] In this embodiment, a given video is converted into several video frames, the chrominance channel of each frame is extracted, the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized, and the copyright information is combined, inverse normalization is performed, and the video frame is reconstructed to obtain a robust watermarked video frame, which not only ensures good visual quality but also has high robustness, extracts each color channel of the robust watermarked video, uses the enhanced least significant bit method frame by frame, and combines the anti-counterfeiting information to reconstruct the video frame to obtain a hybrid double-watermarked video. The dual requirements of video copyright protection and anti-counterfeiting positioning are achieved, and while accurately locating the forged area, it effectively resists geometric distortion and traditional attacks. Compared with the original method, the present invention takes into account the data transmission of the video, has good performance in overcoming common attacks, and can accurately detect the forged area to ensure the confidentiality and integrity of the video data transmission.

[0120] It should be understood that various components of the present invention can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used: a discrete logic circuit having logic gate circuits for implementing logic functions on data signals, an application-specific integrated circuit having suitable combinational logic gate circuits, a programmable gate array (PGA), a field-programmable gate array (FPGA), etc.

[0121] Throughout this specification, reference to terms such as "one embodiment," "some embodiments," "examples," "specific examples," or "some examples" means that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0122] The above-described embodiments merely illustrate several implementations of the present invention, and while their descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art would be able to make numerous variations and improvements without departing from the spirit of the present invention, all of which fall within the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be determined by the appended claims.

Claims

1. A hybrid video double watermarking method, characterized in that: The method comprises the following steps: Step 1: Convert the given video into several video frames and extract the chroma channel of each video frame; Step 2: Calculate the fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame and normalize it. Then, combine the normalized result with the copyright information and perform inverse normalization and video frame reconstruction operations in sequence to obtain a robust watermarked video frame. Step 3: Extract each color channel of the robust watermark video frame, use the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame in combination with the anti-counterfeiting information to obtain a hybrid dual-watermark video; Step 4: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame, and the extreme harmonic Fourier moment of the chroma channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication; Extract each color channel of each received video frame to obtain a fragile watermark for anti-counterfeiting authentication; The process of calculating the fractional harmonic Fourier moment of the chrominance channel of each video frame has the following relationship: ； in, represents the complex conjugate operation, A video frame function representing the original chroma channels, represents the extreme harmonic Fourier moment of the video frame, represents the basis function, represents pi, A non-negative integer representing the order of the fractional polar harmonic Fourier moment, An integer representing the number of repetitions of the fractional polar harmonic Fourier moment, represents the extreme radius of polar coordinates, represents the extreme angle of polar coordinates, Indicates the function to which it belongs and The product of the infinitesimals of The basis functions have the following relationship: ； in, represents the radial basis function, represents the exponential function, represents an imaginary number, represents the fractional order parameter; The radial basis function has the following relationship: ； in, represents the sine function, represents the cosine function; The process of normalizing the fractional-order extreme harmonic Fourier moment has the following relationship: ； in, represents the set of fractional-order extreme harmonic Fourier moments selected to be embedded in the watermark, represents the number of fractional polar harmonic Fourier moments in the set, Indicates the i Moments, represents the set of normalized fractional-order polar harmonic Fourier moments, represents the proportionality coefficient, Indicates the order p The number of repetitions is q No. i Moments The method of extracting each color channel of the robust watermark video frame, combining the anti-counterfeiting information with the enhanced least significant bit method for each color channel frame by frame, and reconstructing the video frame to obtain a hybrid dual-watermark video specifically includes the following steps: Robust watermarking of video frames Separate each color channel to obtain each color channel of the video frame, represents a robust watermark; Given an anti-counterfeiting information bit stream, and the anti-counterfeiting information bit stream Convert to a Base digit sequence , a sequence of numbers Each number in is considered as a hidden number s; The extraction function is used to extract a first digit from each pixel unit in each color channel of the video frame. The corresponding process has the following relationship: ； in, Represents pixel units No. l The pixel value of each pixel, Indicates the number of pixels contained in the pixel unit, represents the remainder function, Indicates the first number; A temporary value is generated based on the first number and the hidden number. The corresponding process has the following relationship: ； in, t Indicates a temporary value, Represents 3 L Power system, Represents an intermediate value, and the following relationship exists: ； The temporary value t Convert to Base sequence ,in, , Representation sequence A number in According to the ternary modulation characteristics, Base sequence Generate the binary sequence to be embedded , specifically the following relationship exists: ； in, Represents the base sequence to be embedded, Represents the base sequence to be embedded A number in Pixel unit U Each pixel is combined with the binary sequence to be embedded Generate pixel units embedded with anti-counterfeiting information , and obtain the color channels embedded with anti-counterfeiting information; among them, , Represents pixel units The l The pixel value of the pixel, pixel unit The l The calculation process of the pixel value of a pixel has the following relationship: ； in, The position of the number to be embedded in the base sequence has the following relationship: ； The color channels embedded with anti-counterfeiting information are combined to obtain a hybrid double-watermarked video frame.

2. A hybrid video double watermarking method according to claim 1, characterized in that: In step 2, the process of combining copyright information and performing inverse normalization has the following relationship: ； in, Representation Quantizer represents the amplitude value set of the fractional-order extreme harmonic Fourier moment after the copyright information is embedded, represents the embedding strength, Indicates the jitter modulation distance where copyright information is embedded. Indicates the specific embedded copyright information, Indicates the current status of the embedded copyright information; when When ;when When ; The quantizer has the following relationship: ； in, represents the set of amplitude values ​​of the normalized fractional-order extreme harmonic Fourier moment, represents the floor function; The inverse normalization has the following relationship: ； in, represents the set of inverse-normalized fractional polar harmonic Fourier moments.

3. A hybrid video double watermarking method according to claim 2, characterized in that: In step 2, the process of reconstructing the video frame operation has the following relationship: ； in, represents the original video frame, represents the reconstructed video frame combined with copyright information, Indicates the order p The number of repetitions is q No. i The basis functions corresponding to the moments are express The complex conjugate of express The complex conjugate of .

4. A hybrid video double watermarking method according to claim 3, characterized in that: In step 4, after receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame. The method specifically includes the following steps: Use the extreme value method to calculate the weights of all pixels occupied by noise points R ,Will R = 0.005 as the boundary point for whether the video frame is affected by noise; like R < 0.005, it is determined that there is no noise attack and no denoising operation is performed; if R >0.005, then proceed to the next step of noise type determination; Calculate the variance of the received video frame and the variance of the received video frame after median filtering ,by As the boundary point, it distinguishes whether the video frame is subjected to salt and pepper noise or Gaussian noise; if , it is determined to be Gaussian noise; otherwise, it is determined to be salt and pepper noise; If the received video frame is affected by salt and pepper noise, the received video frame is directly subjected to median filtering to obtain a denoised video frame after the salt and pepper noise is removed; If the received video frame is subject to Gaussian noise, set the window size of the median filter to arrive In between, an adaptive median filtering operation is performed on the received video frame to obtain a denoised video frame after removing Gaussian noise.

5. A hybrid video double watermarking method according to claim 4, characterized in that: In step 4, the extreme harmonic Fourier moment of the chrominance channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication. The method specifically includes the following steps: The chroma channels of all denoised video frames are extracted, and the fractional-order polar harmonic Fourier moments of the same order and repetition number as in the embedding stage are calculated to obtain the fractional-order polar harmonic Fourier moments of the watermark to be embedded. Then, an inverse quantization operation is performed to obtain the amplitude value of the fractional-order polar harmonic Fourier moment after the copyright information is embedded to extract the copyright information. The extracted copyright information is compared with the original copyright information for copyright authentication.

6. A hybrid video double watermarking method according to claim 5, characterized in that: In step 4, the method of extracting each color channel of each received video frame to obtain a fragile watermark for anti-counterfeiting authentication specifically includes the following steps: Separate the received video frame by frame into each color channel. For each pixel unit in each color channel, use the extraction function to extract a hidden number to obtain a hidden sequence. Perform binary conversion on the hidden sequence to extract the watermark bit stream of each color channel. The extracted watermark bit stream of each color channel is compared with the original fragile watermark. If the watermark bit of any one of the extracted watermark bit streams is different from the original watermark bit, the corresponding pixel unit is considered to be modified. The pixel unit is marked in white, and the unmodified pixel units are marked in dark color for anti-counterfeiting authentication.

7. A hybrid video dual watermark system, characterized in that: The system applies a hybrid video double watermark method according to any one of claims 1 to 6, and the system includes: Video frame separation module, used for: Convert a given video into several video frames and extract the chroma channel of each video frame; Robust watermark embedding module for: The fractional-order extreme harmonic Fourier moment of the chrominance channel of each video frame is calculated and normalized. The normalized result is then combined with the copyright information to perform inverse normalization and reconstruct the video frame to obtain a robust watermarked video frame. Fragile watermark embedding module for: Extract each color channel of the robust watermark video frame, combine the anti-counterfeiting information with the enhanced least significant bit method for each color channel frame by frame, and reconstruct the video frame to obtain a hybrid dual-watermark video; Robust watermark authentication module, used for: After receiving the video, each video frame of the received video is passed through a denoiser to obtain a denoised video frame. The extreme harmonic Fourier moment of the chroma channel of the denoised video frame is calculated to obtain a robust watermark for copyright authentication. Fragile watermark authentication module, used for: Each color channel of each received video frame is extracted to obtain a fragile watermark for anti-counterfeiting authentication.

Images