Method, device, storage medium and program product for secure processing of media data

Abstract

This application provides a method, device, storage medium, and program product for secure processing of media data, relating to the field of multimedia technology. The method includes acquiring video data to be verified corresponding to original media data; generating first verification data for the video data to be verified; generating audio verification data containing the first verification data; and generating target media data containing the video data to be verified and the audio verification data, wherein the audio verification data is time-aligned with the video data to be verified. This application embodiment can achieve cross-verification of video data with audio data and convert the first verification data into audio, ensuring the security of the storage or transmission of the first verification data. Furthermore, the verification process of this application embodiment does not require consideration of complex operations such as video data encoding / decoding and video analysis, and can be adapted to anti-counterfeiting identification of media data in more diverse scenarios.

Description

Technical Field

[0001] This application relates to, but is not limited to, the field of multimedia technology, and in particular to a method, apparatus, storage medium, and program product for securely processing media data. Background Technology

[0002] In practical applications, media data (such as pure audio data, pure video data, and mixed audio and video data) is often at risk of being tampered with. For example, audio and video media forgery techniques can be used to tamper with or replace facial information in the original video and synthesize fake voices to create fake news, making it difficult for viewers to distinguish between genuine and fake media data. Although related technologies have proposed methods to detect forged audio and video media data to help institutions or communities identify such forged videos, these detection methods have many limitations, such as relying on specific data distributions and compression rates. Their technological evolution lags far behind the technology used to generate fake videos, making it impossible to identify media data more accurately. Therefore, there is an urgent need for a secure media data processing method that can improve the accuracy of media data anti-tampering identification. Summary of the Invention

[0003] The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.

[0004] This application provides a method, device, storage medium, and program product for secure processing of media data, which can improve the accuracy of media data anti-tampering identification.

[0005] In a first aspect, according to an embodiment of this application, a method for securely processing media data includes obtaining video data to be verified corresponding to original media data; generating first verification data of the video data to be verified; generating audio verification data containing the first verification data; and generating target media data containing the video data to be verified and the audio verification data, wherein the audio verification data is time-aligned with the video data to be verified.

[0006] Secondly, according to the media data security processing method of the embodiments of this application, the media data security processing method includes: acquiring target media data; extracting audio verification data and video data to be verified from the target media data; the audio verification data representing the verification data of the video data to be verified; determining first verification data based on the extracted audio verification data; and verifying the extracted video data to be verified based on the first verification data to obtain a first verification result.

[0007] Thirdly, a network device according to an embodiment of this application includes: at least one processor; at least one memory for storing at least one program; and when at least one of the programs is executed by at least one of the processors, implementing the secure media data processing method as described in any one of the first aspects and / or the secure media data processing method as described in any one of the second aspects.

[0008] Fourthly, according to embodiments of this application, a computer-readable storage medium stores computer-executable instructions for performing the secure processing method for media data as described in any one of the first aspects and / or the secure processing method for media data as described in any one of the second aspects.

[0009] Fifthly, a computer program product according to an embodiment of this application includes a computer program or computer instructions stored in a computer-readable storage medium. A processor of a network device reads the computer program or computer instructions from the computer-readable storage medium, and the processor executes the computer program or computer instructions to cause the network device to perform a secure media data processing method as described in any one of the first aspects and / or a secure media data processing method as described in any one of the second aspects.

[0010] The embodiments of this application obtain the video data to be verified corresponding to the original media data, generate first verification data for the video data to be verified, and include the first verification data in the audio verification data. The target media data is then generated by combining the video data to be verified and the audio verification data based on time alignment. In this way, the recipient of the target media data can parse the audio verification data and the video data to be verified from the received target media data, and verify the video data to be verified based on the first verification data in the audio verification data, thus achieving anti-counterfeiting identification. The embodiments of this application can achieve cross-verification of video data and audio data and convert the first verification data into audio to ensure the security of the storage or transmission of the first verification data. Furthermore, the verification data generation and transmission process of the embodiments of this application does not require consideration of complex operations such as video data encoding / decoding and video analysis, and can adapt to anti-counterfeiting identification of media data in more diverse scenarios. Therefore, compared with related technologies, the embodiments of this application can improve the accuracy of anti-tampering identification of media data. Attached Figure Description

[0011] Figure 1 A system diagram of the communication system provided in this application;

[0012] Figure 2 A flowchart illustrating the application of the secure processing method for media data provided in this application to a media data provider;

[0013] Figure 3 A schematic diagram illustrating an embodiment of the secure processing method for media data provided in this application applied to a media data provider;

[0014] Figure 4a A flowchart illustrating an embodiment of the secure media data processing method provided in this application, wherein the original media data consists of audio and video data;

[0015] Figure 4b A schematic diagram of an embodiment of the media data provider generating audio verification data in the media data security processing method provided in this application;

[0016] Figure 4c A schematic diagram of another embodiment in which the original media data in the secure processing method for media data provided in this application consists of audio and video data;

[0017] Figure 5 A schematic diagram illustrating the source tampering judgment in the secure processing method of media data provided in this application;

[0018] Figure 6 A schematic diagram of an embodiment in which the original media data in the secure processing method for media data provided in this application is video data;

[0019] Figure 7 A schematic diagram of an embodiment in which the original media data in the secure processing method for media data provided in this application is audio data;

[0020] Figure 8 A schematic diagram of an embodiment of the secure processing method for media data provided in this application applied to a source tracing scenario;

[0021] Figure 9 A flowchart illustrating the application of the secure processing method for media data provided in this application to media data users;

[0022] Figure 10a The secure processing method for media data provided in this application is applied to the waveform of audio data received by the media data user;

[0023] Figure 10b for Figure 10a The waveform diagram shown is a schematic diagram of the waveform after decomposition.

[0024] Figure 11 A schematic diagram of the device hardware structure corresponding to the device management method provided in this application. Detailed Implementation

[0025] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0026] It should be noted that although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first," "second," etc., in the specification, claims, and the aforementioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0027] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0028] The following are the Chinese and English definitions of the terms used in the embodiments of this application:

[0029] Amplitude Shift Keying (ASK) is a digital modulation scheme in which the amplitude of the carrier signal varies with the data to be transmitted.

[0030] Phase Shift Keying (PSK) is a modulation method in which the phase of the carrier signal changes according to the data being transmitted.

[0031] The Fourier Transform is a linear integral transform in mathematics used to transform functions from the time domain to the frequency domain for analysis.

[0032] Mixing, or audio mixing, is the process of combining two or more audio signals into a single signal. It is commonly used in music production and broadcasting.

[0033] Media data (such as pure audio data, pure video data, and mixed audio and video data) is often at risk of being tampered with. For example, audio and video media forgery techniques can be used to tamper with or replace facial information in the original video and synthesize fake voices to create fake news, making it difficult for viewers to distinguish between genuine and fake media data. Although existing technologies have proposed methods for detecting forged audio and video media data to help institutions or communities identify such forged videos, these detection methods have many limitations, such as relying on specific data distributions and compression rates. Their technological evolution lags far behind the technology used to generate fake videos, making it impossible to identify media data more accurately. Therefore, there is an urgent need for a secure media data processing method that can improve the accuracy of media data identification and enable the identification of more forged media data. Based on this, embodiments of this application provide a secure media data processing method, device, storage medium, and program product that can improve the accuracy of media data anti-tampering identification.

[0034] It is understood that in the accompanying drawings of this application Figure 4a , Figures 6-8 The dashed step boxes in the text indicate that the step is optional.

[0035] Reference Figure 1 As shown, this application provides a communication system including a first communication terminal and at least one second communication terminal, wherein,

[0036] The first communication terminal executes the following steps: acquiring the video data to be verified corresponding to the original media data; generating the first verification data of the video data to be verified; generating audio verification data containing the first verification data; and generating target media data containing the video data to be verified and the audio verification data, with the audio verification data and the video data to be verified being time-aligned.

[0037] The second communication terminal performs the following steps: acquiring target media data; extracting audio verification data and video data to be verified from the target media data; the audio verification data represents the verification data of the video data to be verified; determining the first verification data based on the extracted audio verification data; and verifying the extracted video data to be verified based on the first verification data to obtain the first verification result.

[0038] Since the verification data of the video data to be verified is converted into audio at the first communication end in this embodiment, if the audio verification data is not extracted at the second communication end, it means that the audio data in the target media data sent by the first communication end has been tampered with. When the first verification data cannot be used to verify the video data to be verified, it means that the first verification data has been tampered with or the video data to be verified has been tampered with; thus, it can be determined whether the original media data is reliable.

[0039] This application does not limit how the first communication terminal and the second communication terminal communicate and connect, nor does it limit the number of second communication terminals that interact with the first communication terminal. Figure 1 As shown, a second communication terminal is provided, and the second communication terminal obtains target media data from the first communication terminal. This embodiment of the application can be applied to scenarios involving audio / video transmission or storage, such as voice conferencing, video conferencing, pure video sharing, and pure audio sharing. Those skilled in the art can adapt the first and second communication terminals to specific devices according to actual application requirements.

[0040] The video data to be verified is used to verify the reliability of the original media data. It can be the original video data within the original media data or pre-configured video data; this application does not impose any restrictions on this. The target media data also carries the original media data, which is the data obtained after performing a security processing method on the original media data. This application does not restrict the type of original media data; those skilled in the art can selectively set it according to the actual situation. For example, in some embodiments, the original media data is set to pure audio; in other embodiments, the original media data is pure video; and in still other embodiments, the original media data is a mixture of audio and video.

[0041] The first verification data is used to verify the video data to be verified. The audio verification data represents the verification data carried by sound waves, thereby realizing the audio representation of the verification data. In some embodiments, the original media data contains multiple data types, and the audio verification data may include verification data corresponding to each data type, or it may only contain the first verification data. This application embodiment does not limit the audio frequency of the sound wave carrier in the audio verification data. Those skilled in the art can selectively set it according to actual needs. In some embodiments, audio frequencies that are imperceptible to the human body can be selected, so that the relevant data can be played directly after verification without removing it. The first verification data in this application embodiment does not involve changes to the original video data. Therefore, the operation of this application embodiment is simpler. Compared with adding text or images to the video, adding text or images will directly display, affecting the user experience and cannot prevent problems such as cutting and scaling. This application embodiment can achieve tamper identification without affecting the user experience. At the same time, compared with the invisible watermark method in the prior art, since the visible watermark is hidden in the video data, although it is not visually visible during playback, it requires modification of the video itself. The difficulty and cost of production and identification are relatively high. This application embodiment does not involve modification of the video data, and the identification method is simpler.

[0042] Raw media data can be collected in real time or stored on the device itself.

[0043] The video data to be verified can be either encoded or unencoded. In some embodiments, the video data to be verified is encoded. In this case, verification against tampering can be performed without decoding when the media data user obtains the video data, which can improve media data processing performance and reduce the overhead of media data anti-tampering. In other embodiments, the video data to be verified can also be unencoded. Those skilled in the art can selectively set this according to the system network architecture and verification process.

[0044] Understandably, referring to Figure 2 As shown in the figure, this application provides a method for securely processing media data, the method including:

[0045] Step S110: Obtain the video data to be verified corresponding to the original media data;

[0046] Step S120: Generate the first verification data of the video data to be verified;

[0047] Step S130: Generate audio verification data containing the first verification data;

[0048] Step S140: Generate target media data containing video data to be verified and audio verification data, with the audio verification data and the video data to be verified being time-aligned.

[0049] Therefore, by acquiring the video data to be verified corresponding to each original media data, first verification data of the video data to be verified is generated, and the first verification data is included in the audio verification data. The target media data is then generated by combining the time-aligned video data to be verified and the audio verification data. In this way, the recipient of the target media data can parse the audio verification data and the video data to be verified from the received target media data, and verify the video data to be verified based on the first verification data in the audio verification data, thus achieving anti-counterfeiting identification. This application embodiment can achieve cross-verification of video data and audio data and convert the first verification data into audio to ensure the security of the storage or transmission of the first verification data. Furthermore, the verification data generation and transmission process of this application embodiment does not require consideration of complex operations such as video data encoding / decoding and video analysis, and can adapt to anti-counterfeiting identification of media data in more diverse scenarios. Therefore, this application embodiment can improve the accuracy of anti-tampering identification of media data.

[0050] It is understood that steps S110 to S140 are steps performed by the media data provider. The media data user and the media data provider may be the same communication device or different communication devices. This application embodiment does not limit this, and those skilled in the art can selectively set it according to actual needs.

[0051] The original media data contains at least one type of data. For example, it may contain only audio data (e.g., instrumental music), or in some embodiments only video data (e.g., image data), or in others, a combination of audio and video data. The first verification data refers to the verification data used to verify the video data to be verified. The video data to be verified can be data from the original media data or pre-configured data.

[0052] This application embodiment does not limit the video length of the video data to be verified acquired each time in step S110. For example, the video data to be verified can be set as a single video frame, or it can be set as video data of a fixed duration, etc. Specifically, it can be selectively set according to the granularity of tamper verification. If the requirements for tamper verification are higher, the first verification data can be generated in units of frames. This application embodiment also does not limit whether the video data to be verified in step S110 is acquired continuously. Those skilled in the art can choose to acquire it continuously (e.g., each video frame is a video data to be verified), or they can choose to acquire it at intervals (e.g., at fixed intervals of duration or at fixed intervals of data volume).

[0053] This application does not limit the format of the target media data transmission; it can be a data stream or a file. This application also does not limit how the media data provider processes the target media data. Taking the media data provider needing to send the target media data to the media data user as an example, in some embodiments, the media data provider can segment the target data and send it in parallel or serially through a communication link. Correspondingly, after receiving a certain number of segments, the media data user can decode and recover the data.

[0054] This application does not limit how the first verification data in step S120 is generated. In some embodiments, a hash algorithm may be used, while in others, algorithms such as CRC may be used. Those skilled in the art can choose the algorithm used for generating the verification data according to actual security requirements.

[0055] The audio verification data is the verification data from the original media data that participates in tamper verification, carried by sound waves. The verification data can be specific to the video data to be verified, or it can be for each data type in the original media data. When the verification data is specific to the video data to be verified, the audio verification data only includes the first verification data. When the verification data verifies multiple data types, the audio verification data also includes verification data other than the first verification data. This application embodiment does not limit the audio frequency corresponding to the audio verification data in step S130; it only needs to ensure that, if the original media data contains the original audio data, the audio frequency is inconsistent with the original audio data.

[0056] The essence of audio verification data carrying the first verification data is to carry the data via sound waves. Embodiments of this application can utilize the amplitude, frequency, and phase characteristics of the wave to carry the verification data. In some embodiments, to avoid affecting the user experience, the audio frequency of the audio verification data can be selected as a specific ultrasonic wave. Using audio to transmit verification data eliminates the need for additional burdens in various stages such as packaging, transmission, and storage, offering advantages such as simplicity, reliability, and ease of implementation. Furthermore, the transmission of verification data does not require special channels or special protocol support; simultaneously, the verification data resides within the audio, making it inherently less prone to loss, and media data distribution and storage do not require separate attention to the verification data.

[0057] For example, taking raw media data as an example of real-time acquisition, refer to... Figure 3 As shown, the original audio data and original video data are collected separately. The media data provider generates multiple one-to-one first verification data for each video frame of the collected original video data. The time-aligned first verification data and the original audio data are mixed to obtain mixed audio data. The target media data is obtained based on the time-aligned mixed audio data and the original video data.

[0058] It is understandable that the video data to be verified corresponding to the original media data includes at least one of the following:

[0059] When the original media data consists of original audio data, the preset video data is determined as the video data to be verified.

[0060] If the original media data includes the original video data, the original video data will be identified as the video data to be verified.

[0061] The preset video data can be randomly generated or fixed video segments. In some embodiments, it can also be generated based on preset images. This application does not limit this. Those skilled in the art can selectively set the security level according to the anti-counterfeiting and anti-tampering requirements. For example, if better anti-counterfeiting features are required, the random generation method can be selected. For example, if the video data to be verified is in frames, then the video data to be verified in each frame can be randomly generated, so that the video data to be verified in each frame is different.

[0062] In some embodiments, "original media data includes original video data" means that the original media data consists of original video data. In other embodiments, "original media data includes original video data" means that the original media data consists of original video data and original audio data. When the original media data contains two or more types of data, the embodiments of this application can generate corresponding verification data for each type of data, or can generate first verification data only for the original video data.

[0063] For example, refer to Figure 4a As shown, taking the original media data as having both audio and video data, and generating audio verification data based solely on the first verification data as an example, the first verification data is generated based on the original video data. In this case, the target media data consists of the original media data and the audio verification data.

[0064] For example, refer to Figure 6 As shown, taking the example where the original media data only contains video data and audio verification data is generated based solely on the first verification data, the first verification data is generated based on the original video data. In this case, the target media data consists of the original media data and the original audio verification data.

[0065] For example, refer to Figure 7 As shown, taking the example where the original media data only contains audio data and audio verification data is generated based solely on the first verification data, the first verification data is generated based on the preset video data. In this case, the target media data consists of the original media data, the audio verification data, and the preset video data.

[0066] Understandably, the first verification data for generating the video data to be verified includes:

[0067] Obtain the keyframe data corresponding to the keyframe from the video data to be verified;

[0068] Generate the first verification data based on the keyframe data.

[0069] Keyframes can represent the complete image and can be decoded without referencing other frames. In some embodiments, when security requirements are not high, tamper verification can be performed only on the keyframe data corresponding to the keyframe. This can improve the efficiency of media data providers in securely processing raw media data while meeting security requirements.

[0070] The first verification data can be generated for each keyframe, or it can be generated only after several keyframes. This application does not impose any limitations on this, and those skilled in the art can selectively configure it according to actual needs.

[0071] Understandably, when the original media data contains the original audio data, audio verification data containing the first verification data is generated, including:

[0072] Generate the second verification data for the original audio data;

[0073] Generate audio verification data containing the first and second verification data.

[0074] By generating second verification data when the original media data includes the original audio data, the granularity of the tamper-proof verification can be further improved, thereby enhancing the security of the original audio data.

[0075] The first verification data and the second verification data can be obtained by mixing sound waves of different audio frequencies after conversion, or the first verification data and the second verification data can be obtained by converting sound waves of the same audio frequency. This application does not limit the implementation of the embodiments, and those skilled in the art can selectively set them according to actual needs.

[0076] The sound wave frequency of the audio verification data is different from that of the original audio data.

[0077] The embodiments of this application do not limit the method of generating the second verification data. It can be generated in the same way as the first verification data or in a different way. Those skilled in the art can selectively set it according to actual needs.

[0078] For example, refer to Figure 8 As shown, taking the first and second verification data as examples of using the same audio frequency sound wave as the carrier, after the first and second verification data are spliced ​​together, audio verification data is generated based on the spliced ​​verification data.

[0079] Understandably, when the original media data includes the original audio data, target media data is generated that includes the video data to be verified and the audio verification data, including:

[0080] The audio verification data and the original audio data are mixed to generate mixed audio data.

[0081] The video data to be verified and the mixed audio data are aligned and associated in time and encapsulated to obtain the target media data.

[0082] Mixing the audio verification data with the original audio data allows for transmission of a single waveform. For example, the media data user receives data such as... Figure 10a The audio spectrum shown can be decomposed based on methods such as Fourier transform to obtain... Figure 10b The spectrum shown. At this point, it can be based on... Figure 10b The spectrum shown is used to restore the verification data.

[0083] Understandably, the audio verification data generated, which includes the first verification data, includes:

[0084] Encrypt the first verification data to obtain the first verified encrypted data;

[0085] Generate audio verification data containing the first verification encrypted data.

[0086] Encrypting the first verification data can further enhance the security of the original media data transmission process. This application does not limit how the first verification data is encrypted. In some embodiments, while considering security, traceability can also be performed; in this case, encryption can employ methods similar to digital signatures for tracing the original media data. In other embodiments, where only enhanced security is considered, asymmetric encryption algorithms or similar methods can be used to encrypt the first verification data, reducing the possibility of tampering and thus improving security.

[0087] For example, refer to Figure 4a , Figures 6-8 As shown, a private key and public key pair can be pre-generated and sent to the media data provider and media data user respectively. The media data provider encrypts the first verification data using the private key, obtaining the first verification encrypted data. Media data users without access to the original media data cannot decrypt it, while those with access can successfully decrypt it. Similarly, in tampering scenarios, the inability to decrypt normally indicates a potential data tampering.

[0088] Understandably, the audio verification data generated, which includes the first verification encryption data, includes:

[0089] If the original media data contains the original audio data, generate second verification data for the original audio data;

[0090] The second verification data is encrypted to obtain the second verification encrypted data.

[0091] Generate audio verification data containing the first and second verification encrypted data.

[0092] In some embodiments, encrypting the first verification data and the second verification data separately can increase the difficulty of tampering, thereby enhancing security. The encryption algorithms for the first and second verification data can be the same or different; this application does not limit this, and those skilled in the art can selectively set them according to actual needs.

[0093] The first and second verification encrypted data can be carried using different sound wave frequencies or the same sound wave frequency. This application does not impose any restrictions on this.

[0094] Understandably, encrypting the first verification data yields the first encrypted verification data, which includes:

[0095] If the original media data contains the original audio data, generate second verification data for the original audio data;

[0096] The first verification data and the second verification data are concatenated, and the concatenated verification data is encrypted to obtain the first verification encrypted data.

[0097] By concatenating the first and second verification data, the security of the original audio data can be achieved. Compared to scenarios where the verification data is not encrypted, using the first verification data to encrypt the data can make the original media data transmission more secure.

[0098] For example, taking original media data containing both audio and video data as an example, referring to Figure 8, a key pair is pre-generated. This key pair includes a public key and a corresponding private key. The public key and private key are given to the media data user and the media data provider, respectively. After determining the first verification data and the second verification data, the media data provider concatenates the first verification data and the second verification data. The media data provider encrypts the concatenated verification data based on the private key to obtain the first encrypted verification data, and generates audio verification data based on the first encrypted verification data.

[0099] The embodiments of this application do not limit the target encryption algorithm used to encrypt the spliced ​​verification data. The target encryption algorithm can be pre-configured or dynamically configured.

[0100] Understandably, in some embodiments, the first verification encryption data is obtained by encrypting it through the following steps:

[0101] Get the length of the first verification data;

[0102] Based on the length, select the target encryption algorithm from the preset encryption algorithm list;

[0103] The first verification data is encrypted using the target encryption algorithm to obtain the first verification encrypted data.

[0104] Different encryption algorithms support different data lengths for encryption. For example, if PKCS#1v1.5 padding is used, then for a 2048-bit RSA key, the actual space available to carry data will be less than 2048 bits. Specifically, PKCS#1v1.5 needs to reserve at least 11 bytes (88 bits) for padding, meaning that a 2048-bit RSA key can only encrypt a maximum of (2048-88=1960) bits of data. By determining the target encryption algorithm based on the length of the first checksum, the integrity of the first checksum after decryption can be ensured.

[0105] By automatically selecting the target encryption algorithm based on its length, dynamic configuration of the target encryption algorithm can be achieved. This dynamic configuration allows for the dynamic selection of the rule for generating the first verification data, thus enabling dynamic adaptation to different anti-tampering scenarios.

[0106] Understandably, the first verification encrypted data is obtained by encrypting it through the following steps:

[0107] Determine the signing private key; the signing private key represents the source of the original media data;

[0108] The first verification data is digitally signed according to the preset target encryption algorithm and the signature private key to obtain the first verification encrypted data.

[0109] By assigning a unique signing private key to each source of original media data, tamper-proof verification of original media data from a specific source can be achieved. This also enables verification of the source of original media data, allowing for traceability of the original media data.

[0110] For example, refer to Figure 4c As shown, for n original media data from different sources (e.g., different owners), pre-generate their respective signing private keys and signing public keys. During the encryption of the first verification data of the original media data, taking the source of the original media data as m as an example, use the corresponding signing private key m to encrypt the first verification encrypted data. At this point, for the media data user, only the signing public key m corresponding to the signing private key m can successfully decrypt it. Therefore, the media data user can determine the source based on whether the decryption is successful. For example... Figure 4c As shown, in the presence of second verification data, the signature private key m can also encrypt the concatenated verification data.

[0111] Understandably, the sound waves corresponding to the audio verification data are sound waves that are imperceptible to the human body.

[0112] For example, ultrasound or infrasound could be used. By using sound waves that are imperceptible to the human body, the user experience can be further reduced, such as by playing music simultaneously with the verification process.

[0113] Understandably, referring to Figure 9 As shown in the figure, this application provides a method for securely processing media data, the method including:

[0114] Step S210: Obtain target media data;

[0115] Step S220: Extract audio verification data and video data to be verified from the target media data; the audio verification data represents the verification data of the video data to be verified.

[0116] Step S230: Determine the first verification data based on the extracted audio verification data;

[0117] Step S240: Verify the extracted video data to be verified based on the first verification data to obtain the first verification result.

[0118] The recipient of the target media data can parse audio verification data and video data to be verified from the received target media data. Based on the first verification data in the audio verification data, the video data to be verified can be validated, thus achieving anti-counterfeiting identification. Because cross-verification of video and audio data is used and the first verification data is converted to audio, the security of the first verification data storage or transmission can be ensured. Furthermore, in this embodiment, the first verification data on the media data provider's side does not require complex operations such as video data encoding / decoding and video analysis, making it adaptable to anti-counterfeiting identification of media data in more diverse scenarios. Therefore, the accuracy of anti-tampering identification of media data in this embodiment is higher.

[0119] Steps S210 to S240 are the execution steps on the side of the media data user.

[0120] Understandably, the extracted video data to be verified is verified based on the first verification data to obtain the first verification result, including:

[0121] Generate third verification data for the video data to be verified;

[0122] The third verification data is compared with the first verification data to obtain the first verification result.

[0123] The method for generating the third verification data is the same as that for step S120 on the media data provider's side. In some embodiments, a hash algorithm can be used to determine whether data tampering has occurred by comparing the third verification data with the first verification data. There are two possible results for the first verification: one is a comparison failure, meaning the video data in the target media data has been altered; the other is a comparison success, indicating that the original media data carried in the target media data is reliable and complete, and has not been tampered with.

[0124] Understandably, the audio verification data is obtained through the following steps:

[0125] Obtain the preset verification audio frequency;

[0126] Extract audio data from the target media data, and extract audio data with the same frequency as the verification audio from the audio data as audio verification data.

[0127] The verification audio frequency is the audio frequency used by the media data provider to carry the first verification data.

[0128] This application does not limit how audio data consistent with the verification audio frequency is extracted from audio data, such as the spectrum of the received audio data. Figure 10a As shown, Fourier transform can be used to decompose the data to obtain the following results: Figure 10b The spectrum of the two different frequencies is shown.

[0129] Understandably, after acquiring the target media data, the method also includes:

[0130] Obtain the preset actual audio frequency;

[0131] Extract audio data that matches the actual audio frequency from the target media data and use it as the raw audio data.

[0132] The fourth verification data is generated from the original audio data;

[0133] Based on the extracted audio verification data, determine the second verification data;

[0134] The fourth verification data is verified based on the second verification data, and the second verification result is output.

[0135] The actual audio frequency is the sound wave frequency used by the media data provider to carry the original audio data.

[0136] The method for generating the fourth verification data is the same as the method for generating the second verification data on the media data provider's side.

[0137] The second verification result has two types: one is a failure, which indicates that the original audio data may have been tampered with, and the other is a success, which indicates that the original audio data is reliable and has not been tampered with.

[0138] Understandably, based on the extracted audio verification data, the first verification data is determined, including:

[0139] Extract the first verification encrypted data from the audio verification data;

[0140] Decrypt the first verification encrypted data;

[0141] If the first verification encrypted data is successfully decrypted, the first verification data is determined based on the decryption result;

[0142] The method also includes:

[0143] If the first verification fails to decrypt the encrypted data, output the third verification result.

[0144] The process by which the media data user decrypts the first verification encrypted data is the reverse of the process by which the media data provider generates the first verification encrypted data.

[0145] The third verification result indicates that the audio data in the target media data may have been tampered with.

[0146] For example, refer to Figure 5 As shown, since the audio verification data, the original audio data, and the original video data are all time-aligned, the success or failure of the audio verification data extraction can determine whether the audio data is likely to be tampered with, and the success or failure of the first verification data in verifying the data to be verified can determine whether the video data to be verified or the first verification data is likely to be tampered with.

[0147] Understandably, the first verification data is determined based on the decryption result, including:

[0148] If the target media data contains the original audio data, the decryption result is split into verification data to obtain the first verification data and the second verification data.

[0149] If the target media data does not contain the original audio data, the decryption result will be used as the first verification data.

[0150] Understandably, decrypting the first verification encrypted data includes:

[0151] Obtain multiple preset signing public keys, each corresponding to a media data source;

[0152] The first verification encrypted data is decrypted using multiple signature public keys to obtain the decryption result and determine the target signature public key when decryption is successful.

[0153] The source of the target media data is determined based on the target signature public key.

[0154] Each signing public key corresponds to a signing private key. The signing private key is held by the media data source, and the signing public key is held by the media data user with access rights. If there are n different media data providers, n pairs of (signing private key, signing public key) can be generated. Each media data provider has its own signing private key. For a media data user, if they have access rights to media data provided by all n different media data providers, they can obtain n signing public keys. When they receive one of the target media data, they can determine the source of the target media data based on the decryption status of the first verification encrypted data using the n signing public keys. For example, refer to... Figure 4c As shown, for media data users, if the first verification encrypted data carried by the audio verification data is successfully decrypted using the public key m, it can be determined that it originated from m.

[0155] Understandably, after acquiring the target media data, the method also includes:

[0156] If audio verification data extraction fails, output the fourth verification result.

[0157] The following reference Figures 4a to 8 An example illustrating the interaction process between media data providers and media data users, where each piece of video data to be verified corresponds to one video frame, as detailed below:

[0158] Example 1: Taking the original media data as having both audio and video types, and encrypting the first verification data as an example, prepare the key pair (public key and private key) corresponding to the signature algorithm in advance. Then refer to... Figure 4a As shown, the specific steps to be performed by media data users and media data providers are as follows:

[0159] Media data provider:

[0160] S1.1 Acquisition of raw audio data;

[0161] S1.2 Acquire the original video data to obtain the compressed original video data;

[0162] S2. Generate the first verification data of the original video verification data. The first verification data can correspond to an I-frame in the original video verification data, or it can correspond one-to-one with each video frame in the original video verification data. The generation of the first verification data can use CRC / SHA, etc. When encryption algorithms are used to encrypt the verification data, a simpler algorithm can be used for the first verification data to obtain less verification data and improve the processing performance of the original media data for the media data provider. Alternatively, the algorithm can be chosen adaptively according to security requirements. For example, for security-sensitive applications, a hash algorithm, such as SHA-256, can be selected. The generation of the first verification data can be achieved through three steps: initializing the SHA handle: SHA256_CTX -> passing in video frame data sha256_update -> obtaining the first verification data sha256_find.

[0163] S3. Encrypt the first verification data using the signature private key; wherein, the target encryption algorithm used for encryption can be an asymmetric encryption algorithm;

[0164] S4. Generate audio verification data carrying the first verification data:

[0165] In some embodiments, the sampling frequency of the verification data can be determined based on a preset verification audio frequency to further ensure that verification data can be carried when each frame of the original video data is verified. The amount of audio data that can be carried within each frame's corresponding time period is shown in Table 1 below:

[0166]

[0167] Table 1

[0168] As shown in Table 1, the higher the audio frequency, the more data it can carry. That is, the higher the verification audio frequency, the more verification data it can carry. The verification audio frequency can be determined based on the amount of verification data. In some embodiments, the process of converting the first verification data into audio involves sampling the first verification data. When the verification audio frequency increases, the sampling frequency of the verification data acquisition needs to be increased synchronously to ensure that the data can be correctly restored. In this case, the sampling frequency of the first verification data can be determined by referring to a common sampling frequency and audio frequency range sampling frequency mapping table, as shown in Table 2 below:

[0169]

[0170]

[0171] Table 2

[0172] Table 2 above is based on the Nyquist Sampling Theorem.

[0173] For example, refer to Figure 4b The example illustrates audio conversion of the sampled first verification data. Taking ASK (Amplitude Shift Keying) as an example, the data can be represented by changing the amplitude of the ASK output signal. Here, ASK carrier activation represents 1, and deactivation represents 0. Therefore, when the first verification data is 1011010111, the amplitude shift keying output signal outputs at the position corresponding to 1 and stops outputting at the position of 0, thus achieving audio conversion of the first verification data. For ASK, since each cycle can carry 1 bit of data, the amount of data that a sound wave with a verification audio frequency of n Hz can carry is n bits. Therefore, when the verification audio frequency is 20000 Hz, 20000 bits of data can be carried per second. If a keyframe is established every 2 seconds, and the RSA2048 algorithm generates 2048 bits of data every 2 seconds, then the 20000 Hz audio using the ASK method can fully satisfy the anti-tampering verification requirements for generating the first verification data using a keyframe of 1 frame. When the first verification data exceeds the data range carried by the ASK method, other audio conversion methods can be selected, which will not be elaborated upon in this embodiment.

[0174] S5. Mix the original audio data and audio verification data to obtain mixed audio data.

[0175] S6. After aligning the mixed audio data and the original video data in time, package and encapsulate them to generate target media data. The target media data can be stored as a file or transmitted to the media data user via the network.

[0176] Media data users:

[0177] d1: The media data user reads media files or receives media data from the network to obtain the target media data;

[0178] d2: Decapsulate the target media data;

[0179] d3.1: Obtain video frame data (i.e., the video data to be verified in step S220);

[0180] d3.2: Acquire audio data;

[0181] d4: Extract audio verification data from audio data; audio verification data can be extracted based on preset verification audio frequencies;

[0182] d5: Extract the first verification encrypted data from the audio verification data; the extraction method corresponds to the generation method in S4. For example, if S4 selects a specific audio frequency (e.g., 20000Hz or higher) and uses amplitude shift keying (ASK) to carry the first verification data, the audio data obtained by the media data receiver will be as follows: Figure 10a As shown, using Fourier transform, audio data can be decomposed into a spectrum composed of sine waves of different frequencies, as shown in the figure. Figure 10b As shown, at this point, the original audio data and the first verification encryption data can be obtained by restoring the amplitude of different frequencies.

[0183] d6.1: Calculate the third checksum of the video frame data. The method for generating the checksum in this step is the same as that in s2.

[0184] d6.2: Decrypt the first verification encrypted data using the public key to obtain the first verification data; wherein the decryption in this step corresponds to S3 of the media data provider, and the decryption is performed using the decryption algorithm corresponding to the target encryption algorithm in S3;

[0185] For example, if the target encryption algorithm is RSA, then the first verification data = RSA(first verification encryption data, public key);

[0186] d7: Compare the verification data of d6 and d6.1 to see if they are consistent, that is, compare the third verification data with the first verification data. It utilizes the characteristics of audio and video synchronization to compare the verification data corresponding to audio and video data in the same time period to determine whether there has been tampering.

[0187] d8: If the two verification data are consistent, it indicates that the original media data carried in the target media data is reliable and complete, and has not been tampered with.

[0188] In summary, because Example 1 utilizes synchronized audio and video transmission, frame-by-frame verification is possible. Furthermore, the verification uses both audio and video data, meaning that any modification to either aspect can be detected. For example, refer to... Figure 5 As shown, if any frame of video is modified, it will be detected in D7; if any segment of audio data is modified, the audio / video verification data (corresponding to...) will not be obtained. Figure 4a (d4), or the obtained audio and video verification data cannot be decrypted (corresponding to...) Figure 4a (d6.1). Thus, the above steps can achieve fine-grained data tampering detection.

[0189] Example 2: Taking the original media data as having both audio and video types, and encrypting the first verification data as an example, prepare n key pairs (public and private keys) corresponding to the signature algorithm in advance. Then refer to... Figure 4c As shown, the specific steps to be performed by media data users and media data providers are as follows:

[0190] Media data provider: Refer to S1 to S6 in Example 1 for execution.

[0191] Media data provider: Refer to d1 to d5 in Example 1 for execution;

[0192] d6.1. Sequentially decrypt the first verification encrypted data using the pre-stored key pairs 1 to n, respectively.

[0193] d7. For each signature public key, determine whether decryption was successful;

[0194] d8. If the m-th key pair is successfully decrypted, that is, if the signature public key m is successfully decrypted, it proves that the original media data carried in the target media data comes from m. Otherwise, it means that the source of the original media data is unknown.

[0195] Understandably, Example 2 can also refer to Example 1, comparing the first and third verification data obtained from successful decryption in d7 to determine where the tampering occurred.

[0196] Example 3: Taking the original media data as containing only video data as an example, and encrypting the first verification data, a key pair (public key and private key) corresponding to the signature algorithm is prepared in advance. Refer to... Figure 6 As shown, compared to Example 1, no mixing is required at S5 in Example 3, and the audio verification data output from S4 is directly sent to S6 to generate the target media data. Correspondingly, when the media data user performs data audio separation for d4, only data audio of a specific frequency (i.e., verification audio data) is obtained.

[0197] Example 4: Taking the example of encrypting the first verification data using only audio data from the original media data, a key pair (public key and private key) corresponding to the signature algorithm is prepared in advance. Refer to... Figure 7 As shown, compared to Example 1, in Example 4, S1.1 is set to obtain preset video data. When performing anti-tampering verification on a per-video-frame basis, the preset video data obtained is the length of one video frame. The preset video data can choose to use a specific scene or generate random video; when using random video (such as snow), S2 will generate different checksums. Correspondingly, d6.1 and d7 on the media data receiver side can verify different data, resulting in better security. Furthermore, the media data user can maintain the same audio data processing method, and when playing audio and video, can choose to play only the audio.

[0198] Example 5: Taking the original media data as having both audio and video types, and encrypting both the first and second verification data as an example, prepare a key pair (public key and private key) corresponding to the signature algorithm in advance, then refer to... Figure 8 As shown, before S3 uses the signature key for encryption, S2.2 is executed to concatenate the first and second verification data to obtain the concatenated verification data. Then, S3 uses the signature private key to encrypt the concatenated verification data to generate audio verification data. Since the steps after the audio verification data are the same as those in the above example, they will not be described in detail here.

[0199] Accordingly, refer to Figure 8 As shown, on the media data user side, d4.2 and d4.3 have been added compared to the example above, to verify the original audio data and the original video data based on the first verification data and the second verification data, respectively.

[0200] Example 5 above can address an "advanced" scenario of tampering with the original audio: the forger separates the verification data audio, modifies the original audio data, and then mixes the original audio data with the first verification data, thereby achieving the tampering with the original audio data, such as... Figure 8As shown, in Example 5, the second checksum of the original audio data is added at step s2.2, forming the checksum of the original audio and video data. At the media data user's location, the first and second checksums (two checksums in total) can be used to verify the original audio and video data respectively. In step d6.1, the checksums of the original audio and video data carried by the checksum are obtained; in step d7, the checksums of the original audio and video data are verified respectively.

[0201] It is understandable that in some embodiments, such as Figure 8 As shown, the step within the dashed box in S3 can be omitted. In this case, the first and second verification data can be directly extracted from the audio verification data on the media data user's side. In some embodiments, Example 4 can also use the method of Example 5 to add second verification data to the original audio data. For details, please refer to Example 5, which will not be elaborated here.

[0202] In summary, the examples in this application involve a media data provider collecting audio and video data, compressing and encoding the video, generating first verification data for the video frame data, generating first verification encrypted data based on the first verification data, using audio as the carrier for the first verification encrypted data, and synthesizing this audio wave with the originally collected audio to form new audio data. The media data user separates the audio data carrier from the audio data, extracts the first verification data from it, and verifies the video frame data using the same method as the media data provider. If the verification is successful, it proves that the audio and video media data in the received target media data is valid. This allows verification of whether the audio and video data has been tampered with, at the video frame level.

[0203] The embodiments of this application can be adapted to combine the above-mentioned schemes according to the security purpose (traceability, anti-tampering, or a combination of traceability and anti-tampering).

[0204] In summary, the embodiments of this application have the following advantages:

[0205] 1. The embodiments of this application use audio to carry verification data and use audio to verify the original media data. This does not change the encapsulation, transmission, storage and other methods of the original media, and there is no additional intermediate overhead; it can be applied seamlessly.

[0206] 2. This application does not alter the original media data itself. If the media data user does not require security features, it can achieve full compatibility without affecting the user experience (e.g., ultrasonic waves can be used to carry verification data).

[0207] 3. The embodiments of this application can select one or more frequencies of sound waves to carry the verification data; it has high scalability.

[0208] 4. The embodiments of this application can also take into account the identification of data sources by media data users, and realize the traceability of media data.

[0209] 5. The embodiments of this application can identify both audio and video data simultaneously, and have the characteristics of high flexibility and scalability: they can be adapted to special media applications such as single audio and single video; they can also add encryption technology to enhance security; and different algorithms can be selected to encrypt the verification data according to different requirements.

[0210] 6. The embodiments of this application utilize audio payload verification data, taking advantage of the characteristic that audio data processing consumes little CPU resources; for video data, complex operations such as encoding / decoding and image analysis are not required, resulting in low resource consumption and high data processing performance.

[0211] Understandably, referring to Figure 11 As shown, one embodiment of this application also provides an electronic device, including:

[0212] At least one processor 101;

[0213] At least one memory 102 is used to store at least one program that implements the above method when the at least one program is executed by at least one processor 101.

[0214] Memory 102, as a non-transitory network system, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory 102 may include high-speed random access memory and non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 102 may optionally include remotely located memories 102 relative to processor 101, which can be connected to processor 101 via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0215] The memory 102 can be implemented as a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 102 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 102 and is called and executed by the processor 101.

[0216] The processor 101 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application.

[0217] In some embodiments, the network device further includes:

[0218] Input / output interfaces are used to implement information input and output;

[0219] The communication interface is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).

[0220] A bus transmits information between various components of the device (e.g., processor 101, memory 102, input / output interface, and communication interface);

[0221] The processor 101, memory 102, input / output interface, and communication interface can communicate with each other within the device via a bus.

[0222] An embodiment of this application also provides a computer-readable storage medium storing computer-executable instructions for performing the above-described method.

[0223] An embodiment of this application also provides a computer program product, including a computer program or computer instructions stored in a computer-readable storage medium. The processor of the detection device reads the computer program or computer instructions from the computer-readable storage medium and executes the computer program or computer instructions, causing the computer device to perform the above-described method.

[0224] The system architecture and application scenarios described in this application are intended to more clearly illustrate the technical solutions of this application and do not constitute a limitation on the technical solutions provided in this application. Those skilled in the art will understand that as system architectures evolve and new application scenarios emerge, the technical solutions provided in this application are also applicable to similar technical problems.

[0225] It will be understood by those skilled in the art that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, as is known to those skilled in the art, communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0226] The above description, with reference to the accompanying drawings, illustrates some embodiments of this application, but does not limit the scope of the invention. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and spirit of this invention should be considered within the scope of this application.

Claims

1. A method for securely processing media data, the method comprising: Obtain the video data to be verified corresponding to the original media data; Generate the first verification data of the video data to be verified; Generate audio verification data containing the first verification data; Generate target media data containing the video data to be verified and the audio verification data, wherein the audio verification data is time-aligned with the video data to be verified.

2. The method for securely processing media data according to claim 1, characterized in that, The process of obtaining the video data to be verified corresponding to the original media data includes at least one of the following: When the original media data consists of original audio data, the preset video data is determined as the video data to be verified. If the original media data contains original video data, the original video data is identified as the video data to be verified.

3. The method for securely processing media data according to claim 1, characterized in that, The first verification data for generating the video data to be verified includes: From the video data to be verified, obtain the keyframe data corresponding to the keyframe; The first verification data is generated based on the keyframe data.

4. The method for securely processing media data according to claim 1, characterized in that, When the original media data includes original audio data, generating audio verification data containing the first verification data includes: Generate second verification data for the original audio data; Generate audio verification data that includes the first verification data and the second verification data.

5. The method for securely processing media data according to claim 1 or 4, characterized in that, When the original media data includes original audio data, generating target media data that includes the video data to be verified and the audio verification data includes: The audio verification data and the original audio data are mixed to generate mixed audio data; The target media data is obtained by aligning and associating the video data to be verified and the mixed audio data in time.

6. The method for securely processing media data according to claim 1, characterized in that, The step of generating audio verification data containing the first verification data includes: The first verification data is encrypted to obtain the first encrypted verification data; Generate the audio verification data containing the first verification encryption data.

7. The method for securely processing media data according to claim 6, characterized in that, Generating the audio verification data containing the first verification encryption data includes: If the original media data contains original audio data, a second verification data for the original audio data is generated. The second verification data is encrypted to obtain the second encrypted verification data. Generate the audio verification data that includes the first verification encryption data and the second verification encryption data.

8. The method for securely processing media data according to claim 6, characterized in that, The step of encrypting the first verification data to obtain the first encrypted verification data includes: If the original media data contains original audio data, a second verification data for the original audio data is generated. The first verification data and the second verification data are concatenated, and the concatenated verification data is encrypted to obtain the first encrypted verification data.

9. The method for securely processing media data according to claim 6, characterized in that, The first verification encryption data is obtained by encrypting it through the following steps: Determine the signing private key; the signing private key represents the source of the original media data; The first verification data is digitally signed according to the preset target encryption algorithm and the signature private key to obtain the first verification encrypted data.

10. The method for securely processing media data according to claim 1, characterized in that, The sound waves corresponding to the audio verification data are sound waves that are imperceptible to the human body.

11. A method for securely processing media data, the method comprising: Acquire target media data; Extract audio verification data and video data to be verified from the target media data; The audio verification data represents the verification data of the video data to be verified. Based on the extracted audio verification data, the first verification data is determined; The extracted video data to be verified is verified based on the first verification data to obtain the first verification result.

12. The method for securely processing media data according to claim 11, characterized in that, The step of verifying the extracted video data to be verified based on the first verification data to obtain a first verification result includes: Generate third verification data for the video data to be verified; The third verification data is compared with the first verification data to obtain the first verification result.

13. The method for securely processing media data according to claim 11, characterized in that, Audio verification data is obtained through the following steps: Obtain the preset verification audio frequency; Audio data is extracted from the target media data, and audio data with the same frequency as the verification audio is extracted from the audio data as audio verification data.

14. The method for securely processing media data according to claim 13, characterized in that, After acquiring the target media data, the method further includes: Obtain the preset actual audio frequency; Extract audio data that matches the actual audio frequency from the target media data as the original audio data; Generate the fourth verification data of the original audio data; Based on the extracted audio verification data, determine the second verification data; The fourth verification data is verified based on the second verification data, and a second verification result is output.

15. The method for securely processing media data according to claim 11 or 13, characterized in that, The step of determining the first verification data based on the extracted audio verification data includes: Extract the first verification encryption data from the audio verification data; Decrypt the first verification encrypted data; If the first verification encrypted data is successfully decrypted, the first verification data is determined based on the decryption result; The method further includes: If the first verification encryption data fails to decrypt, the third verification result is output.

16. The method for securely processing media data according to claim 15, characterized in that, Determining the first verification data based on the decryption result includes: If the target media data contains the original audio data, the decryption result is split into verification data to obtain the first verification data and the second verification data. If the target media data does not contain the original audio data, the decryption result is used as the first verification data.

17. The method for securely processing media data according to claim 15, characterized in that, The decryption of the first verification encrypted data includes: Obtain multiple preset signing public keys, each corresponding to a media data source; The first verification encrypted data is decrypted using multiple signature public keys to obtain the decryption result and determine the target signature public key when decryption is successful. The source of the target media data is determined based on the target signature public key.

18. A network device, comprising: At least one processor; At least one memory for storing at least one program; When at least one of the programs is executed by at least one of the processors, the secure processing method for media data as described in any one of claims 1 to 10 and / or the secure processing method for media data as described in any one of claims 11 to 17 is implemented.

19. A computer-readable storage medium storing computer-executable instructions for performing the secure processing method of media data according to any one of claims 1 to 10 and / or the secure processing method of media data according to any one of claims 11 to 17.

20. A computer program product, comprising a computer program or computer instructions, characterized in that, The computer program or the computer instructions are stored in a computer-readable storage medium. The processor of the network device reads the computer program or the computer instructions from the computer-readable storage medium and executes the computer program or the computer instructions, causing the network device to perform the secure processing method for media data as described in any one of claims 1 to 10 and / or the secure processing method for media data as described in any one of claims 11 to 17.

Images