Media data verification method, system, device and equipment and medium

Abstract

The invention discloses a media data verification method, system and device, equipment and a medium, and relates to the technical field of data transmission. The method comprises the steps that fingerprint information corresponding to multiple audio and video frames in media data to be transmitted is calculated through a fingerprint extraction assembly, and multiple pieces of fingerprint information are obtained; target fingerprint information meeting a preset standard is selected from the multiple pieces of fingerprint information; determining a verification data packet for verifying the media data to be transmitted based on the target fingerprint information; and in the data transmission process of the to-be-transmitted media data, verifying the to-be-transmitted media data based on the verification data packet through the fingerprint verification component, and determining whether the to-be-transmitted media data is tampered or not. According to the technical scheme provided by the invention, the verification workload of audios and videos can be reduced, and the bandwidth of a data transmission link can also be reduced.

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to a method, system, device, equipment and medium for verifying media data. Background Art

[0002] With the development of the Internet, real-time multimedia applications have gradually become an indispensable part of the Internet. Multimedia technology plays a vital role in many application fields.

[0003] At present, in the existing multimedia data verification technology, each message will carry sequence number and timestamp information during the transmission process. The initial value of the sequence number is random. The sender increases the value of this field by one after sending each media data packet. The receiver can detect packet loss and restore the packet sequence through this field. However, if the number of audio and video frames of the media data is relatively large, the amount of verification information transmitted will be relatively large, which may affect the bandwidth of the link and increase the number of comparisons of the fingerprint comparison module. Summary of the invention

[0004] The present application provides a method, system, device, equipment and medium for verifying media data, which can reduce the workload of audio and video verification and can also reduce the bandwidth of data transmission links.

[0005] In a first aspect, the present application provides a method for verifying media data, the method comprising:

[0006] Calculate fingerprint information corresponding to multiple audio and video frames in the media data to be transmitted by the fingerprint extraction component to obtain multiple fingerprint information;

[0007] Selecting target fingerprint information that meets a preset standard from the multiple fingerprint information;

[0008] Determining a verification data packet for verifying the media data to be transmitted based on the target fingerprint information;

[0009] During the data transmission process of the media data to be transmitted, the media data to be transmitted is verified by the fingerprint verification component based on the verification data packet to determine whether the media data to be transmitted has been tampered with.

[0010] Furthermore, the fingerprint information corresponding to each of the multiple audio and video frames in the media data to be transmitted is calculated through a fingerprint extraction component to obtain multiple fingerprint information, including: obtaining content key information corresponding to each audio and video frame; calculating the fingerprint information corresponding to each audio and video frame based on the content key information corresponding to each audio and video frame and using a preset fingerprint algorithm to obtain the multiple fingerprint information; wherein the content key information includes quintuple information, sequence number, timestamp and information length.

[0011] Furthermore, selecting target fingerprint information that meets the preset standard from the multiple fingerprint information includes: determining a first quantity of the multiple fingerprint information; determining a bit requirement in the preset standard based on the first quantity and the quantity requirement in the preset standard, the bit requirement being a key value requirement on at least one target bit in the fingerprint information; and selecting the target fingerprint information from the multiple fingerprint information based on the bit requirement and the quantity requirement.

[0012] Further, determining the bit requirement in the preset standard based on the first quantity and the quantity requirement in the preset standard includes: performing data calculation on the first quantity based on the quantity requirement to obtain a second quantity of the target fingerprint information; and determining a third quantity of the target bit positions and a target key value of the target bit position based on the second quantity of the target fingerprint information.

[0013] Further, selecting the target fingerprint information from the multiple fingerprint information based on the bit requirement and the quantity requirement includes: determining, for current fingerprint information in the multiple fingerprint information, whether a key value corresponding to at least one target bit in the current fingerprint information is the target key value; if so, determining the current fingerprint information as the target fingerprint information; and traversing the multiple fingerprint information to determine the second quantity of the target fingerprint information.

[0014] Furthermore, data transmission is performed on the media data to be transmitted based on the real-time message transmission protocol RTMP, the WebSocket protocol or the hypertext transfer protocol HTTP.

[0015] In a second aspect, the present application provides a media data verification system, which includes a media data sending end, a media data receiving end, a fingerprint extraction component and a fingerprint verification component; the fingerprint extraction component is deployed in a bypass of the media data sending end, and at least one fingerprint verification component is deployed on a link for data transmission of the media data to be transmitted; the media data verification system is used to execute the media data verification method described in any embodiment of the present application.

[0016] In a third aspect, the present application provides a media data verification device, the device comprising:

[0017] A fingerprint information extraction module is used to calculate fingerprint information corresponding to each of multiple audio and video frames in the media data to be transmitted through a fingerprint extraction component to obtain multiple fingerprint information;

[0018] A fingerprint information screening module, used to select target fingerprint information that meets preset standards from the multiple fingerprint information;

[0019] A verification information determination module, used to determine a verification data packet for verifying the media data to be transmitted based on the target fingerprint information;

[0020] The media data verification module is used to verify the media data to be transmitted based on the verification data packet through a fingerprint verification component during the data transmission process of the media data to be transmitted, so as to determine whether the media data to be transmitted has been tampered with.

[0021] In a fourth aspect, the present application provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the media data verification method described in any embodiment of the present application.

[0022] In a fifth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the media data verification method described in any embodiment of the present application when executed.

[0023] In order to solve the defects of the prior art in the background technology, the embodiment of the present application provides a method for verifying media data. The execution of this method can bring the following beneficial effects: after determining the multiple fingerprint information corresponding to the media data to be transmitted, the present application selects a certain number of target fingerprint information from the multiple fingerprint information according to the preset screening criteria, and completes the verification task of the media data to be transmitted during the data transmission process based on the target fingerprint information. The present application does not need to change the current fingerprint feature extraction, transmission and verification methods, and does not need to change the existing deployment method, without affecting the tampering fingerprint verification results, which reduces the verification times of the fingerprint verification component, reduces the verification workload of audio and video, and thus reduces the investment in hardware; it also reduces the bandwidth of the data transmission link.

[0024] It should be noted that the above computer instructions may be stored in whole or in part on a computer-readable storage medium, wherein the computer-readable storage medium may be packaged together with the processor of the media data verification device, or may be packaged separately from the processor of the media data verification device, which is not limited in this application.

[0025] The description of the second, third, ..., and fifth aspects in this application can refer to the detailed description of the first aspect; and the beneficial effects of the description of the second, third, ..., and fifth aspects can refer to the beneficial effect analysis of the first aspect, which will not be repeated here.

[0026] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description.

[0027] It is understandable that before using the technical solutions disclosed in the embodiments of this application, the type, scope of use, and usage scenarios of the personal information involved in this application should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0029] Figure 1 A flowchart of a method for verifying media data provided in an embodiment of the present application;

[0030] Figure 2 A schematic diagram of a media data verification system provided in an embodiment of the present application;

[0031] Figure 3 A schematic diagram of the structure of a media data verification device provided in an embodiment of the present application;

[0032] Figure 4 It is a block diagram of an electronic device used to implement a method for verifying media data in an embodiment of the present application. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0034] It should be noted that the terms "first", "second", "target", and "original" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including", "having", and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0035] Figure 1 A flowchart of a method for verifying media data provided in an embodiment of the present application is provided. This embodiment can be applied to the case where verification is performed based on fingerprint information corresponding to the media data during data transmission of the media data. A method for verifying media data provided in this embodiment can be performed by a device for verifying media data provided in an embodiment of the present application. The device can be implemented in software and / or hardware and integrated in an electronic device that executes the method.

[0036] See also Figure 1 The method of this embodiment includes but is not limited to the following steps:

[0037] S110. Calculate fingerprint information corresponding to each of multiple audio and video frames in the media data to be transmitted through a fingerprint extraction component to obtain multiple fingerprint information.

[0038] Among them, the fingerprint extraction component is a technical tool for extracting unique features or "fingerprints" from media data to be transmitted. The media data to be transmitted refers to the information contained in various forms of media content to be transmitted in the transmission link, which can be audio data (such as music, voice), audio and video data (such as movies, short videos), and image data (such as photos). This embodiment takes the media data as audio and video as an example to explain a method for verifying media data. Fingerprint information refers to the unique and identifying feature data extracted from the media data.

[0039] Specifically, the fingerprint information corresponding to each of the multiple audio and video frames in the media data to be transmitted is calculated by the fingerprint extraction component to obtain multiple fingerprint information, including: extracting the content of each audio and video frame to obtain the content key information corresponding to each audio and video frame; calculating the fingerprint information corresponding to each audio and video frame based on the content key information corresponding to each audio and video frame and using a preset fingerprint algorithm to obtain multiple fingerprint information.

[0040] Among them, the key content information may include five-tuple information, sequence number, timestamp and information length. The five-tuple information may include source Internet Protocol (IP) address, source port, destination IP address, destination port and transport layer protocol. The preset fingerprint algorithm may be China National Cryptographic Algorithm SM3, Cyclic Redundancy Check (CRC), Message Digest Algorithm 5 (MD5), Secure Hash Algorithm 1 (SHA1), SHA256 and related variant algorithms.

[0041] S120: Select target fingerprint information that meets a preset standard from multiple fingerprint information.

[0042] When the amount of media data to be transmitted is large, the number of audio and video frames is also large, so the number of fingerprint information calculated according to the preset fingerprint algorithm will be large, which may affect the bandwidth of the data transmission link and increase the number of verifications of the fingerprint verification component. In order to solve this defect, without affecting the tampering of the fingerprint verification result, the target fingerprint information that meets the preset standard can be selected from multiple fingerprint information.

[0043] Specifically, selecting target fingerprint information that meets the preset standard from multiple fingerprint information includes: determining a first quantity of the multiple fingerprint information. Since the number of audio and video frames is the same as the number of fingerprint information, the value of the first quantity can also be obtained by determining the number of audio and video frames; determining the bit requirement in the preset standard based on the first quantity and the quantity requirement in the preset standard; and selecting the target fingerprint information from the multiple fingerprint information based on the bit requirement and the quantity requirement.

[0044] Optionally, the quantity requirement may be to select a preset proportion (e.g., 50%) of fingerprint information from multiple fingerprint information as the target fingerprint information. The bit requirement is a key value requirement for at least one target bit in the fingerprint information. The value of a certain bit can only be 0 or 1. For example, the key value requirement for the target bit can be that the bit value is 0.

[0045] Further, the bit requirement in the preset standard is determined based on the first quantity and the quantity requirement in the preset standard, including: first, performing data calculation on the first quantity based on the quantity requirement to obtain the second quantity of the target fingerprint information, for example: taking the preset ratio of the first quantity as the second quantity. Second, calculating the third quantity of the target bit positions and the target key value of the target bit position based on the second quantity of the target fingerprint information by using a preset calculation formula; in other words, the preset calculation formula is used to determine how many target bits (recorded as the third quantity) and the key value of the target bit position are selected for each fingerprint information in the multiple fingerprint information (recorded as the target key value), and the second quantity of the target fingerprint information can be obtained. Among them, the third quantity represents how many bits (i.e., the target bit positions) are selected from all the bits of a certain fingerprint information, and the preset calculation formula is used to represent the numerical relationship between the second quantity and the third quantity.

[0046] Further, target fingerprint information is selected from multiple fingerprint information based on the bit requirement and the quantity requirement, including: for the current fingerprint information in the multiple fingerprint information, determining whether the key value corresponding to at least one target bit in the current fingerprint information is the target key value; if so, determining the current fingerprint information as the target fingerprint information; traversing the multiple fingerprint information to determine a second quantity of target fingerprint information.

[0047] The value of a certain bit can only be 0 or 1, and the probability of the key value of the bit being 1 or 0 is the same. Filter a few bits of the fingerprint information (i.e., the third number of bits) and only select the fingerprint features with fixed values ​​(i.e., the target key value) for these bits. For example, filter the bit key value corresponding to the 128th bit of the fingerprint information as 1. In theory, the result of the screening is 1 / 2 of the total fingerprint information. If two bits are filtered, the result of the screening is 1 / 2 of the total fingerprint information. 2 If 3 bits are filtered, the result is theoretically 1 / 2 of the total fingerprint features. 3 By analogy, if n bits are screened, the result of the screening is to screen out 1 / 2 of the total fingerprint features. n .

[0048] A video frame is generally encapsulated into multiple data packets, and an audio frame is theoretically encapsulated into one data packet. Due to the tampering of audio and video, many video frames and audio frames change continuously. By filtering out fingerprint information according to a certain ratio, it is possible to filter out the data packets corresponding to the tampered audio and video frames, which theoretically does not affect the comparison results.

[0049] S130. Determine a verification data packet for verifying the media data to be transmitted based on the target fingerprint information.

[0050] In an embodiment of the present application, a data structure is pre-constructed to encapsulate a preset fingerprint algorithm, target fingerprint information and verification information of the media data to be transmitted, thereby obtaining a verification data packet of the media data to be transmitted.

[0051] S140. During data transmission of the media data to be transmitted, the media data to be transmitted is verified by a fingerprint verification component based on a verification data packet to determine whether the media data to be transmitted has been tampered with.

[0052] In an embodiment of the present application, at least one fingerprint verification component is deployed on a link for data transmission of media data to be transmitted. In the process of transmitting data packets through a given original transmission channel, corresponding fingerprint information is generated in the verification channel according to the media data to be transmitted transmitted through the original transmission channel. The fingerprint verification component compares the generated new fingerprint information with the fingerprint information in the verification data packet, and determines whether tampering has occurred in the media data to be transmitted based on the comparison result.

[0053] Optionally, the media data to be transmitted is transmitted based on the real-time messaging protocol RTMP, the WebSocket protocol or the hypertext transfer protocol HTTP.

[0054] The technical solution provided by this embodiment calculates the fingerprint information corresponding to each of the multiple audio and video frames in the media data to be transmitted through the fingerprint extraction component to obtain multiple fingerprint information; selects the target fingerprint information that meets the preset standard from the multiple fingerprint information; determines the verification data packet used to verify the media data to be transmitted based on the target fingerprint information; during the data transmission process of the media data to be transmitted, the media data to be transmitted is verified by the fingerprint verification component based on the verification data packet to determine whether the media data to be transmitted has been tampered with. After determining the multiple fingerprint information corresponding to the media data to be transmitted, the present application selects a certain number of target fingerprint information from the multiple fingerprint information according to the preset screening criteria, and completes the verification task of the media data to be transmitted during the data transmission process based on the target fingerprint information. Without affecting the tampering fingerprint verification result, the present application does not need to change the current fingerprint feature extraction, transmission and verification methods, and does not need to change the existing deployment method, which reduces the verification times of the fingerprint verification component, reduces the verification workload of the audio and video, and thus reduces the investment in hardware; it also reduces the bandwidth of the data transmission link.

[0055] The embodiment of the present invention also provides a media data verification system, such as Figure 2As shown, it includes a media data sending end 210, a media data receiving end 220, a fingerprint extraction component 230 and a fingerprint verification component 240. The fingerprint extraction component 230 is deployed in a bypass of the media data sending end 210, and at least one fingerprint verification component 240 is deployed on a link for data transmission of the media data to be transmitted; the verification system for media data is used to execute a verification method for media data such as any of the embodiments of the present invention. Please refer to the description of the previous embodiments for details, which will not be repeated here.

[0056] Figure 3 A schematic diagram of the structure of a media data verification device provided in an embodiment of the present application, such as Figure 3 As shown, the device 300 may include:

[0057] The fingerprint information extraction module 310 is used to calculate the fingerprint information corresponding to each of the multiple audio and video frames in the media data to be transmitted through the fingerprint extraction component to obtain multiple fingerprint information;

[0058] The fingerprint information screening module 320 is used to select target fingerprint information that meets the preset standard from the multiple fingerprint information;

[0059] A verification information determination module 330, configured to determine a verification data packet for verifying the media data to be transmitted based on the target fingerprint information;

[0060] The media data verification module 340 is used to verify the media data to be transmitted based on the verification data packet through a fingerprint verification component during the data transmission process of the media data to be transmitted, so as to determine whether the media data to be transmitted has been tampered with.

[0061] Furthermore, the above-mentioned fingerprint information extraction module 310 can be specifically used to: obtain the content key information corresponding to each audio and video frame; calculate the fingerprint information corresponding to each audio and video frame based on the content key information corresponding to each audio and video frame and use a preset fingerprint algorithm to obtain the multiple fingerprint information; wherein the content key information includes quintuple information, serial number, timestamp and information length.

[0062] Furthermore, the fingerprint information screening module 320 can be specifically used to: determine a first quantity of the multiple fingerprint information; determine a bit requirement in the preset standard based on the first quantity and the quantity requirement in the preset standard, wherein the bit requirement is a key value requirement on at least one target bit in the fingerprint information; and select the target fingerprint information from the multiple fingerprint information based on the bit requirement and the quantity requirement.

[0063] Furthermore, the fingerprint information screening module 320 can also be specifically used to: perform data calculation on the first quantity based on the quantity requirement to obtain a second quantity of the target fingerprint information; and determine a third quantity of the target bit positions and a target key value of the target bit position based on the second quantity of the target fingerprint information.

[0064] Furthermore, the fingerprint information screening module 320 can be specifically used to: determine, for the current fingerprint information among the multiple fingerprint information, whether the key value corresponding to the at least one target bit in the current fingerprint information is the target key value; if so, determine the current fingerprint information as the target fingerprint information; traverse the multiple fingerprint information to determine the second number of the target fingerprint information.

[0065] In one embodiment, data transmission of the media data to be transmitted is performed based on the real-time message transmission protocol RTMP, the WebSocket protocol or the hypertext transfer protocol HTTP.

[0066] The media data verification device provided in this embodiment can be applied to the media data verification method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0067] Figure 4 It is a block diagram of an electronic device for implementing a verification method of media data of an embodiment of the present application. The electronic device 10 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0068] like Figure 4As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0069] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0070] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a verification method for media data.

[0071] In some embodiments, the verification method of media data may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the verification method of media data described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the verification method of media data in any other appropriate manner (e.g., by means of firmware).

[0072] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0073] The computer programs for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer programs are executed by the processor, the functions / operations specified in the flow charts and / or block diagrams are implemented. The computer programs may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0074] In the context of the present application, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or equipment. A computer-readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0075] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0076] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server) or a computing system that includes middleware components (e.g., an application server) or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein) or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0077] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0078] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. For example, those skilled in the art can use the various forms of processes shown above to reorder, add, or delete steps; the steps recorded in the present application can be performed in parallel, sequentially, or in different orders, as long as the desired results of the technical solution of the present application can be achieved, and this document does not limit them here.

[0079] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. A method for verifying media data, characterized in that: The method comprises: Calculate fingerprint information corresponding to multiple audio and video frames in the media data to be transmitted by the fingerprint extraction component to obtain multiple fingerprint information; Selecting target fingerprint information that meets a preset standard from the multiple fingerprint information; Determining a verification data packet for verifying the media data to be transmitted based on the target fingerprint information; During the data transmission process of the media data to be transmitted, the media data to be transmitted is verified by the fingerprint verification component based on the verification data packet to determine whether the media data to be transmitted has been tampered with.

2. The method for verifying media data according to claim 1, characterized in that: The fingerprint extraction component calculates the fingerprint information corresponding to each of the multiple audio and video frames in the media data to be transmitted, and obtains multiple fingerprint information, including: Get the key content information corresponding to each audio and video frame; Based on the content key information corresponding to each audio and video frame and using a preset fingerprint algorithm to calculate the fingerprint information corresponding to each audio and video frame, the multiple fingerprint information is obtained; The key content information includes five-tuple information, sequence number, timestamp and information length.

3. The method for verifying media data according to claim 1, characterized in that: Selecting target fingerprint information that meets a preset standard from the multiple fingerprint information includes: Determining a first quantity of the plurality of fingerprint information; Determine a bit requirement in the preset standard based on the first quantity and the quantity requirement in the preset standard, where the bit requirement is a key value requirement on at least one target bit in the fingerprint information; The target fingerprint information is selected from the multiple fingerprint information based on the bit requirement and the quantity requirement.

4. The method for verifying media data according to claim 3, characterized in that: Determining the bit requirement in the preset standard based on the first quantity and the quantity requirement in the preset standard includes: Performing data calculation on the first quantity based on the quantity requirement to obtain a second quantity of the target fingerprint information; A third number of the target bits and a target key value of the target bits are determined based on the second number of the target fingerprint information.

5. The method for verifying media data according to claim 4, characterized in that: Selecting the target fingerprint information from the multiple fingerprint information based on the bit requirement and the quantity requirement includes: For a current fingerprint information among the multiple fingerprint information, determining whether a key value corresponding to at least one target bit in the current fingerprint information is the target key value; If yes, the current fingerprint information is determined as the target fingerprint information; The plurality of fingerprint information are traversed to determine the second number of target fingerprint information.

6. The method for verifying media data according to claim 1, characterized in that: The media data to be transmitted is transmitted based on the real-time message transmission protocol RTMP, the WebSocket protocol or the hypertext transfer protocol HTTP.

7. A media data verification system, characterized in that: The system includes a media data sending end, a media data receiving end, a fingerprint extraction component and a fingerprint verification component; Deploy a fingerprint extraction component in a bypass of the media data sending end, and deploy at least one fingerprint verification component on a link for data transmission of the media data to be transmitted; The media data verification system is used to execute the media data verification method as described in any one of claims 1-6.

8. A media data verification device, characterized in that: The device comprises: A fingerprint information extraction module is used to calculate fingerprint information corresponding to each of multiple audio and video frames in the media data to be transmitted through a fingerprint extraction component to obtain multiple fingerprint information; A fingerprint information screening module, used to select target fingerprint information that meets preset standards from the multiple fingerprint information; A verification information determination module, used to determine a verification data packet for verifying the media data to be transmitted based on the target fingerprint information; The media data verification module is used to verify the media data to be transmitted based on the verification data packet through a fingerprint verification component during the data transmission process of the media data to be transmitted, so as to determine whether the media data to be transmitted has been tampered with.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively coupled to the at least one processor; The memory stores a computer program executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the media data verification method according to any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the media data verification method according to any one of claims 1 to 6 when executed.

Images