A data verification method, device, apparatus and storage medium

By deploying a verification channel in the bypass of the audio and video data transmission channel to extract and verify fingerprint features, the problem of complex and error-prone audio and video data verification in the existing technology is solved, and the real-time performance and stability are improved.

CN116599734BActive Publication Date: 2025-11-18BEIJING HENGAN JIAXIN SAFETY TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310596125.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2025-11-18
Estimated Expiration
2043-05-24

AI Technical Summary

Technical Problem

Existing multimedia data verification technologies are complex and error-prone in detecting video content tampering, and network transmission performance is affected. There is a lack of real-time verification and stable transmission solutions for audio and video data.

Method used

By deploying a verification channel in bypass of the original transmission channel, and allocating the verification channel to extract and verify the fingerprint features of audio and video data packets, real-time verification and stable transmission of audio and video data can be achieved.

Benefits of technology

This ensures the real-time performance and accuracy of audio and video data verification, guarantees the smoothness and stability of data transmission, and reduces the delay and false detection rate of data tampering detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116599734B_ABST
    Figure CN116599734B_ABST
Patent Text Reader

Abstract

The application discloses a data checking method, device and equipment and a storage medium, and comprises the following steps: obtaining target audio and video data packets corresponding to target audio and video encoding in a given original transmission channel; allocating a checking channel for the target audio and video data packets, and generating current fingerprint data packets of the target audio and video encoding in the checking channel according to the target audio and video data packets; in the process of data packet transmission through the original transmission channel, checking the target audio and video data packets in the checking channel according to the current fingerprint data packets, and determining a checking result of the target audio and video encoding. The above scheme can realize real-time checking of audio and video data through a bypass deployment mode without frame extraction, thereby guaranteeing the real-time performance and accuracy of the checking of the audio and video data, and the fluency and stability of the transmission of the audio and video data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a data verification method, apparatus, device, and storage medium. Background Technology

[0002] With the development of the internet, real-time multimedia applications have gradually become an indispensable part of the internet. Multimedia technology plays a crucial role in many application areas.

[0003] Currently, existing multimedia data verification technologies are mainly applied to the detection of video content tampering, lacking other aspects of content verification. One method used in existing technologies is to extract features from keyframes in the video for verification. This method requires accurate identification and extraction of keyframes, which is complex to implement and prone to missed detections and errors. Another data verification method often uses the same link for multimedia data transmission and verification. When there is a large amount of data in the channel, it can affect network transmission performance, easily leading to data reuse, transmission chaos, and verification errors. There is also a risk of network interruption due to equipment failure. Summary of the Invention

[0004] This invention provides a data verification method, apparatus, device, and storage medium that achieves real-time verification of audio and video data through bypass deployment without frame extraction, ensuring the real-time performance and accuracy of audio and video data verification, as well as the smoothness and stability of audio and video data transmission.

[0005] In a first aspect, embodiments of this disclosure provide a data verification method, including:

[0006] Obtain the target audio and video data packets corresponding to the target audio and video encoding in a given original transmission channel;

[0007] A verification channel is allocated to the target audio and video data packet, and a current fingerprint data packet encoded in the target audio and video data packet is generated in the verification channel based on the target audio and video data packet;

[0008] During the transmission of data packets through the original transmission channel, the target audio and video data packets are verified in the verification channel based on the current fingerprint data packets to determine the verification result of the target audio and video encoding.

[0009] Secondly, embodiments of this disclosure provide a data verification device, including:

[0010] The data packet acquisition module is used to acquire the target audio and video data packets corresponding to the target audio and video encoding in a given original transmission channel;

[0011] A data packet generation module is used to allocate a verification channel for the target audio and video data packet, and generate the current fingerprint data packet of the target audio and video encoding in the verification channel according to the target audio and video data packet;

[0012] The verification result determination module is used to verify the target audio and video data packet based on the current fingerprint data packet in the verification channel during the data packet transmission through the original transmission channel, and determine the verification result of the target audio and video encoding.

[0013] Thirdly, embodiments of this disclosure provide an electronic device, including:

[0014] At least one processor; and

[0015] A memory that is communicatively connected to at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by at least one processor, such that the at least one processor can perform a data verification method provided in the first aspect embodiment described above.

[0017] Fourthly, embodiments of this disclosure provide a computer-readable storage medium storing computer instructions that, when executed by a processor, implement a data verification method provided in the first aspect of the embodiments described above.

[0018] This invention discloses a data verification method, apparatus, device, and storage medium. The method involves acquiring a target audio / video data packet corresponding to a target audio / video encoding in a given original transmission channel; allocating a verification channel for the target audio / video data packet; generating a current fingerprint data packet of the target audio / video encoding based on the target audio / video data packet in the verification channel; and verifying the target audio / video data packet based on the current fingerprint data packet in the verification channel during data packet transmission through the original transmission channel to determine the verification result of the target audio / video encoding. This technical solution utilizes two channels to separately implement audio / video data transmission and verification, enabling real-time verification of audio / video data simultaneously with data transmission. Therefore, this solution achieves real-time verification of audio / video data through a bypass deployment without frame skipping, ensuring the real-time performance and accuracy of audio / video data verification, as well as the smoothness and stability of audio / video data transmission.

[0019] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a flowchart of a data verification method provided in Embodiment 1 of the present invention;

[0022] Figure 2 This is a flowchart of a data verification method provided in Embodiment 2 of the present invention;

[0023] Figure 3 This is an example illustration of the transmission process involved in a data verification method provided in Embodiment 2 of the present invention;

[0024] Figure 4 This is an example illustration of feature extraction involved in a data verification method provided in Embodiment 2 of the present invention;

[0025] Figure 5 This is another example illustration of feature extraction involved in a data verification method provided in Embodiment 2 of the present invention;

[0026] Figure 6 This is an example illustration of data verification involved in a data verification method provided in Embodiment 2 of the present invention;

[0027] Figure 7 This is another example illustration of data verification involved in a data verification method provided in Embodiment 2 of the present invention;

[0028] Figure 8 This is a schematic diagram of the structure of a data verification device provided in Embodiment 3 of the present invention;

[0029] Figure 9 This is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. Detailed Implementation

[0030] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0031] It should be noted that the terms "first," "second," and "target," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0032] Example 1

[0033] Figure 1 This is a flowchart of a data verification method provided in Embodiment 1 of the present invention. This embodiment is applicable to the situation of real-time verification of audio and video encoded data. The method can be executed by a data verification device, which can be implemented in hardware and / or software.

[0034] like Figure 1 As shown, the method includes:

[0035] S101. Obtain the target audio and video data packets corresponding to the target audio and video encoding in the given original transmission channel.

[0036] In this embodiment, the target audio / video encoding can be understood as the audio and video encoded data to be transmitted or being transmitted. The given original transmission channel can be understood as the data transmission channel used to transmit the target audio / video encoding. The target audio / video data packet can be understood as a data packet encapsulated based on the target audio / video encoding and its corresponding basic parameter data.

[0037] Specifically, after the sending device responds to the corresponding audio and video encoding acquisition request and sends the target audio and video data packet corresponding to the target audio and video encoding according to the given original transmission channel, a data verification device of this embodiment is executed to obtain the target audio and video data packet corresponding to the target audio and video encoding from the given original transmission channel.

[0038] It is understood that the target audio and video data packets are encapsulated and transmitted according to a preset communication protocol, and this embodiment does not limit the type of communication protocol.

[0039] S102. Allocate a verification channel for the target audio and video data packet, and generate the current fingerprint data packet encoded by the target audio and video data packet in the verification channel.

[0040] In this embodiment, the verification channel can be understood as a channel used for feature extraction and verification based on the target audio / video data packet; it is a physical channel separately allocated for performing data feature extraction and verification. The current fingerprint data packet can be understood as a data packet generated based on the fingerprint features after fingerprint feature extraction from the target audio / video data packet in the verification channel.

[0041] Specifically, a corresponding verification channel is allocated to the target audio and video data packets. This allows the target audio and video data packets to be transmitted from the given original transmission channel while feature extraction and real-time verification are performed within the allocated verification channel. A fingerprint feature extraction module is deployed in the verification channel. When the fingerprint feature extraction module receives the target audio and video data packets in the verification channel, it extracts fingerprint features from the target audio and video data packets to obtain the fingerprint feature information corresponding to the target audio and video encoding. This fingerprint feature information is then encapsulated to obtain the current fingerprint data packet.

[0042] It is understandable that the fingerprint feature information in the current fingerprint data packet is standard fingerprint feature information, which can be used to verify the data.

[0043] S103. During the data packet transmission process through the original transmission channel, the target audio and video data packet is verified in the verification channel based on the current fingerprint data packet to determine the verification result of the target audio and video encoding.

[0044] In this embodiment, the verification result can be understood as the result of whether the target audio and video codec has been tampered with during the transmission process, including two results: the target audio and video codec has been tampered with and the target audio and video codec has not been tampered with.

[0045] Specifically, a fingerprint feature verification module is deployed in the verification channel. During the transmission of data packets through the given original transmission channel, corresponding fingerprint feature information is generated in the verification channel based on the target audio and video data packets transmitted through the original transmission channel. The fingerprint feature verification module compares the generated new fingerprint feature information with the fingerprint feature information in the current fingerprint data packet, and determines whether the target audio and video encoding has been tampered with based on the comparison result.

[0046] In this embodiment, the target audio and video data packet corresponding to the target audio and video encoding in a given original transmission channel is obtained; a verification channel is allocated to the target audio and video data packet, and a current fingerprint data packet of the target audio and video encoding is generated in the verification channel based on the target audio and video data packet; during the data packet transmission through the original transmission channel, the target audio and video data packet is verified in the verification channel based on the current fingerprint data packet to determine the verification result of the target audio and video encoding. The above technical solution uses two channels to separately implement the transmission and verification of audio and video data, enabling real-time verification of audio and video data while the audio and video data is being transmitted. Therefore, this solution can achieve real-time verification of audio and video data through a bypass deployment without frame extraction, ensuring the real-time performance and accuracy of audio and video data verification, as well as the smoothness and stability of audio and video data transmission.

[0047] As a first optional embodiment of the embodiments, based on the above embodiments, this first optional embodiment further optimizes and adds: when the verification result indicates that the target audio and video encoding has been tampered with, an alarm message is generated and sent to the corresponding receiving device.

[0048] In this embodiment, the alarm information can be understood as an alarm automatically issued when the target audio and video codec is detected to have been tampered with, which includes the verification result, the tampering status of the target audio and video codec, and the location where the target audio and video codec has been tampered with.

[0049] Specifically, when the verification result indicates that the target audio / video encoding has been tampered with, a corresponding alarm message is automatically generated at that location and sent to the receiving device corresponding to the target audio / video data packet. This allows the receiving device to locate the location of the tampering event based on the alarm message reported in real time, and to execute corresponding countermeasures locally according to the pre-set anomaly response plan to correct the data tampering behavior during transmission.

[0050] Example 2

[0051] Figure 2 This is a flowchart of a data verification method provided in Embodiment 2 of the present invention. This embodiment is a further optimization of any of the above embodiments and can be applied to the situation of real-time verification of audio and video encoded data. The method can be executed by a data verification device, which can be implemented in hardware and / or software.

[0052] like Figure 2 As shown, the method includes:

[0053] S201. Obtain the target audio and video data packets corresponding to the target audio and video encoding in the given original transmission channel.

[0054] S202. Allocate the first interactive network port and the second interactive network port to the target audio and video data packets to form a verification channel.

[0055] In this embodiment, both the first interactive network port and the second interactive network port can be understood as network ports used for data interaction between the original transmission channel and the verification channel. The first interactive network port is the network port that receives data from the original transmission channel into the verification channel. The second interactive network port is the network port that receives data from the verification channel back to the original transmission channel.

[0056] It is understandable that during data transmission, multiple network ports can exist to facilitate data interaction between the two channels. The network port through which data flows from the original transmission channel to the verification channel is collectively referred to as the first interaction network port, and the network port through which data flows from the verification channel to the original transmission channel is collectively referred to as the second interaction network port. It is not that there are only two network ports.

[0057] Specifically, a first interactive network port and a second interactive network port are allocated to the target audio and video data packets to form a verification channel for feature extraction and verification of the target audio and video.

[0058] S203. Input the current original file data packet into the verification channel, and extract features from the current original file data packet to generate the current fingerprint data packet of the target audio and video encoding.

[0059] In this embodiment, the current original file data packet is transmitted to the verification channel through a pre-allocated network port. In the verification channel, the current original file data is subjected to feature extraction to obtain the fingerprint feature information of the target audio and video data packet, and the target audio and video encoded current fingerprint data packet is generated based on the fingerprint feature information.

[0060] Optionally, inputting the current original file data packet to the verification channel includes: mirroring the target audio and video data packet from the original transmission channel to the verification channel through the first interactive network port.

[0061] Specifically, the target audio and video data packets are mirrored from the original transmission channel to the verification channel via the first interactive network port. At this time, the target audio and video data packets are still stored and transmitted in the original transmission channel, and the mirrored target audio and video data packets also exist in the verification channel.

[0062] By using mirror transmission, the target audio and video data packets transmitted in the original transmission channel remain unchanged, reducing the possibility of mutations in the target audio and video data packets during transmission and verification. This also ensures the stability and smoothness of data transmission, reducing the occurrence of audio and video stuttering.

[0063] Optionally, feature extraction is performed on the current original file data packet to generate the current fingerprint data packet encoded with the target audio and video, including:

[0064] S2031. Extract the five-tuple information, data packet sequence number, data packet timestamp, and data packet length from the target audio and video data packet.

[0065] In this embodiment, the five-tuple information, sequence number, and timestamp of the target audio / video data packet are extracted from the target audio / video data packet header. Before transmitting the target audio / video data packet, there may be historical audio / video data packets of the target audio / video encoding that have already been transmitted. The data length of the target audio / video encoding transmitted based on the historical audio / video data packets is calculated.

[0066] The data packet consists of a header and a payload. The header includes the protocol version number, payload type, packet sequence number, packet timestamp, and synchronization source identifier. The 5-tuple information includes the source IP address, source port, destination IP address, destination port, and protocol version number. The packet sequence number identifies the sequence number of the target audio / video data packet sent by the sending device, and increments by 1 for each data packet sent. The receiving device can use the sequence number to detect the loss of target audio / video data packets, reorder the packets, and recover the data. The packet timestamp reflects the sampling time of the first octet of the target audio / video data packet. The receiving device can use the timestamp to calculate latency and jitter, and perform synchronization control.

[0067] S2032. Based on the quintuple information, data packet sequence number, data packet timestamp, and data packet length, determine the current fingerprint feature information corresponding to the target audio / video data packet.

[0068] In this embodiment, the current fingerprint feature information can be understood as the fingerprint feature information determined after feature extraction of the target audio and video data packet, which is the summary information of the target audio and video data packet.

[0069] Specifically, in terms of data storage, different multimedia content corresponds to different lengths and binary content. Since the transmitted target audio and video encoding may contain a large amount of information, the digest information of the transmitted target audio and video encoding is calculated using a preset digest algorithm based on the five-tuple information in the packet header, the packet sequence number, the packet timestamp, and the length of the target audio and video encoding packets transmitted before the target audio and video packet. This digest information is used as a unique fingerprint for each transmission and serves as a correct reference for the current transmitted content.

[0070] The preset digest algorithm can be Cyclic Redundancy Check (CRC), MD5 message digest algorithm, Secure Hash Algorithm (SHA1), SHA256 and related variant algorithms. This embodiment does not limit this.

[0071] It is understandable that in certain situations, encrypted computation can be introduced during the calculation of the digest value of the transmitted content. The computation result can be protected by pre-deployed certificates / signatures or real-time negotiated keys. The specific encryption algorithm can be selected according to the actual computing power and deployment scenario. This embodiment does not limit this.

[0072] S2033. Encapsulate the current fingerprint feature information into a current fingerprint data packet.

[0073] In this embodiment, since the current fingerprint feature information cannot be directly transmitted within the channel, the current fingerprint feature information is encapsulated into a current fingerprint data packet to facilitate information transmission.

[0074] S204. Input the current fingerprint data packet to the original transmission channel via the second interactive network port of the verification channel, and transmit the target audio and video data packet and the current fingerprint data packet through the original transmission channel.

[0075] In this embodiment, after extracting the fingerprint features of the current data packet and generating the current fingerprint data packet, the current fingerprint data packet is transmitted from the verification channel to the original transmission channel through the second interactive network port. Within the original transmission channel, the target audio / video data packet and the current fingerprint data packet are transmitted together. The transmission of the current fingerprint data packet from the verification channel to the original transmission channel through the second interactive network port can be either mirror transmission or direct transmission; this embodiment does not impose any limitations on this.

[0076] S205. During the transmission process through the original transmission channel, generate fingerprint feature information to be verified based on the target audio and video data packets in the verification channel.

[0077] In this embodiment, during the transmission of the target audio / video data packet and the current fingerprint data packet through the original transmission channel, when a verification requirement arises, the target audio / video data packet and the current fingerprint data packet are mirrored from the original transmission channel to the verification channel via the first interactive network port. Within the verification channel, corresponding fingerprint feature information to be verified is generated based on the target audio / video data packet. The steps for generating the fingerprint information to be verified are the same as those for generating the current fingerprint feature information, and will not be described again in this embodiment.

[0078] S206. Compare the current fingerprint feature information in the current fingerprint data packet with the fingerprint feature information to be verified to determine the verification result of the target audio and video encoding.

[0079] In this embodiment, if the target audio and video encoding to be transmitted changes, the corresponding fingerprint feature information related to the transmitted content will also change. Therefore, the current fingerprint feature information in the current fingerprint data packet is compared with the fingerprint feature information to be verified to determine the comparison result. Based on the comparison result, it is determined whether the target audio and video encoding has been tampered with, and the verification result is obtained.

[0080] Optionally, the current fingerprint feature information in the current fingerprint data packet is compared with the fingerprint feature information to be verified to determine the verification result of the target audio / video encoding, including:

[0081] S2061. Compare the current fingerprint feature information in the current fingerprint data packet with the fingerprint feature information to be verified, and determine whether the current fingerprint feature information and the fingerprint feature information to be verified are consistent.

[0082] The current fingerprint feature information in the current fingerprint data packet is compared with the fingerprint feature information to be verified. The comparison result is determined to determine whether the current fingerprint feature information and the fingerprint feature information to be verified are consistent.

[0083] S2062. If so, confirm that the verification result indicates that the target audio / video encoding has not been tampered with.

[0084] In this embodiment, if the comparison result shows that the current fingerprint feature information is consistent with the fingerprint feature information to be verified, it means that the target audio and video encoding in the currently received target audio and video data packet has not been tampered with during transmission.

[0085] S2063. If not, the verification result is determined to be an event of tampering with the target audio / video encoding.

[0086] In this embodiment, if the comparison result shows that the current fingerprint feature information is inconsistent with the fingerprint feature information to be verified, it indicates that the target audio and video encoding in the currently received target audio and video data packet has been tampered with during transmission.

[0087] In this embodiment, the target audio and video data packets corresponding to the target audio and video encoding in a given original transmission channel are obtained; a first interactive network port and a second interactive network port are allocated to the target audio and video data packets to form a verification channel; the current original file data packet is input to the verification channel, and feature extraction is performed on the current original file data packet to generate the current fingerprint data packet of the target audio and video encoding; the current fingerprint data packet is input to the original transmission channel via the second interactive network port of the verification channel, and the target audio and video data packet and the current fingerprint data packet are transmitted through the original transmission channel; during the transmission through the original transmission channel, fingerprint feature information to be verified is generated in the verification channel based on the target audio and video data packet; the current fingerprint feature information in the current fingerprint data packet is compared with the fingerprint feature information to be verified to determine the verification result of the target audio and video encoding. In the above technical solution, data transmission is performed in the original transmission channel, and data packet verification is performed in the verification channel. Mirror transmission of data between the two channels is achieved according to the preset network port, which enables real-time verification of the target audio and video encoding and ensures the consistency of data packet transmission. Therefore, the above scheme can achieve real-time verification of audio and video data through bypass deployment without frame extraction, ensuring the real-time performance and accuracy of audio and video data verification, as well as the smoothness and stability of audio and video data transmission.

[0088] To more clearly explain a data verification method according to an embodiment of the present invention, Figure 3 This is an example illustration of the transmission process involved in a data verification method provided in Embodiment 2 of the present invention, as shown in the diagram. Figure 3 As shown, the receiving end device receives the target audio / video data packet sent by the sending end device, allocates a verification channel for the target audio / video data packet, mirrors the target audio / video data packet from the original transmission channel to the verification channel, extracts features from the target audio / video data packet from the verification channel, and transmits the generated current fingerprint data packet to the original transmission channel along with the target audio / video data packet. When a verification requirement arises, the target audio / video data packet and the current fingerprint data packet are mirrored to the verification channel for verification and the verification result is determined. If the verification result indicates that no tampering event has occurred, no action is taken; if a tampering event occurs along the transmission route, the real-time verification result is determined to indicate that a tampering event has occurred, and an alarm message is reported to the receiving end device.

[0089] Figure 4 This is an example illustration of feature extraction involved in a data verification method provided in Embodiment 2 of the present invention. Figure 4As shown, the target audio and video data packet flows into the original transmission channel. While the target audio and video data packet is being transmitted in the original transmission channel (from port 1 to port 5), the target audio and video data packet is mirrored from the original transmission channel to the verification channel via the first interactive port (mirrored from port 1 to the first interactive port). The fingerprint feature extraction module extracts features to generate the current fingerprint data packet. The current fingerprint data packet is transmitted from the second interactive port to the original transmission channel (from the second interactive port to port 2). The current fingerprint data packet is then transmitted in the original transmission channel (from port 2 to port 5). Finally, the target audio and video data packet and the current fingerprint data packet are transmitted together into the network via port 5.

[0090] Because audio and video data can be transmitted bidirectionally. Figure 5 This is another example illustration of feature extraction involved in a data verification method provided in Embodiment 2 of the present invention. The specific extraction method is the same as... Figure 4 Similarly.

[0091] Figure 6 This is an example illustration of data verification involved in a data verification method provided in Embodiment 2 of the present invention, as shown in the figure. Figure 6 As shown, the target audio / video data packet and the current fingerprint data packet are transmitted in the original transmission channel. Simultaneously, while the target audio / video data packet is being transmitted in the original transmission channel (from port 1 to port 5), the target audio / video data packet and the current fingerprint data packet are mirrored from the original transmission channel to the verification channel via the first interactive port (mirrored from port 1 to the first interactive port). Feature extraction is performed on the target audio / video data packet to generate fingerprint feature information to be verified. The fingerprint feature verification module compares the current fingerprint feature information in the current fingerprint data packet with the fingerprint data information to be verified to determine the verification result of the target audio / video encoding. If the verification result indicates a tampering event, an alarm message is reported to the receiving device. The target audio / video data packet and the current fingerprint data packet continue to be transmitted together into the network via port 5.

[0092] Because audio and video data can be transmitted bidirectionally. Figure 7 This is another example illustration of data verification involved in a data verification method provided in Embodiment 2 of the present invention. The specific verification method is the same as... Figure 6 Similarly.

[0093] Example 3

[0094] Figure 8 This is a schematic diagram of the structure of a data verification device provided in Embodiment 3 of the present invention. Figure 8 As shown, the device includes:

[0095] The data packet acquisition module 31 is used to acquire the target audio and video data packets corresponding to the target audio and video encoding in a given original transmission channel;

[0096] The data packet generation module 32 is used to allocate a verification channel for the target audio and video data packet, and generate the current fingerprint data packet of the target audio and video encoding in the verification channel according to the target audio and video data packet;

[0097] The verification result determination module 33 is used to verify the target audio and video data packet based on the current fingerprint data packet in the verification channel during the data packet transmission through the original transmission channel, and determine the verification result of the target audio and video encoding.

[0098] This technical solution employs a data verification device that uses two channels to separately transmit and verify audio and video data, enabling real-time verification of the audio and video data simultaneously with data transmission. Therefore, this solution achieves real-time verification of audio and video data through a bypass deployment without frame skipping, ensuring the real-time performance and accuracy of the verification, as well as the smoothness and stability of the audio and video data transmission.

[0099] Optionally, the packet generation module 32 includes:

[0100] A verification channel forming unit is used to allocate a first interactive network port and a second interactive network port to the target audio and video data packets to form the verification channel;

[0101] The data packet generation unit is used to input the current original file data packet into the verification channel, and to extract features from the current original file data packet to generate the current fingerprint data packet of the target audio and video encoding.

[0102] Optionally, the data packet generation unit is specifically used to: mirror the target audio and video data packet from the original transmission channel to the verification channel through the first interactive network port.

[0103] Optionally, the packet generation unit is specifically used for:

[0104] Extract the five-tuple information, data packet sequence number, and data packet timestamp from the target audio and video data packet;

[0105] The length of the target audio and video encoding data transmitted before the target audio and video data packet is calculated, and the current digest value of the transmitted target audio and video encoding data is determined.

[0106] The five-tuple information, data packet sequence number, data packet timestamp, transmitted data length, and current digest value are determined as the current fingerprint feature information corresponding to the target audio and video data packet;

[0107] The current fingerprint feature information is encapsulated into a current fingerprint data packet.

[0108] Optionally, the verification result determination module 33 includes:

[0109] The data transmission unit is used to input the current fingerprint data packet to the original transmission channel via the second interactive network port of the verification channel, and to transmit the target audio and video data packet and the current fingerprint data packet through the original transmission channel;

[0110] The feature information generation unit is used to generate fingerprint feature information to be verified based on the target audio and video data packets in the verification channel during the transmission process through the original transmission channel.

[0111] The verification result determination unit is used to compare the current fingerprint feature information in the current fingerprint data packet with the fingerprint feature information to be verified, and determine the verification result of the target audio and video encoding.

[0112] Optionally, the verification result determination unit is specifically used for:

[0113] The current fingerprint feature information in the current fingerprint data packet is compared with the fingerprint feature information to be verified to determine whether the current fingerprint feature information and the fingerprint feature information to be verified are consistent.

[0114] If so, the verification result confirms that the target audio / video encoding has not been tampered with.

[0115] If not, the verification result indicates that the target audio / video encoding has been tampered with.

[0116] Optionally, the device may also include:

[0117] The alarm module is used to generate alarm information and send it to the corresponding receiving device when the verification result indicates that the target audio and video encoding has been tampered with.

[0118] The data verification device provided in this embodiment of the invention can execute a data verification method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method execution.

[0119] Example 4

[0120] Figure 9A schematic diagram of an electronic device 40 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0121] like Figure 9 As shown, the electronic device 40 includes at least one processor 41 and a memory, such as a read-only memory (ROM) 42 or a random access memory (RAM) 43, communicatively connected to the at least one processor 41. The memory stores computer programs executable by the at least one processor. The processor 41 can perform various appropriate actions and processes based on the computer program stored in the ROM 42 or loaded into the RAM 43 from storage unit 48. The RAM 43 may also store various programs and data required for the operation of the electronic device 40. The processor 41, ROM 42, and RAM 43 are interconnected via a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0122] Multiple components in electronic device 40 are connected to I / O interface 45, including: input unit 46, such as keyboard, mouse, etc.; output unit 47, such as various types of monitors, speakers, etc.; storage unit 48, such as disk, optical disk, etc.; and communication unit 49, such as network card, modem, wireless transceiver, etc. Communication unit 49 allows electronic device 40 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0123] Processor 41 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 41 performs the various methods and processes described above, such as a data verification method.

[0124] In some embodiments, a data verification method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 40 via ROM 42 and / or communication unit 49. When the computer program is loaded into RAM 43 and executed by processor 41, one or more steps of the data verification method described above may be performed. Alternatively, in other embodiments, processor 41 may be configured to perform a data verification method by any other suitable means (e.g., by means of firmware).

[0125] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0126] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0127] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0128] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0129] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0130] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0131] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0132] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A data verification method, characterized in that, include: Obtain the target audio and video data packets corresponding to the target audio and video encoding in a given original transmission channel; A first interactive network port and a second interactive network port are allocated to the target audio and video data packets to form a verification channel; The current original file data packet is input into the verification channel, and features are extracted from the current original file data packet to generate the current fingerprint data packet of the target audio and video encoding; The current fingerprint data packet is input to the original transmission channel via the second interactive network port of the verification channel, and the target audio and video data packet and the current fingerprint data packet are transmitted through the original transmission channel; During the transmission through the original transmission channel, when a verification requirement is generated, the target audio and video data packet and the current fingerprint data packet are mirrored from the original transmission channel to the verification channel through the first interactive network port, and fingerprint feature information to be verified is generated in the verification channel based on the target audio and video data packet. The current fingerprint feature information in the current fingerprint data packet is compared with the fingerprint feature information to be verified to determine the verification result of the target audio and video encoding.

2. The method according to claim 1, characterized in that, The step of inputting the current original file data packet to the verification channel includes: The target audio and video data packets are mirrored from the original transmission channel to the verification channel through the first interactive network port.

3. The method according to claim 1, characterized in that, The step of extracting features from the current original file data packet to generate the current fingerprint data packet of the target audio and video encoding includes: Extract the five-tuple information, data packet sequence number, data packet timestamp, and data packet length from the target audio and video data packet; Based on the quintuple information, data packet sequence number, data packet timestamp, and data packet length, determine the current fingerprint feature information corresponding to the target audio and video data packet; The current fingerprint feature information is encapsulated into a current fingerprint data packet.

4. The method according to claim 1, characterized in that, The step of comparing the current fingerprint feature information in the current fingerprint data packet with the fingerprint feature information to be verified to determine the verification result of the target audio and video encoding includes: The current fingerprint feature information in the current fingerprint data packet is compared with the fingerprint feature information to be verified to determine whether the current fingerprint feature information and the fingerprint feature information to be verified are consistent. If so, the verification result confirms that the target audio / video encoding has not been tampered with. If not, the verification result indicates that the target audio / video encoding has been tampered with.

5. The method according to claim 1, characterized in that, Also includes: When the verification result indicates that the target audio / video encoding has been tampered with, an alarm message is generated and sent to the corresponding receiving device.

6. A data verification device, characterized in that, include: The data packet acquisition module is used to acquire the target audio and video data packets corresponding to the target audio and video encoding in a given original transmission channel; A data packet generation module is used to allocate a verification channel for the target audio and video data packet, and generate the current fingerprint data packet of the target audio and video encoding in the verification channel according to the target audio and video data packet; The verification result determination module is used to verify the target audio and video data packet based on the current fingerprint data packet in the verification channel during the data packet transmission through the original transmission channel, and determine the verification result of the target audio and video encoding. The data packet generation module includes: A verification channel forming unit is used to allocate a first interactive network port and a second interactive network port to the target audio and video data packets to form the verification channel; The data packet generation unit is used to input the current original file data packet into the verification channel, and to extract features from the current original file data packet to generate the current fingerprint data packet of the target audio and video encoding; The verification result determination module includes: The data transmission unit is used to input the current fingerprint data packet to the original transmission channel via the second interactive network port of the verification channel, and to transmit the target audio and video data packet and the current fingerprint data packet through the original transmission channel; The feature information generation unit is used to, during the transmission process through the original transmission channel, when a verification requirement is generated, mirror the target audio and video data packet and the current fingerprint data packet from the original transmission channel to the verification channel through the first interactive network port, and generate fingerprint feature information to be verified based on the target audio and video data packet in the verification channel; The verification result determination unit is used to compare the current fingerprint feature information in the current fingerprint data packet with the fingerprint feature information to be verified, and determine the verification result of the target audio and video encoding.

7. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform a data verification method according to any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute a data verification method according to any one of claims 1-5.

Citation Information

Patent Citations

  • Audio video protecting method and audio video terminal

    CN103686333A

  • Audio and video detection method and device, electronic equipment and storage medium

    CN114842882A