Audiovisual content acquisition equipment, verification terminals and systems

Abstract

The present application discloses an audio-visual content acquisition device and a processing method for the acquisition device when acquiring audio-visual content, and also discloses a corresponding verification terminal and verification method. Among them, a device digital certificate and a corresponding device private key are pre-set in the acquisition device, and the device digital certificate is used to uniquely identify the identity of the acquisition device. The processing unit of the acquisition device can extract the basic unit in the audio-visual data, calculate the hash value corresponding to the basic unit, and when the basic unit is a key unit, use the device private key to calculate the signature corresponding to the key unit. The calculated original data includes the basic unit and the hash value corresponding to the previous basic unit of the basic unit. With this solution, the authenticity of the original acquisition device is guaranteed, and the acquired audio-visual content has strong anti-tampering capabilities and good verifiability. The verification terminal can verify the authenticity of the complete audio-visual content or its fragments, ensuring that the audio-visual content is authentic and reliable.

Description

Technical Field

[0001] The present application relates to the field of audiovisual content processing technology, and more particularly to an audiovisual content acquisition device and a corresponding verification terminal. In addition, the present application also relates to a system including the acquisition device and verification terminal. Background Art

[0002] With the rapid development of artificial intelligence (AI) technology, especially the application of deep learning and generative adversarial networks (GANs), AI can now generate highly realistic video, audio, and other audio-visual content. This non-realistic audio-visual content can be used to spread false information, mislead public opinion, or even be used for illegal activities such as fraud.

[0003] Traditional video and audio authenticity verification primarily relies on file timestamp-based technologies and basic digital watermarking. While these technologies can verify the authenticity of audiovisual content to a certain extent, they can still be circumvented or forged. Furthermore, these technologies struggle to handle highly realistic AI-generated content, making it difficult for users to discern and prevent it.

[0004] Currently, there are solutions that use cryptographic signature technology to protect audiovisual content such as video and audio. These solutions typically use the creator's or copyright holder's private key to sign the entire audiovisual content, ensuring its integrity and authenticity. However, in some application scenarios, the verifier may only have access to a partial video or audio clip, not the entire signed video or audio. In this case, it is difficult to verify the authenticity of this partial clip. Summary of the Invention

[0005] One purpose of the present application is to provide an audiovisual content acquisition device and a processing method for the acquisition device when acquiring audiovisual content, as well as a corresponding verification terminal and verification method. When the acquisition device is used to acquire audiovisual content, the audiovisual content has strong tamper-proof capabilities and good verifiability. Both the entire audiovisual content and fragments thereof can be verified by the verification terminal, ensuring the authenticity and reliability of the audiovisual content or fragments thereof.

[0006] A first aspect of the present application provides an audiovisual content acquisition device, wherein a device digital certificate and a corresponding device private key are pre-set in the acquisition device, wherein the device digital certificate is used to uniquely identify the identity of the acquisition device; the acquisition device includes an acquisition unit and a processing unit, wherein:

[0007] The acquisition unit is used to collect audio-visual data;

[0008] The processing unit is used to: extract the basic unit from the audio-visual data; calculate the hash value corresponding to the basic unit, wherein the original data used to calculate the hash value includes: the basic unit, and the hash value corresponding to the previous basic unit of the basic unit; when the basic unit is a key unit, use the device private key to calculate the signature corresponding to the key unit, wherein the original data used to calculate the signature includes the key unit and the hash value corresponding to the previous basic unit of the key unit; store the basic unit and the corresponding hash value, and, when the basic unit is the key unit, store the signature corresponding to the key unit.

[0009] In combination with the first aspect, in a possible implementation manner, the processing unit is further used to: embed a hash value corresponding to the basic unit into the basic unit or metadata of the basic unit.

[0010] In combination with the first aspect, in a possible implementation manner, the processing unit is further used to: embed the signature corresponding to the key unit into the basic unit or the metadata of the basic unit.

[0011] In combination with the first aspect, in a possible implementation, the processing unit is further used to: store the hash value corresponding to the basic unit and / or the signature corresponding to the key unit in an independent file.

[0012] With reference to the first aspect, in one possible implementation, the processing unit is further configured to:

[0013] In the case where the basic unit is the first basic unit in the audio-visual data, the original data used to calculate the hash value includes: the first basic unit and a preset initial value.

[0014] In combination with the first aspect, in a possible implementation, the processing unit is further configured to: when the basic unit is the first basic unit in the audio-visual data, the original data used to calculate the hash value includes: the first basic unit and a preset initial value.

[0015] In combination with the first aspect, in a possible implementation method, when the collected audio-visual data includes video data, the basic unit is a video clip or video frame extracted according to a first preset rule, and the key unit is a key video segment or key frame selected from the video according to a second preset rule.

[0016] In combination with the first aspect, in a possible implementation method, when the collected audio-visual data includes audio data, the basic unit is an audio clip or audio frame extracted according to a third preset rule; the key unit is a key audio segment or key frame selected from the audio according to a fourth preset rule.

[0017] In combination with the first aspect, in a possible implementation manner, the acquisition device includes a security chip, and the device private key is stored in the security chip.

[0018] In combination with the first aspect, in a possible implementation, the acquisition device is further used to: divide at least one first segment from the stored audio-visual content, each first segment includes at least two consecutive basic units, and the at least two basic units include at least one key unit; send the at least one first segment and corresponding first verification data, wherein the first verification data includes the hash values ​​corresponding to the at least two basic units and the signature corresponding to at least one key unit.

[0019] A second aspect of the present application provides a verification terminal for audio-visual content, the verification terminal being used to: obtain a second segment to be verified in the audio-visual content and corresponding second verification data, the second segment including at least two basic units, the at least two basic units including at least one key unit, the second verification data including hash values ​​corresponding to the at least two basic units, and a signature corresponding to at least one key unit; verify the signature corresponding to at least one key unit using the device public key of the acquisition device; verify the hash value corresponding to each basic unit except the first basic unit in the second segment respectively; and determine that the second segment is an audio-visual content segment originally acquired and unmodified by the acquisition device when all hash values ​​and signatures are verified.

[0020] In combination with the second aspect, in a possible implementation, the verification end is further configured to: when at least one of all hash values ​​and the signature fails verification, generate prompt information to indicate that the second segment is a non-original audio-visual content segment.

[0021] In combination with the second aspect, in a possible implementation, the verification end is a server or a client.

[0022] A third aspect of the present application provides an audiovisual content acquisition and verification system, comprising any possible acquisition device of the first aspect and any possible verification terminal of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 The following is a schematic diagram of the system architecture of an exemplary application scenario of this application.

[0024] Figure 2 This is a flowchart of an exemplary method executed by a processing unit in an acquisition device according to an embodiment of the present application.

[0025] Figure 3 A schematic diagram of exemplary audio-visual data and its corresponding hash value and signature according to an embodiment of the present application.

[0026] Figure 4 The figure is a flowchart of an exemplary verification method performed by the verification terminal in an embodiment of the present application.

[0027] Figure 5 This is a schematic diagram of an exemplary audio-visual content segment to be verified and corresponding verification data in an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to clearly and completely describe the technical solution of the present application, further explanation will be given below in conjunction with embodiments and drawings.

[0029] In addition to the aforementioned scheme of signing the entire audiovisual content, other schemes can also sign audiovisual content such as video and audio in segments or frame by frame, thereby ensuring that every segment or frame in the audiovisual content is authentic and reliable. However, this scheme still has some drawbacks in its application. For example, when certain segments or frames in the audiovisual content are deleted, the information expressed by the audiovisual content may have changed. If the signature of each remaining segment or frame in the audiovisual content is verified, it can be verified successfully. In other words, this method cannot determine whether some segments or frames of the audiovisual content have been deleted. In particular, in some cases, the verifier may only have access to a portion of the audiovisual content. It is impossible to verify the entire signature of the audiovisual content (since the entire signature is not available, verification of the entire signature will inevitably fail), nor can it detect deletion issues by signing each segment or frame.

[0030] To this end, the embodiments of the present application propose an audiovisual content acquisition device and a processing method for the acquisition device when acquiring audiovisual content, and also propose a corresponding verification terminal and verification method. With this solution, the authenticity of the original acquisition device is guaranteed, and the acquired audiovisual content has strong anti-tampering capabilities and good verifiability, which can ensure that the audiovisual content is authentic and reliable. However, highly simulated audiovisual content generated by AI, or modified audiovisual content, does not have such verifiability and is therefore easier to detect.

[0031] The following will first introduce the system architecture of an exemplary application scenario in which this solution can be applied, then explain the acquisition device and its processing process when acquiring audio-visual content, and then explain the verification end and its processing process when verifying audio-visual content.

[0032] See also Figure 1 ,The system may include an audiovisual content acquisition device and a verification terminal, and in some cases may also include other physical and / or virtual devices, such as Figure 1 The terminal and server shown, etc.

[0033] An acquisition device is an electronic device with acquisition and processing capabilities, such as a camera, a voice recorder, an intelligent monitor, or a mobile phone, tablet computer, wearable device, augmented reality (AR) / virtual reality (VR) device with acquisition and processing capabilities. This application does not limit the specific product form / type of the acquisition device.

[0034] The acquisition device is primarily used to capture audiovisual content from the real world, such as capturing video, recording audio, and recording the changes in the device interface as the user operates the device (which can also be understood as a type of video). Of course, in addition to capturing video and audio, the acquisition device can also be used to capture other forms of content, such as photos, etc., and this application does not limit this. It is understood that the acquisition device can simultaneously capture multiple audiovisual contents at the same time, or it can capture a single type of audiovisual content, and this application does not limit this either.

[0035] The collection device is pre-installed with a device digital certificate and a corresponding device private key. In some implementations, in order to identify the identity of each collection device and to enable verification, a pair of device keys can be generated for each collection device. The device key uses an asymmetric key and includes a corresponding device private key SK and a device public key PK. A trusted certificate authority (CA) then issues a digital certificate for the collection device based on the device public key PK, namely a device digital certificate, which can be used to uniquely identify the identity of the collection device. The device digital certificate and the corresponding device private key SK are embedded in the collection device for subsequent use. Exemplarily, the device digital certificate and the corresponding device private key can be embedded before the collection device leaves the factory.

[0036] In some implementations, the acquisition device may include a security chip, in which the device private key may be stored to prevent unauthorized access. The device digital certificate may be stored in the security chip or other storage space on the acquisition device and may be transferred to other devices when necessary.

[0037] After the audiovisual data collected by the acquisition device is processed, it can form audiovisual content. The audiovisual content or part of it may be transmitted to other devices (such as Figure 1 The terminal or server may directly or indirectly send the acquired audiovisual content or a portion thereof to the verification terminal, requesting the verification terminal to verify its authenticity. It is understood that in some cases, the acquisition device may also send the audiovisual content or a portion thereof to the verification terminal itself, and this application does not limit this.

[0038] The verification end in the embodiments of the present application can be developed as a server and deployed in a server, or developed as a client and deployed on other possible electronic devices. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server or cloud computing service center that provides cloud services, cloud databases, cloud computing, cloud storage, network services, cloud communications, middleware services, security services, content distribution services, big data and artificial intelligence platforms and other cloud computing services. It can also be a combination of physical servers and cloud servers. Other electronic devices can be terminal devices with verification capabilities, etc. This application does not limit the specific product form of servers and other electronic devices.

[0039] The following will take the processing process of the acquisition device when acquiring a certain audio-visual content as an example to further explain the processing process of the acquisition device and the functions it can achieve.

[0040] In some implementations, the acquisition device may include an acquisition unit and a processing unit. The acquisition unit is mainly used to acquire audio-visual data, and may be, for example, a camera module, a microphone module, etc., and transmit the acquired audio-visual data to the processing unit for processing. It is understood that the acquisition unit may transfer the data stream (such as a video stream or an audio stream) to the processing unit for processing while acquiring, or may acquire a relatively complete audio-visual data set or data packet and then process it by the processing unit. This application does not limit this.

[0041] See also Figure 2 , Figure 2 This is a flowchart of an exemplary method executed by a processing unit in an embodiment of the present application. The method includes at least steps S101 to S104.

[0042] S101: extracting basic units from audio-visual data.

[0043] The basic unit is the basic processing unit for performing hash operations and signatures in the embodiments of the present application. For an audiovisual content, it can be divided into multiple basic units with a sequence. For example, for video, each video frame can be used as a basic unit. For audio, each small audio segment can be used as a basic unit. It is understandable that for an audiovisual content, the division of its basic units can be uniform or uneven, and can include one or more division methods. This application does not limit this, as long as it can eventually form a complete audiovisual content.

[0044] The audio-visual data here can be a data stream collected by the collection unit and transmitted to the processing unit, or it can be data of a relatively complete audio-visual content, which is not limited in this application.

[0045] The method of extracting basic units from audio-visual data may adopt different methods according to the type and format of the audio-visual data.

[0046] In some implementations, when the audiovisual content includes a video, video frames or video clips can be extracted from the video according to a first preset rule and used as basic units. For example, the first preset rule can be configured to extract frame by frame, or extract every preset number of frames (e.g., every 12 frames), or extract every preset time length (e.g., 1 second).

[0047] In some implementations, when the audio-visual content includes audio, audio segments or audio frames extracted from the audio according to a third preset rule can be used as basic units. Audio frames usually divide the audio signal into time windows of fixed size. Common audio frame sizes depend on application requirements, and a time window of 20-40 milliseconds is usually used. The number of samples corresponding to each window is determined by the sampling rate of the audio. Exemplarily, the audio frames can be extracted using a sliding window method to divide the audio signal into frames by a fixed time length or number of samples. Exemplarily, the third preset rule can be configured to extract audio frames one by one, or to extract audio segments every other preset time length (e.g., 1s).

[0048] It is understandable that during extraction, information such as a number or a timestamp may be recorded for each extracted basic unit to record the order of different basic units, and to facilitate identification of adjacent basic units before and after different basic units when needed.

[0049] It can also be understood that when the audiovisual content contains multiple different types of data such as audio and video, each can be processed separately, that is, the basic units are extracted to calculate the hash value, and the key units are signed and stored separately.

[0050] S102, calculating the hash value corresponding to the basic unit.

[0051] The original data used to calculate the hash value includes: the current basic unit and the hash value corresponding to the previous basic unit of the basic unit.

[0052] For example, Figure 3 As shown, assuming that the acquisition unit captures a segment of video data, the processing unit extracts the basic units in the video data, for example, the currently extracted basic unit is D(i), and then calculates the hash value H(i) corresponding to D(i). Using the hash value H(i-1) corresponding to the previous basic unit D(i-1) of D(i) and D(i) as the original data, a hash operation is performed to obtain the hash value H(i). That is, H(i) = Hash(D(i)||H(i-1)).

[0053] The processing unit can then process the next extracted basic unit D(i+1) and calculate the hash value H(i+1) corresponding to D(i+1) = Hash(D(i+1)||H(i)). Similarly, the hash value corresponding to each basic unit can be calculated separately.

[0054] It should be noted that when the basic unit is the first basic unit D(0) in the audiovisual data, since there is no previous basic unit, a preset data can be used instead. That is, in this case, the original data used to calculate the hash value H(0) corresponding to the basic unit includes: the first basic unit D(0) and the preset initial value Initial_Value, H(0) = Hash(D(0)||Initial_Value).

[0055] For example, the preset initial value can be a fixed value, such as 0 or other fixed values, or can be assigned a variable value according to certain rules. This application does not limit the specific value-taking method and value of the preset initial value.

[0056] S103: When the basic unit is a key unit, a signature corresponding to the key unit is calculated using the device private key.

[0057] It is understandable that the key unit itself is also a basic unit, which is screened out from the basic units according to certain rules, and there are many ways to screen it.

[0058] In some implementations, when the collected audiovisual data includes video data, key video segments or key frames can be selected from the basic units of the video data according to a second preset rule. For example, when the first preset rule is configured to extract basic units frame by frame, a key frame of the video, such as an I-frame (Intra Frame), can be used as the key unit.

[0059] In some implementations, when the collected audiovisual data includes audio data, key audio segments or key frames may be selected from the basic units of the audio data according to a fourth preset rule. For example, when the third preset rule is configured to extract audio segments as basic units, one audio segment may be selected as a key audio segment for every certain number (e.g., five) of audio segments.

[0060] For a key unit, in addition to calculating its corresponding hash value, the device private key is also used to calculate its corresponding signature. The original data used for the signature includes the key unit and the hash value corresponding to the previous basic unit. For example, Figure 3 As shown, assuming that D(i) can be determined to be a key unit according to the second preset rule, the device private key SK is used to sign D(i) and H(i-1) to obtain the signature S(i). That is, S(i) = Sign_SK(D(i)||H(i-1)).

[0061] S104: Store the basic unit and the corresponding hash value, and if the basic unit is a key unit, store the signature corresponding to the key unit.

[0062] The hash value corresponding to the basic unit and the signature corresponding to the key unit can be stored in multiple ways. This application does not limit the specific storage method. It only needs to be stored so that it can be used for subsequent verification.

[0063] In some implementations, the hash value corresponding to the basic unit may be embedded in the corresponding basic unit, or embedded in the metadata of the corresponding basic unit.

[0064] In some implementations, the hash values ​​corresponding to all basic units may also be stored in an independent file (referred to as the first file for ease of distinction).

[0065] In some implementations, the signature corresponding to the key unit may be embedded in the corresponding key unit, or embedded in the metadata of the corresponding key unit.

[0066] In some implementations, the signatures corresponding to all key units may also be stored in a separate file (referred to as a second file for ease of distinction). It is understood that when all hash values ​​and all signatures are stored in separate files, the first file and the second file may be different files or the same file, and this application does not limit this.

[0067] It is understandable that the above steps S101 to S104 describe the processing process of the processing unit on one of the basic units, and the processing process on other basic units is similar. When the acquisition unit completes the acquisition of a whole segment of audio-visual data and the data is processed by the processing unit, a whole segment of complete audio-visual content is stored. For example, Figure 3 As shown, assuming that the entire video includes n basic units, m of which are key units, the entire audio-visual content includes n basic units, the hash values ​​corresponding to each of the n basic units, and the signatures corresponding to m of the key units.

[0068] Optionally, the acquisition device may store the audiovisual content acquired in the aforementioned manner locally or in a possible location such as the cloud, or may directly or indirectly transmit the audiovisual content or a fragment thereof (referred to as a first fragment in this embodiment for ease of distinction) and corresponding verification data (referred to as first verification data in this embodiment for ease of distinction). It is understood that the first fragment includes at least two consecutive basic units, each of which includes one or more key units.

[0069] It should be noted that when the first fragment includes multiple key units, the first verification data may include the signature of any one of the key units, or may include the signatures corresponding to any several or all of the key units, and this application does not limit this.

[0070] In this way, the source of each key unit and its previous basic unit in the audio-visual content is guaranteed to be credible through the device private key signature, and the hash values ​​of the key unit and the previous basic unit are prevented from being forged or illegally tampered with. At the same time, by calculating the hash value corresponding to each basic unit, a chain relationship is established between adjacent basic units in the entire audio-visual content. Any tampering with a single basic unit will destroy the chain relationship, resulting in failure to pass verification. Therefore, regardless of whether the audio-visual content to be verified is an entire complete content or a fragment of it, as long as it includes at least one key unit, it is possible to verify whether the source of the fragment is authentic, whether it has been tampered with or forged, and whether any frame or fragment has been deleted. Its authenticity and integrity can be well verified.

[0071] The following will take the verification process of a certain audio-visual content or a certain segment thereof as an example to further explain the processing process of the verification end and the functions it can achieve. Figure 4 , Figure 4 This is a flow chart of an exemplary verification method performed by a verification terminal according to an embodiment of the present application. The method includes at least steps S201 to S204.

[0072] S201: Acquire a second segment to be verified in audio-visual content and corresponding second verification data.

[0073] The audiovisual content collected by the acquisition device may flow through different devices and / or networks. No matter how it flows, how many times it flows, or whether it is further edited during the flow (for example, new segments are cut out from it), it can be sent to the verification end to verify its authenticity and the integrity of the segments.

[0074] For ease of distinction and explanation, in the embodiments of the present application, the segment to be verified obtained by the verification terminal is referred to as the second segment, and the corresponding verification data is referred to as the second verification data. The second segment can be the entire audiovisual content or a portion thereof. In some implementations, the second segment can be the aforementioned first segment or a portion thereof, or a segment of the audiovisual content that is different from the first segment.

[0075] The second segment includes at least two basic units, at least one of which is a key unit. The second verification data includes the hash value corresponding to each basic unit in the second segment and the signature corresponding to at least one key unit in the second segment. For example, see Figure 5 , where the second fragment includes four basic units from D'(i-2) to D'(i+1), where D'(i) is the key unit, and its corresponding second verification data includes four hash values ​​from H(i-2) to H(i+1) and the signature S(i).

[0076] It should be noted that, similar to the first verification data, when the second fragment includes multiple key units, the second verification data may include the signature of any one of the key units, or may include the signatures corresponding to any or all of the key units, and this application does not limit this. The second verification data can be embedded in the corresponding basic unit or its metadata, or can be stored separately in an independent file (such as the aforementioned first file and / or second file). Please refer to the aforementioned related description and will not be repeated here.

[0077] S202: Use the device public key of the acquisition device to verify the signature corresponding to at least one key unit.

[0078] When signatures corresponding to multiple key units are included, each signature can be verified separately using the device public key of the acquisition device, or any one or several signatures can be verified.

[0079] Use the device public key of the acquisition device to verify the signature corresponding to a key unit, which is corresponding to the signing process. Figure 5Taking the verification of signature S(i) as an example, when signing, hash operations are performed on the original data D(i) and H(i-1), and encrypted using the device private key SK to obtain S(i). Accordingly, when verifying the signature, the device private key PK can be used to decrypt S(i) to obtain decrypted data; hash operations are performed on the original data D'(i) and H(i-1) to obtain calculated data; the decrypted data and calculated data are compared. If the two are consistent, the signature S(i) is verified. If they are inconsistent, the signature S(i) fails verification. The verification of S(i) indicates that the key unit D'(i) in the second fragment to be verified is consistent with the corresponding key unit D(i) during the original collection and processing of the acquisition device, that is, D'(i) is indeed from the acquisition device and has not been modified during the circulation process. It is authentic and trustworthy, and the hash value H(i-1) in the second verification data is also authentic and trustworthy.

[0080] S203 , respectively verifying the hash value corresponding to each basic unit except the first basic unit in the second segment.

[0081] For example, see Figure 5 Taking the hash value corresponding to D'(i) as an example, a hash operation is performed on D'(i) and H(i-1) as the original data to obtain H'(i). If H'(i) is consistent with H(i) in the second verification data, the hash value corresponding to the basic unit D'(i) is verified. This indicates that H(i) in the second verification data is authentic.

[0082] The same logic is applied to the original data D'(i+1) and H(i), and the hash operation is performed to obtain H'(i+1). If H'(i+1) is consistent with H(i+1) in the second verification data, the hash value corresponding to the basic unit D'(i) is verified to be authentic. Since the previous verification can prove that H(i) is authentic, it is now confirmed that D'(i+1) and H(i+1) are also authentic.

[0083] Similarly, using D'(i-1) and H(i-2) as the original data, a hash operation is performed to obtain H'(i-1). If H'(i-1) is consistent with H(i-1) in the second verification data, then the hash value H'(i-1) corresponding to the basic unit D'(i-1) has passed verification. Since the previous signature verification shows that the hash value H(i-1) is authentic, this verification also proves that D'(i-1) and H(i-2) are authentic.

[0084] If the second segment includes other basic units before and after, the verification method can be deduced in the same way as above.

[0085] In the application embodiments, there is no limitation on the order of verifying the signature and verifying each hash value.

[0086] S204 : If both the hash value and the signature are verified, determine that the second segment is an audio-visual content segment originally captured by the capture device and has not been modified.

[0087] S205 : When at least one of all the hash values ​​and the signatures fails verification, generate prompt information to indicate that the second segment is not the original audio-visual content segment.

[0088] If a key unit of an audiovisual content segment has been modified, it cannot pass the corresponding signature verification. If a key unit is not collected by the original collection device, it cannot pass the corresponding signature verification. If the basic unit of a non-key unit has been modified, or an intermediate basic unit has been deleted, for example, the aforementioned D'(i-1) segments have been deleted, it cannot pass the corresponding hash value verification. It can be seen that the above-mentioned verification method can effectively detect the aforementioned non-authenticity or incompleteness of the audiovisual content or its segments, and video segments generated by AI or modified by AI can naturally be detected. Therefore, the above-mentioned scheme can effectively help users distinguish the authenticity of audiovisual content.

[0089] The present application also provides a system in an embodiment, including any possible acquisition device and any possible verification terminal as described above. The system can be applied in a variety of different scenarios.

[0090] For example, in the context of news media content recording and publishing, journalists can use the aforementioned cameras (i.e., acquisition devices) to record video and audio. After recording, the corresponding files can be directly uploaded to the news organization's content management system. This content can be published and disseminated in its entirety or in fragments. The public and news organizations can use the verification terminal to confirm the authenticity and integrity of the video and audio, ensuring the credibility of the news content and preventing the spread of false information.

[0091] As another example, in the application scenario of intelligent traffic monitoring, traffic monitoring equipment (i.e., data collection equipment) is deployed at traffic intersections to monitor and collect vehicle behavior and traffic violations. When traffic violation records need to be submitted to law enforcement agencies or for objection processing, verification can be performed through the verification terminal to confirm the authenticity of the video and audio collected by the monitoring equipment, preventing the violation records from being maliciously tampered with.

[0092] In addition, the system can also be used in application scenarios such as remote examination invigilation, law enforcement or judicial on-site evidence collection, and remote meeting recording.

[0093] Those skilled in the art will appreciate that the methods performed by the processing unit and verification terminal provided in the embodiments of the present application can also be provided as a computer-readable storage medium. This can take the form of a completely software embodiment, or an embodiment combining software and hardware. That is, the embodiments of the present application also provide a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform some or all of the steps in any of the implementations of the aforementioned processing method or verification method.

[0094] The present application may also take the form of a computer program product embodied in one or more computer-readable storage mediums having computer-usable program code embodied therein.

[0095] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0096] It should be understood that in the various embodiments of the present application, the execution order of each step should be determined by its function and internal logic. The size of the sequence number of each step does not mean the order of execution and does not constitute any limitation on the implementation process of the embodiment.

[0097] It should also be understood that, in order to clearly describe the technical solutions of the embodiments of the present application, the words "first" and "second" are used in the embodiments of the present application to distinguish between identical or similar items with substantially the same functions and effects, or concepts with certain differences. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity or execution order, and the words "first" and "second" do not necessarily mean different.

[0098] The same or similar parts between the various embodiments in this specification can be referred to each other. As long as there is no logical contradiction, different embodiments can be combined with each other.

Claims

1. An audio-visual content acquisition device, characterized in that: The acquisition device is pre-installed with a device digital certificate and a corresponding device private key, and the device digital certificate is used to uniquely identify the identity of the acquisition device; the acquisition device includes an acquisition unit and a processing unit, wherein: The acquisition unit is used to collect audio-visual data; The processing unit is used for: Extracting basic units from the audio-visual data; the basic units are audio-visual segments or frames extracted from the audio-visual data according to preset rules; Calculating a hash value corresponding to the basic unit, wherein, if the basic unit is the first basic unit in the audio-visual data, the original data used to calculate the hash value includes: the first basic unit and a preset initial value; if the basic unit is not the first basic unit in the audio-visual data, the original data used to calculate the hash value includes: the basic unit and the hash value corresponding to the previous basic unit of the basic unit; When the basic unit is a key unit, calculating a signature corresponding to the key unit using the device private key, wherein the original data used to calculate the signature includes the key unit and a hash value corresponding to a basic unit preceding the key unit; the key unit is obtained by screening from the basic units of the audio-visual data according to another preset rule; The basic unit and the corresponding hash value are stored, and when the basic unit is the key unit, the signature corresponding to the key unit is stored.

2. The acquisition device according to claim 1, characterized in that The processing unit is further configured to: embedding the hash value corresponding to the basic unit into the basic unit or the metadata of the basic unit; or, Embedding the signature corresponding to the key unit into the basic unit or the metadata of the basic unit; or, The hash value corresponding to the basic unit and / or the signature corresponding to the key unit are stored in an independent file.

3. The acquisition device according to any one of claims 1 to 2, characterized in that: In the case where the collected audiovisual data includes video data, the basic unit is a video clip or video frame extracted according to a first preset rule, and the key unit is a key video segment or key frame selected from the video according to a second preset rule; and / or, When the collected audio-visual data includes audio data, the basic unit is an audio segment or audio frame extracted according to a third preset rule; the key unit is a key audio segment or key frame selected from the audio according to a fourth preset rule.

4. The acquisition device according to any one of claims 1 to 2, characterized in that: The acquisition device includes a security chip, and the device private key is stored in the security chip.

5. The acquisition device according to any one of claims 1 to 2, characterized in that: The acquisition device is also used for: Dividing at least one first segment from the stored audiovisual content, each of the first segments includes at least two consecutive basic units, and the at least two basic units include at least one key unit; The at least one first fragment and corresponding first verification data are sent, wherein the first verification data includes hash values ​​corresponding to each of the at least two basic units and a signature corresponding to at least one key unit.

6. The acquisition device according to claim 3, characterized in that: The acquisition device is also used for: Dividing at least one first segment from the stored audiovisual content, each of the first segments includes at least two consecutive basic units, and the at least two basic units include at least one key unit; The at least one first fragment and corresponding first verification data are sent, wherein the first verification data includes hash values ​​corresponding to each of the at least two basic units and a signature corresponding to at least one key unit.

7. A verification terminal for audio-visual content, characterized in that: The verification terminal is used to: Obtaining a second segment to be verified in the audiovisual content and corresponding second verification data, where the second segment includes at least two basic units, the at least two basic units include at least one key unit, and the second verification data includes hash values ​​corresponding to the at least two basic units and a signature corresponding to the at least one key unit; Verifying the signature corresponding to at least one key unit using the device public key of the acquisition device; wherein the data used to verify the signature corresponding to the key unit includes: the key unit and the hash value corresponding to the basic unit before the key unit; Verifying the hash value corresponding to each basic unit in the second segment except the first basic unit, wherein the data used to verify the hash value corresponding to the basic unit includes: the basic unit and the hash value corresponding to the previous basic unit of the basic unit; When the verification of all hash values ​​and signatures is passed, it is determined that the second segment is an audio-visual content segment originally captured by the capture device and has not been modified.

8. The verification terminal according to claim 7, characterized in that: The verification terminal is further used to: If at least one of all hash values ​​and the signature fails verification, prompt information is generated to indicate that the second segment is a non-original audio-visual content segment.

9. The verification terminal according to claim 7, characterized in that: The verification end is a server or a client.

10. An audio-visual content collection and verification system, comprising the collection device according to any one of claims 1 to 6, and the verification terminal according to any one of claims 7 to 9.

Images