Metadata generation method, recognition method, and electronic device
A metadata generation and recognition method for AIGC using identifiers, hash values, and digital signatures addresses the challenge of AIGC authenticity, enhancing user verification and reliability.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2024-02-28
- Publication Date
- 2026-07-17
AI Technical Summary
The authenticity and reliability of artificial intelligence-generated content (AIGC) are compromised, leading to potential misinformation and the need for effective recognition methods to determine the origin and integrity of such content.
A metadata generation method that includes an AIGC identifier in the metadata of media content, utilizing hash values and digital signatures to ensure authenticity and integrity, along with a recognition method to determine if content is AIGC based on these identifiers.
Enhances user vigilance and enables accurate determination of AIGC, allowing for verification of copyright, personal information, and misinformation, thereby improving the reliability of media content usage.
Smart Images

Figure 2026524092000001_ABST
Abstract
Description
Technical Field
[0001] This application claims the priority of Chinese Patent Application No. 202310675278.8, titled "METADATA GENERATION METHOD, RECOGNITION METHOD, AND ELECTRONIC DEVICE", filed with the National Intellectual Property Administration on June 8, 2023. Chinese Patent Application No. 202310675278.8 is incorporated herein by reference in its entirety.
[0002] Embodiments of this application relate to the field of data processing, and more particularly, to a metadata generation method, a recognition method, and an electronic device.
Background Art
[0003] With the development of artificial intelligence (AI) technology, artificial intelligence generated content (AIGC) has been developing explosively. AIGC can create new, interesting, and diverse digital contents (such as images, music, and natural language) to meet different user preferences and scenarios.
[0004] However, AI generation may affect the authenticity, reliability, etc. of information. For example, misinformation may be spread using AIGC. Therefore, it is important to recognize AIGC.
Summary of the Invention
Means for Solving the Problems
[0005] To help users recognize whether media content is AIGC, this application provides a metadata generation method, a recognition method, and an electronic device. Metadata generated by using the generation method may include an AIGC identifier indicating whether the media content is AIGC, and subsequently, it is possible to recognize whether the media content is AIGC based on the AIGC identifier in the metadata of the media content. In this way, it can help to some extent users determine the authenticity of media content and to some extent improve user vigilance when using (e.g., transferring) media content.
[0006] According to a first aspect, one embodiment of the present application provides a metadata generation method. This method includes the steps of first acquiring media content and then generating metadata for the media content, wherein the metadata for the media content includes an artificial intelligence-generated content (AIGC) identifier, the AIGC identifier indicating whether the media content is AIGC. Furthermore, the AIGC identifier may then be obtained from the metadata for the media content, and whether the media content is AIGC is determined based on the AIGC identifier. In this way, this method can help to some extent users determine the authenticity of media content (for example, if media content is determined to be AIGC, it can be determined that there is a high probability that the information contained in the media content is false, and then the authenticity of the media content can be further determined by other means), and can improve to some extent users' vigilance when using (for example, transferring) media content (for example, if media content is determined to be AIGC, users can further verify whether the media content is copyrighted, whether the media content contains personal information, whether the media content contains misinformation, etc., and if the media content is determined to be copyrighted, or whether the media content contains personal information, or whether the media content contains misinformation, the media content cannot be used, or if, through verification, it is determined that the media content is not copyrighted, does not contain personal information, and does not contain misinformation, the media content can be used).
[0007] For example, media content includes, but is not limited to, images, photographs, videos, and audio. This is not limited to these in this application.
[0008] For example, metadata for media content may include data used to describe the media content. For example, metadata may include information describing the properties of the media content.
[0009] Please note that the media generation method described in this application is applied to the media asset creation phase and corresponds to the metadata generation process in the media asset creation phase.
[0010] For example, when media content is AIGC, the value of the AIGC identifier in the media content's metadata is a pre-configured identifier value, which indicates that the media content is AIGC. When media content is not AIGC, the value of the AIGC identifier in the media content's metadata is a different identifier value, which indicates that the media content is not AIGC. It is important to understand that the pre-configured identifier value is different from the other identifier value. For the AIGC identifier, one pre-configured identifier value and one or more other identifier values may be predefined.
[0011] According to the first embodiment, the metadata of the media content further includes a first hash value, the first hash value being a hash value of data containing an AIGC identifier. This prevents the AIGC identifier from being tampered with.
[0012] For example, the first hash value is the hash value of data containing the AIGC identifier. The first hash value can be understood as the hash value of several pieces of data, where "several pieces of data" may include the AIGC identifier.
[0013] For example, when "some data" includes only an AIGC identifier, the first hash value may be the hash value of the AIGC identifier, or the first hash value may be obtained by performing a hash calculation on the AIGC identifier. Specifically, the first hash value may be obtained by performing a hash calculation on the value of the AIGC identifier according to a hash algorithm. It should be understood that this application is not limited to the hash algorithm used to calculate the first hash value.
[0014] Please understand that the first hash value is optional information within the metadata of the media content.
[0015] According to the first embodiment or any one of the above-described implementations of the first embodiment, the metadata of the media content further includes a digital signature of the first hash value. This prevents the AIGC identifier from being forged.
[0016] For example, a digital signature may be obtained by performing a digital signature algorithm on a first hash value using a secret key, thereby obtaining the digital signature of the first hash value. It should be understood that this application is not limited to the digital signature algorithm used to compute the digital signature of the first hash value.
[0017] Please understand that the digital signature of the first hash value is optional information within the metadata of the media content.
[0018] According to the first embodiment or any one of the above-described implementations of the first embodiment, the metadata of the media content further includes a trainability identifier, the trainability identifier indicating whether the media content can be used for model training. Thus, it is convenient to subsequently determine whether AI model training can be performed using the media content.
[0019] For example, the training enablement identifier could be the DNT (Full Name: Do not Train) field.
[0020] Please understand that the training-enabled identifier is optional information within the metadata of the media content.
[0021] According to any one of the first aspect or the above implementation forms of the first aspect, the metadata of the media content further includes related information of the media content.
[0022] For example, the related information of the media content can be information related to the media content, and the related information of the media content can include data used to describe the media content. For example, it can include information describing the characteristics of the media content.
[0023] According to any one of the first aspect or the above implementation forms of the first aspect, the metadata of the media content further includes at least one of a model identifier, a model version identifier, a model parameter data volume identifier, or a model training set data volume identifier.
[0024] For example, the model identifier can indicate the type of AI model for generating the media content, such as ChatGPT (a driven natural language processing tool) or Midjourney (an AI drawing tool).
[0025] For example, the model version identifier can indicate the version of the AI model for generating the media content, such as Midjourney V4, Midjourney V5, ChatGPT v3.5, or ChatGPT v4.
[0026] For example, the model parameter data volume identifier can indicate the data volume of the parameters of the AI model for generating the media content, such as 1 million parameters or 10 million parameters.
[0027] For example, the model training set data volume identifier can indicate the data volume of the training set of the AI model for generating the media content, such as 1G or 47T.
[0028] In this way, subsequently, it is convenient to know the related information of the AI model for generating media content based on the metadata of the media content.
[0029] It should be understood that the model identifier, the model version identifier, the model parameter data volume identifier, and the model training set data volume identifier are all optional information in the metadata of the media content.
[0030] According to any one of the first aspect or the above implementation forms of the first aspect, the metadata of the media content further includes a second hash value, a third hash value, and a digital signature of the third hash value. The second hash value is the hash value of the media content, and the third hash value is the hash value of the data including the related information of the media content and the second hash value. This can prevent the media content and the related information of the media content from being tampered with and prevent the related information of the media content from being forged.
[0031] For example, the third hash value is the hash value of the data including the related information of the media content and the second hash value. The third hash value is the hash value of some data, and it can be understood that "some data" may include the related information of the media content and the second hash value.
[0032] For example, when "some data" only includes the related information of the media content and the second hash value, the third hash value can be obtained by performing a hash calculation on the related information of the media content and the second hash value. Specifically, a hash calculation can be performed on the combined related information of the media content and the second hash value to obtain the third hash value.
[0033] Please understand that the second hash value, the third hash value, and the digital signature of the third hash value are all optional information within the media content metadata.
[0034] According to the first embodiment or any one of the above-described implementations of the first embodiment, the metadata of media content further comprises one or more media declarations and one or more fourth hash values, wherein the media declaration is a declaration about media content and the fourth hash value is the hash value of the media declaration.
[0035] For example, a media statement may include, but is not limited to, copyright information, thumbnails, whether the media statement can be modified, permission to operate, permission to use, source of media content, and editorial information.
[0036] It should be understood that the media declaration and the fourth hash value are optional information within the metadata. In other words, in the process of generating the metadata, media content may or may not be declared. In this way, the flexibility and backward compatibility of the metadata can be improved.
[0037] According to the first embodiment or any one of the above-described implementations of the first embodiment, the metadata of the media content further includes a fifth hash value, the fifth hash value is a hash value of data that includes a second hash value, a third hash value, a digital signature of the third hash value, and one or more fourth hash values. In this way, multiple hash values can be associated, thereby further preventing tampering with the media content and the information associated with the media content.
[0038] For example, the fifth hash value is the hash value of data that includes the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values. The fifth hash value can be understood as the hash value of several data, where “several data” may include the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.
[0039] For example, if “some data” includes only a second hash value, a third hash value, a digital signature of the third hash value, and one or more fourth hash values, the fifth hash value can be obtained by performing a hash calculation on the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.
[0040] For example, a hash calculation may be performed on a combination result obtained by combining a second hash value, a third hash value, the digital signature of the third hash value, and one or more fourth hash values, thereby obtaining an intermediate hash value. When the intermediate hash value is obtained by performing a hash calculation by combining all of the second hash value, the third hash value, the digital signature of the third hash value, and the fourth hash value, the intermediate hash value may be used as the fifth hash value. When the intermediate hash value is obtained by performing a hash calculation by combining the second hash value, the third hash value, the digital signature of the third hash value, and some of the one or more fourth hash values, the hash calculation may be performed on the intermediate hash value and the other parts of the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values, thereby obtaining a fifth hash value.
[0041] For example, the metadata of media content may further include a digital signature of a fifth hash value. It should be understood that the metadata of media content may further include other information; this is not limited to the present application.
[0042] According to the first embodiment or any one of the above-described implementations of the first embodiment, the method further includes obtaining media assets corresponding to media content based on media content and metadata of media content.
[0043] For example, media content and its metadata can be encapsulated to obtain the media asset corresponding to the media content. For instance, if the media content is a JPEG (Joint Picture Encoding Group) image, the JPEG file (i.e., the media asset) can be obtained by encapsulating the image and its metadata.
[0044] According to the first embodiment or any one of the above-described implementations of the first embodiment, the metadata of media content is a JUMBF (JPEG Universal Metadata Box Format) box, the JUMBF box includes a JUMBF description box and a JUMBF content box, and the JUMBF description box and / or JUMBF content box include an AIGC identifier. In this way, whether media content is AIGC can be determined based on the AIGC identifier read from the JUMBF description box and / or JUMBF content box.
[0045] For example, a JUMBF description box is a JUMBF Description Box, and a JUMBF content box is a JUMBF Content Box.
[0046] For example, a new Content Type may be defined in a JUMBF and may be called an AIGC Content Type, and the corresponding JUMBF Content Box may be called an AICG Content Box. In addition, a new identifier value (sometimes called a pre-configured identifier value) may be defined for the TYPE field in a JUMBF Description Box. A pre-configured identifier value may indicate that a JUMBF Content Box is an AICG Content Box (or may be understood to indicate that the type of the JUMBF Content Box is an AIGC Content Type, or that the media content is AIGC). In this case, the AIGC identifier may be the TYPE field in the JUMBF Description Box.
[0047] For example, in this application, the AIGCI (AIGC Identity) field may be added to the JUMBF Description Box. The AIGCI field may indicate whether the media content is AIGC. The AIGCI field in the JUMBF Description Box may be used as an AIGC identifier. For example, the AIGCI field may be defined with multiple identifier values (which may include one pre-set identifier value and at least one other identifier value). For example, two identifier values, "1" and "0", may be defined. "1" may be a pre-set identifier value indicating that the media content is AIGC, and "0" may be another identifier value indicating that the media content is not AIGC.
[0048] For example, an AIGCI field may be added to a JUMBF Content Box. The AIGCI field may indicate whether the media content is AIGC. The AIGCI field within a JUMBF Content Box can be used as an AIGC identifier.
[0049] For example, the JUMBF Description Box may further include a trainability identifier.
[0050] According to the first embodiment or any one of the above-described implementations of the first embodiment, the JUMBF content box further includes information related to the media content.
[0051] According to the first embodiment or any one of the above-described implementations of the first embodiment, the JUMBF content box further includes at least one of the following: a model identifier, a model version identifier, a model parameter data volume identifier, or a model training set data volume identifier.
[0052] When media content is AIGC, a JUMBF Content Box is sometimes called an AICG Content Box.
[0053] For example, an AICG Content Box may include, but is not limited to, the AIGCI field, AI Model field, AI Model Ver (full name: AI Model Version) field, Para size (full name: Parameter Size) field, Data Size (AI Model Training Set Data Size) field, and Data (Load Data) field.
[0054] For example, the AIGCI field (sometimes called the AIGCI identifier; the AIGC identifier represented by the TYPE field in the JUMBF Description Box and the AIGC identifier represented by the AIGCI field in the AICG Content Box are two identifiers, but they have the same function) can indicate whether a JUMBF Content Box is an AICG Content Box (the AIGCI field can also be understood as indicating whether the media content is AIGC). For example, the AIGCI field is defined with two identifier values, "1" and "0". "1" indicates that the JUMBF Content Box is an AICG Content Box, and "0" indicates that the JUMBF Content Box is not an AICG Content Box.
[0055] For example, the AI Model field is sometimes called the model identifier.
[0056] For example, the AI Model Ver field is sometimes called the model version identifier.
[0057] For example, the Para Size field is sometimes called the model parameter data volume identifier.
[0058] For example, the Data Size field is sometimes called the model training set data volume identifier.
[0059] For example, the Data field can be used to store relevant information about media content.
[0060] For example, a JUMBF content box further includes a second hash value, a third hash value, and a digital signature of the third hash value.
[0061] For example, a JUMBF content box further includes one or more media declarations and one or more fourth hash values.
[0062] For example, the JUMBF content box includes a fifth hash value.
[0063] For example, the JUMBF content box further includes a training-executable identifier.
[0064] It should be understood that the training enablement identifier is optional information within the metadata of the media content. This application does not limit whether the training enablement identifier is located within the JUMBF Content Box or the JUMBF Description Box.
[0065] According to the first embodiment or any one of the above-described implementations of the first embodiment, the information relating to the media content includes at least one of the following: the time the media content was created, the name of the author of the media content, the digital content identifier of the media content, the location where the media content was created, information about the media content creation device for the media content, the resolution of the media content, or the size of the media content.
[0066] Related information about media content may further include other information such as the media type of the media content or the method of generating the media content. This is not limited to the present application.
[0067] For example, media types may include, but are not limited to, image types, video types, audio types, graphic types, and text types.
[0068] For example, methods for generating media content may include AI-generated methods and non-AI-generated methods. For example, if the media content is an image, the corresponding generation methods may include, but are not limited to, photographic generation methods, screenshot generation methods, and AI-generated methods. Photographic generation methods and screenshot generation methods are non-AI-generated methods.
[0069] In this way, in addition to recognizing whether media content is AIGC based on the AIGC identifier read from the JUMBF Description Box or JUMBF Content Box, whether media content is AIGC can also be recognized based on the method used to generate the media content, which is read from the Data field within the JUMBF Content Box.
[0070] According to the first embodiment or any one of the above-described implementations of the first embodiment, the JUMBF description box further includes a first hash value, an implementable state identifier, a content request identifier, identification information, and a sixth hash value, the sixth hash value being determined based on the JUMBF content box, and the first hash value being the hash value of the data including the AIGC identifier, the implementable state identifier, the content request identifier, identification information, and the sixth hash value. In other words, the first hash value can be obtained by performing a hash calculation on the field values of the fields in the JUMBF description box. This prevents tampering with the field values of any field in the JUMBF description box.
[0071] For example, the first hash value is the hash value of data that includes the AIGC identifier, the enforceability identifier, the content request identifier, the identification information, and the sixth hash value. The first hash value is the hash value of several pieces of data, and it can be understood that the "several pieces of data" may include the AIGC identifier, the enforceability identifier, the content request identifier, the identification information, and the sixth hash value.
[0072] For example, if “some data” includes only the hash values of the AIGC identifier, the enforceable status identifier, the content request identifier, the identification information, and the sixth hash value, the first hash value can be obtained by performing a hash calculation on the AIGC identifier, the enforceable status identifier, the content request identifier, the identification information, and the sixth hash value.
[0073] For example, a hash calculation may be performed on a combination result obtained by combining one or more of the AIGC identifier value, the enforceable state identifier value, the content request identifier value, the identification information value, and the sixth hash value, and an intermediate hash value may be obtained. When the intermediate hash value is obtained by performing a hash calculation by combining all of the AIGC identifier value, the enforceable state identifier value, the content request identifier value, the identification information value, and the sixth hash value, the intermediate hash value may be used as the first hash value. When the intermediate hash value is obtained by performing a hash calculation by combining some of the AIGC identifier value, the enforceable state identifier value, the content request identifier value, the identification information value, and the sixth hash value, the hash calculation may be performed on the intermediate hash value and the other parts of the AIGC identifier value, the enforceable state identifier value, the content request identifier value, the identification information value, and the sixth hash value, and a first hash value may be obtained.
[0074] For example, a JUMBF Description Box may contain multiple fields, including a TYPE field (type field), a TOGGLES(T) field (executable status field), a LABEL field (content request field), an ID field (identification field), and a SHA256HASH field (a field used to store a sixth hash value).
[0075] For example, the TYPE field (sometimes called the JUMBF type field or type identifier) can be used to describe the JUMBF content type (i.e., the type of the JUMBF content box).
[0076] For example, the TYPE field may contain a single 16-byte UUID, where the UUID value specifies the type of JUMBF Content Box.
[0077] For example, JUMBF Content Box types may include, but are not limited to, Codestream Content Type, UUID Content Type, XML Content Type, JSON Content Type, CBOR Content Type, Embedded File Content Type, and other content types (which can be customized).
[0078] For example, the TYPE field is a required field.
[0079] For example, the TOGGLES(T) field (sometimes called the enable status identifier) may contain a 1-byte (i.e., 8-bit) binary number that can indicate an option value for the JUMBF box. Each bit represents one option. When the bit's value is 1, this value indicates that the option is available. When the bit's value is 0, this value indicates that the option is unavailable.
[0080] For example, the LABEL field (sometimes called a content request identifier) may contain a variable-length text label, and the LABEL field can be used to reference or request content in a JUMBF box.
[0081] For example, the ID field (sometimes called identification information) may contain a single unique 4-byte ID assigned by the user, and the ID field can be used to reference the JUMBF box in binary.
[0082] For example, a sixth hash value can be stored using the SHA256HASH field, and the sixth hash value is determined based on the JUMBF Content Box. For instance, after n JUMBF Content Boxes are combined as a sequence of n JUMBF Content Boxes in a JUMBF Super Box, a hash calculation may be performed on the n JUMBF Content Boxes to obtain the sixth hash value.
[0083] For example, the TOGGLE(T) field, LABEL field, ID field, and SHA256HASH field can be optional fields.
[0084] For example, a first hash value may be obtained by performing a calculation according to a hash algorithm on the combination result obtained by combining the identifier value of the AIGC identifier with at least one field value from the TOGGLE(T) field, LABEL field, ID field, SHA256HASH field, and DNT field.
[0085] For example, the JUMBF description box may further include the digital signature of the first hash value.
[0086] According to a second aspect, one embodiment of the present application provides a recognition method. This method includes the steps of first obtaining metadata of media content, then reading an artificial intelligence-generated content (AIGC) identifier from the metadata of the media content, and then determining whether the media content is AIGC based on the AIGC identifier.
[0087] According to a second aspect, the method further includes the step of determining that media content is AIGC when the value of the AIGC identifier is a pre-set identifier value.
[0088] According to the second embodiment or any one of the above-described implementations of the second embodiment, the metadata of media content is a JPEG General Metadata Box format JUMBF box, the JUMBF box includes a JUMBF description box and a JUMBF content box, the JUMBF description box and / or the JUMBF content box includes an AIGC identifier.
[0089] According to a third aspect, one embodiment of the present application provides a metadata generation device. The device includes a content acquisition module configured to acquire media content and a metadata generation module configured to generate metadata for the media content, the metadata for the media content including an artificial intelligence generated content AIGC identifier, the AIGC identifier indicating whether the media content is AIGC.
[0090] It should be understood that the metadata generation device in the third embodiment may perform the steps in the first embodiment and any one of the implementations of the first embodiment. Details will not be repeated in this specification.
[0091] Any one of the third aspect and any one of the implementations of the third aspect corresponds to any one of the first aspect and any one of the implementations of the first aspect. For technical effects corresponding to any one of the third aspect and any one of the implementations of the third aspect, please refer to the technical effects corresponding to any one of the first aspect and any one of the implementations of the first aspect. Details will not be repeated in this specification.
[0092] According to a fourth aspect, one embodiment of the present application provides a recognition device. The device includes a metadata acquisition module configured to acquire metadata of media content; a reading module configured to read an artificial intelligence generated content (AIGC) identifier from the metadata of the media content; and a determination module configured to determine whether the media content is AIGC based on the AIGC identifier.
[0093] It should be understood that the recognition device in the fourth embodiment may perform the steps in the second embodiment and any one of the implementations of the second embodiment. Details will not be repeated in this specification.
[0094] Any of the fourth aspect and any one of the implementations of the fourth aspect corresponds to any one of the second aspect and any one of the implementations of the second aspect. For technical effects corresponding to any one of the fourth aspect and any one of the implementations of the fourth aspect, please refer to the technical effects corresponding to any one of the second aspect and any one of the implementations of the second aspect. Details will not be repeated in this specification.
[0095] According to a fifth aspect, one embodiment of the present application provides an electronic device including a memory and a processor. The memory is coupled to the processor. The memory stores program instructions. When the program instructions are executed by the processor, the electronic device becomes capable of performing a metadata generation method in the first aspect or any one of the possible implementations of the first aspect.
[0096] Any of the fifth aspect and any one of the implementations of the fifth aspect correspond to any one of the first aspect and any one of the implementations of the first aspect. For technical effects corresponding to any one of the fifth aspect and any one of the implementations of the fifth aspect, please refer to the technical effects corresponding to any one of the first aspect and any one of the implementations of the first aspect. Details will not be repeated in this specification.
[0097] According to a sixth aspect, one embodiment of the present application provides an electronic device including a memory and a processor. The memory is coupled to the processor. The memory stores program instructions. When the program instructions are executed by the processor, the electronic device becomes capable of implementing a recognition method in a second aspect or any one of the possible implementations of the second aspect.
[0098] Any of the sixth aspect and any one of the implementations of the sixth aspect corresponds to any one of the second aspect and any one of the implementations of the second aspect. For technical effects corresponding to any one of the sixth aspect and any one of the implementations of the sixth aspect, please refer to the technical effects corresponding to any one of the second aspect and any one of the implementations of the second aspect. Details will not be repeated in this specification.
[0099] According to a seventh aspect, one embodiment of the present application provides a chip comprising one or more interface circuits and one or more processors. The interface circuits are configured to receive signals from the memory of an electronic device and to transmit signals to the processors. The signals include computer instructions stored in the memory. When the processor executes a computer instruction, a step in the first aspect or any one of the possible implementations of the first aspect is performed.
[0100] Any seventh aspect and any one of the implementations of the seventh aspect correspond to any one of the first aspect and any one of the implementations of the first aspect. For technical effects corresponding to any one of the seventh aspect and any one of the implementations of the seventh aspect, please refer to the technical effects corresponding to any one of the first aspect and any one of the implementations of the first aspect. Details will not be repeated in this specification.
[0101] According to the eighth aspect, one embodiment of the present application provides a chip comprising one or more interface circuits and one or more processors. The one or more processors receive or transmit data through the one or more interface circuits. When one or more processors execute a computer instruction, a step in the second aspect or any one of the possible implementations of the second aspect is performed.
[0102] Any eighth aspect and any one of the implementations of the eighth aspect correspond to any one of the second aspect and any one of the implementations of the second aspect. For technical effects corresponding to any one of the eighth aspect and any one of the implementations of the eighth aspect, please refer to the technical effects corresponding to any one of the second aspect and any one of the implementations of the second aspect. Details will not be repeated in this specification.
[0103] According to the ninth aspect, one embodiment of the present application provides a computer-readable storage medium for storing a computer program. When the computer program is executed on a computer or processor, the computer or processor can implement a metadata generation method in the first aspect or any one of the possible implementations of the first aspect.
[0104] Any one of the ninth aspect and any one of the implementations of the ninth aspect corresponds to any one of the first aspect and any one of the implementations of the first aspect. For technical effects corresponding to any one of the ninth aspect and any one of the implementations of the ninth aspect, please refer to the technical effects corresponding to any one of the first aspect and any one of the implementations of the first aspect. Details will not be repeated in this specification.
[0105] According to a tenth aspect, one embodiment of the present application provides a computer-readable storage medium for storing a computer program. When the computer program is executed on a computer or processor, the computer or processor is able to implement a recognition method in a second aspect or any one of the possible implementations of the second aspect.
[0106] Any one of the tenth aspect and any one of the implementations of the tenth aspect corresponds to any one of the second aspect and any one of the implementations of the second aspect. For technical effects corresponding to any one of the tenth aspect and any one of the implementations of the tenth aspect, please refer to the technical effects corresponding to any one of the second aspect and any one of the implementations of the second aspect. Details will not be repeated in this specification.
[0107] According to the eleventh aspect, one embodiment of the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or processor, the computer or processor can implement a metadata generation method in the first aspect or any one of the possible implementations of the first aspect.
[0108] Any one of the eleventh aspect and any one of the implementations of the eleventh aspect corresponds to any one of the first aspect and any one of the implementations of the first aspect. For technical effects corresponding to any one of the eleventh aspect and any one of the implementations of the eleventh aspect, please refer to the technical effects corresponding to any one of the first aspect and any one of the implementations of the first aspect. Details are not repeated in this specification.
[0109] According to the twelfth aspect, one embodiment of the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or processor, the computer or processor is able to implement a recognition method in the second aspect or any one of the possible implementations of the second aspect.
[0110] Any one of the twelfth aspect and any one of the implementations of the twelfth aspect corresponds to any one of the second aspect and any one of the implementations of the second aspect. For technical effects corresponding to any one of the twelfth aspect and any one of the implementations of the twelfth aspect, please refer to the technical effects corresponding to any one of the second aspect and any one of the implementations of the second aspect. Details will not be repeated in this specification. [Brief explanation of the drawing]
[0111] [Figure 1a] This is a diagram illustrating an example of an application scenario. [Figure 1b] This is a diagram illustrating an example of an application scenario. [Figure 1c(1)] This is a diagram illustrating an example of a recognition method. [Figure 1c(2)] This is a diagram illustrating an example of a recognition method. [Figure 1c(3)] This is a diagram illustrating an example of a recognition method. [Figure 2] This is a diagram illustrating an example of the metadata generation process. [Figure 3a] This is a diagram illustrating an example of the structure of a JUMBF box. [Figure 3b] This is a diagram illustrating an example of the structure of a JUMBF Description Box. [Figure 3c] This is an example diagram of the structure of an AICG Content Box. [Figure 4a] This is a diagram illustrating an example of the metadata generation process. [Figure 4b] This is a diagram illustrating an example of the structure of a JUMBF box. [Figure 5a] This is a diagram illustrating an example of the structure of a JUMBF Description Box. [Figure 5b] This is a diagram illustrating an example of the metadata generation process. [Figure 5c] This is a diagram illustrating an example of the structure of a JUMBF Content Box. [Figure 5d] This is a diagram illustrating an example of the structure of a JUMBF box. [Figure 6a]This is a diagram illustrating an example of the structure of a JUMBF Content Box. [Figure 6b] This is a diagram illustrating an example of the metadata generation process. [Figure 6c] This is a diagram illustrating an example of the structure of a JUMBF box. [Figure 7a] This is a diagram illustrating an example of the structure of a JUMBF Description Box. [Figure 7b] This is a diagram illustrating an example of the structure of an AIGC Content Box. [Figure 7c] This is a diagram illustrating an example of the structure of a JUMBF Description Box. [Figure 7d] This is a diagram illustrating an example of the structure of a JUMBF Description Box. [Figure 7e] This is an example diagram showing the structure of a Data field within a JUMBF Content Box. [Figure 7f] This is a diagram illustrating an example of the fifth hash value generation process. [Figure 7g] This is a diagram illustrating an example of the fifth hash value generation process. [Figure 8] This is a diagram illustrating an example of the recognition process. [Figure 9] This is a diagram illustrating an example of the recognition process. [Figure 10] This is a diagram illustrating an example of the recognition process. [Figure 11] This is a diagram illustrating an example of the recognition process. [Figure 12] This is a diagram illustrating an example of a metadata generation device. [Figure 13] This is a diagram illustrating an example of a recognition device. [Figure 14] This is a diagram illustrating an example of the device's structure. [Modes for carrying out the invention]
[0112] The technical solutions in the embodiments of this application will be described clearly and completely below with reference to the accompanying drawings. It will be clear that the embodiments described are not all but a portion of the embodiments of this application. All other embodiments that can be obtained by those skilled in the art without ingenuity based on the embodiments of this application are within the scope of protection of this application.
[0113] In this specification, the term "and / or" describes only a correlation for describing related subjects, indicating that three relationships may exist. For example, A and / or B may represent the following three cases: Only A exists. Both A and B exist. Only B exists.
[0114] In the specification and claims of the embodiments of this application, terms such as "first," "second," etc., are intended to distinguish between different objects and do not indicate a particular order of objects. For example, "first object," "second object," etc., are used to distinguish between different objects, but are not used to describe a particular order of objects.
[0115] In addition, in embodiments of this application, the terms “example” or “for example” are used to indicate that an example, illustration, or explanation is being given. Any embodiment or design described as “example” or “for example” in embodiments of this application should not be described as being preferable to or having more advantages than another embodiment or design. Strictly speaking, the use of terms such as “example” or “for example” is intended to present the relevant concepts in a particular way.
[0116] In the description of embodiments of this application, "multiple" means two or more unless otherwise specified. For example, "multiple processing units" means two or more processing units, and "multiple systems" means two or more systems.
[0117] To facilitate understanding, we will first explain some terms that are used in embodiments of this application.
[0118] 1. Media Assets Media assets may include media content and metadata for media content. Metadata for media content may be bound to the media content, or it may be associated with the media content.
[0119] Note that in some scenarios, media assets are also referred to as media files. For example, if the media content is a JPEG (Joint Picture Encoding Group) image, the corresponding media asset may be called a JPEG file.
[0120] 2. Media Content Media content is sometimes called digital content. Digital content refers to different content types such as text, images, and audio that exist in digital form. Digital content can be stored on digital carriers, such as optical discs or hard disk drives, and transmitted over networks or by other means. Digital content is a complete product or service that integrates content such as images, text, audio, and video using digital technology, and is a product obtained by combining digital media technology and cultural creativity.
[0121] Digital technology is a science and technology that coexists with electronic computers. It is the technology of converting various types of information, including images, text, and audio, into binary numbers "0" and "1" using specific devices, and these binary numbers can be identified by electronic computers for computing, processing, storage, transmission, propagation, and reconstruction. Because computers are necessary for encoding, compressing, and decoding information in computation and storage processes, digital technology is also called digital technology or computer digital technology. Digital technology is also called digital control technology.
[0122] 3. Metadata Metadata can include data used to describe media content. For example, metadata can include information describing the properties of media content.
[0123] Figure 1a is a diagram illustrating an example of an application scenario. In Figure 1a, the media content is an image.
[0124] Please refer to Figure 1a. For example, if User A's mobile phone A receives an image sent by User B's mobile phone B, and User A needs to use this image (for example, forward it), User A can first determine whether the image is AIGC by using mobile phone A. After determining that the image is AIGC, User A can further verify whether the media content is copyrighted, whether the media content contains personal information, whether the media content contains misinformation, etc., and then User A can decide whether to use the image.
[0125] It should be understood that the mobile phone A in Figure 1a may also be another electronic device with advanced computing capabilities, such as a personal computer, computer workstation, or tablet computer. This is not limited to the present application.
[0126] Figure 1b is an example of an application scenario. In Figure 1b, the media content is an image.
[0127] Please refer to Figure 1b. For example, if a user needs to determine whether an image in their smartwatch is an AIGC, they can send the image from their smartwatch to their mobile phone and use the mobile phone to determine if the image is an AIGC.
[0128] It should be understood that the smartwatch in Figure 1b may be another electronic device with low computing capabilities, such as a media consumption device, wearable device, set-top box, or game console. This is not limited to the present application. The mobile phone in Figure 1b may also be another electronic device with high computing capabilities, such as a personal computer, computer workstation, or tablet computer. This is not limited to the present application.
[0129] Figures 1c(1), 1c(2), and 1c(3) illustrate an example of a recognition method. Figures 1c(1), 1c(2), and 1c(3) show the process of determining whether an image is AIGC using a mobile phone.
[0130] For example, a user may perform AIGC recognition by launching a client of the AIGC recognition platform on their mobile phone (e.g., an application program, applet, or web page).
[0131] Please refer to Figure 1c(1). The main interface 101 of the AIGC recognition platform client may include one or more control devices, which may include, but are not limited to, input boxes, recognition buttons, etc. This is not limited to the present application.
[0132] For example, a user may tap an input box, and the AIGC recognition platform client may display a file selection interface in response to the user's actions. The user may then select an image to be recognized on the file selection interface and then tap a recognition button on the main interface 101. In response to this, the AIGC recognition platform client may retrieve the image metadata in response to the user's actions (understand that image metadata is received when mobile phone A receives an image sent by mobile phone B (or when a mobile phone receives an image sent by a smartwatch)), and then, based on the image metadata, recognize whether the image is an AIGC.
[0133] In possible ways, a client of the AIGC recognition platform can determine whether an image is an AIGC image. For example, when there is one image to be recognized, a client of the AIGC recognition platform can perform the recognition locally.
[0134] In possible ways, the server side of the AIGC recognition platform can recognize whether an image is an AIGC image. For example, when there are multiple images to be recognized, a client of the AIGC recognition platform can send multiple images to the server side of the AIGC recognition platform, and the server side of the AIGC recognition platform can recognize the multiple images and return the recognition results to the client of the AIGC recognition platform.
[0135] It should be noted that in this application, whether the AIGC recognition platform client recognizes whether an image is AIGC, or whether the AIGC recognition platform server recognizes whether an image is AIGC, is not limited by the number of images to be recognized.
[0136] For example, a client of an AIGC recognition platform may display recognition results. These results may include whether an image is AIGC and whether an image is not AIGC.
[0137] Please refer to Figure 1c(2). The recognition result shown in Figure 1c(2) indicates that the image is AIGC.
[0138] Please refer to Figure 1c(3). The recognition result shown in Figure 1c(3) indicates that the image is not AIGC.
[0139] It should also be understood that users may manually view the image metadata and then, based on that metadata, determine whether the image is an AIGC. This is not limited to the present application.
[0140] The following describes the process of generating metadata and recognizing media content.
[0141] First, we will explain the process of generating metadata for media content.
[0142] Figure 2 shows an example of the metadata generation process.
[0143] S201: Retrieve media content.
[0144] For example, media content may include, but is not limited to, images, audio, video, text, and graphs. This is not limited to the present application.
[0145] For example, when media content is retrieved, related information about the media content may be retrieved. Related information about media content may be information related to the media content and may include data used to describe the media content, for example, information describing the characteristics of the media content. For example, related information about media content may include, but is not limited to, the time the media content was created, the name of the author of the media content, the digital content identifier of the media content, the location where the media content was created, information about the media content creation device of the media content, the resolution of the media content, the size of the media content, the media type of the media content, or the method of creating the media content.
[0146] For example, media types may include, but are not limited to, image types, video types, audio types, graphic types, and text types.
[0147] For example, methods for generating media content may include AI-generated methods and non-AI-generated methods. For example, if the media content is an image, the corresponding generation methods may include, but are not limited to, photographic generation methods, screenshot generation methods, and AI-generated methods. Photographic generation methods and screenshot generation methods are non-AI-generated methods.
[0148] For example, media content in S201 may be media content that does not contain metadata, and metadata for media content may be generated based on related information of media content, i.e., S202 is performed.
[0149] Please note that the media generation method described in this application is applied to the media asset creation phase and corresponds to the metadata generation process in the media asset creation phase.
[0150] S202: Generate metadata for media content. The metadata for media content includes an AIGC identifier, which indicates whether the media content is AIGC.
[0151] For example, in the process of generating metadata for media content, if the media content is determined to be AIGC, the value of the AIGC identifier may be set to a pre-configured identifier value, which indicates that the media content is AIGC. If the media content is determined not to be AIGC, the value of the AIGC identifier may be set to a different identifier value, which indicates that the media content is not AIGC. Then, metadata for the media content is generated based on the relevant information about the media content and the AIGC identifier. In other words, metadata for media content may include the relevant information about the media content and the AIGC identifier.
[0152] For example, whether media content is AIGC can be determined based on the method used to generate the media content, as indicated in the related information of the media content. If the method used to generate the media content is an AI generation method, the media content may be determined to be AIGC; conversely, if the method used to generate the media content is a non-AI generation method, the media content may be determined not to be AIGC.
[0153] In this way, it is then possible to identify whether media content is AIGC based on the AIGC identifier in the media content's metadata.
[0154] The metadata generation process will be further explained below using an example where the media content is an image and the metadata for the media content is a JUMBF (JPEG Universal Metadata Box Format) box.
[0155] First, install the JUMBF box.
[0156] Figure 3a shows an example of the structure of a JUMBF box.
[0157] Please refer to Figure 3a. For example, a JUMBF box is a superbox. A JUMBF Super Box must contain a JUMBF Description Box, n (where n is a positive integer) JUMBF Content Boxes, and other boxes (for example, a Padding Box, but of course, it could be any other type of box). The JUMBF Description Box is located before the JUMBF Content Boxes.
[0158] For example, a JUMBF Description Box may be used to describe a JUMBF Content Box, which may contain relevant information about media content, and a Padding Box may be used for data padding. Of course, other types of boxes may also be defined; this is not limited to the present application.
[0159] Figure 3b is an example of the structure of a JUMBF Description Box.
[0160] Please refer to Figure 3b. For example, a JUMBF Description Box may contain multiple fields, including a TYPE field (type field), a TOGGLES(T) field (executable status field), a LABEL field (content request field), an ID field (identification field), and a SHA256HASH field (field used to store a sixth hash value).
[0161] Please understand that Figure 3b is merely an example of the present application. The present application may include more or fewer fields than those shown in Figure 3b. This is not limited to the present application.
[0162] For example, the TYPE field (sometimes called the JUMBF type field or type identifier) can be used to describe the JUMBF content type (i.e., the type of the JUMBF content box).
[0163] For example, the TYPE field may contain a single 16-byte UUID, where the UUID value specifies the type of JUMBF Content Box.
[0164] For example, JUMBF Content Box types may include, but are not limited to, Codestream Content Type, UUID Content Type, XML Content Type, JSON Content Type, CBOR Content Type, Embedded File Content Type, and other content types (which can be customized).
[0165] For example, the TYPE field is a required field.
[0166] For example, the TOGGLES(T) field (sometimes called the enable status identifier) may contain a 1-byte (i.e., 8-bit) binary number that can indicate an option value for the JUMBF box. Each bit represents one option. When the bit's value is 1, this value indicates that the option is available. When the bit's value is 0, this value indicates that the option is unavailable.
[0167] For example, the LABEL field (sometimes called a content request identifier) may contain a variable-length text label, and the LABEL field can be used to reference or request content in a JUMBF box.
[0168] For example, the ID field (sometimes called identification information) may contain a single unique 4-byte ID assigned by the user, and the ID field can be used to reference the JUMBF box in binary.
[0169] For example, a sixth hash value can be stored using the SHA256HASH field, and the sixth hash value is determined based on the JUMBF Content Box. For instance, after n JUMBF Content Boxes are combined as a sequence of n JUMBF Content Boxes in a JUMBF Super Box, a hash calculation may be performed on the n JUMBF Content Boxes to obtain the sixth hash value.
[0170] For example, the TOGGLE(T) field, LABEL field, ID field, and SHA256HASH field are optional fields.
[0171] Based on the descriptions in Figures 3a and 3b, in any way possible, in this application, a new Content Type may be defined in a JUMBF and may be called an AIGC Content Type, and the corresponding JUMBF Content Box may be called an AICG Content Box. In addition, a new identifier value (may be called a pre-set identifier value) may be defined for the TYPE field in the JUMBF Description Box. The pre-set identifier value may indicate that the JUMBF Content Box is an AICG Content Box (or may be understood to indicate that the type of the JUMBF Content Box is an AIGC Content Type, or that the media content is AIGC). In this case, the AIGC identifier in Figure 2 may be the TYPE field in the JUMBF Description Box.
[0172] Figure 3c is an example of the structure of an AICG Content Box.
[0173] Please refer to Figure 3c. For example, the AICG Content Box may include, but is not limited to, the AIGCI field, the AI Model field, the AI Model Ver (full name: AI Model Version) field, the Para size (full name: Parameter Size) field, the Data Size (AI Model Training Set Data Size) field, and the Data (Load Data) field.
[0174] For example, the AIGCI field (sometimes called the AIGCI identifier; the AIGC identifier represented by the TYPE field in the JUMBF Description Box and the AIGC identifier represented by the AIGCI field in the AICG Content Box are two identifiers, but they have the same function) can indicate whether a JUMBF Content Box is an AICG Content Box. For example, the AIGCI field may have two identifier values defined: "1" and "0". "1" indicates that the JUMBF Content Box is an AICG Content Box, and "0" indicates that the JUMBF Content Box is not an AICG Content Box.
[0175] For example, the AI Model field (sometimes called the model identifier) could indicate the type of AI model used to generate media content, such as ChatGPT (a naturally language-driven processing tool) or Midjourney (an AI drawing tool).
[0176] For example, the AI Model Ver field (sometimes called the model version identifier) may indicate the version of the AI model used to generate media content, such as Midjourney V4, Midjourney V5, ChatGPT v3.5, or ChatGPT v4.
[0177] For example, the Para Size field (sometimes called the Model Parameter Data Volume Identifier) could indicate the amount of data for the parameters of an AI model used to generate media content, such as 1 million or 10 million parameters.
[0178] For example, the Data Size field (sometimes called the Model Training Set Data Volume Identifier) could indicate the amount of data in the training set for an AI model used to generate media content, such as 1GB or 47T.
[0179] For example, the Data field can be used to store relevant information about media content.
[0180] In Figure 3c, note that the data fields within the AICG Content Box are required fields, while other fields are optional.
[0181] Figure 4a is a diagram illustrating an example of the metadata generation process. Figure 4a is based on Figures 3a to 3c.
[0182] S401: Retrieve the image.
[0183] S402: Determine whether the image is AIGC.
[0184] For example, if the image is determined to be AIGC, S403 may be performed.
[0185] S403: Generates an AICG Content Box.
[0186] It is assumed that the AICG Content Box is shown in Figure 3c. In this case, the field value of the AIGCI field may be set to 1. When the image is an AICG, the associated information of the image may further include associated information of the AI model used to generate the image, such as the type of AI model used to generate the image, the version number of the AI model used to generate the image, the model parameter size of the AI model used to generate the image, and the amount of data in the training set of the AI model used to generate the image. In this way, the AI Model field, AI Model Ver identifier, Para Size field, and Data Size field may be sequentially populated based on the type of AI model used to generate the image, the version number of the AI model used to generate the image, the model parameter size of the AI model used to generate the image, and the amount of data in the training set of the AI model used to generate the image. In addition, associated information of the image may be populated in the Data field. In this way, the AICG Content Box can be obtained.
[0187] For example, there might be one AICG Content Box. In this case, the Data field within the AICG Content Box could contain all the information related to the image.
[0188] For example, there may be multiple AICG Content Boxes. In this case, the Data fields within each AICG Content Box may contain some of the information related to the image. The Data fields within each AICG Content Box may contain different related information about the image.
[0189] Please understand that this application does not limit the number of AICG Content Boxes generated during the media asset creation phase.
[0190] S404: Generate a JUMBF Description Box and set the field value of the Type field within the JUMBF Description Box to a pre-configured identifier value.
[0191] For example, a pre-configured identifier value could be an identifier value indicating that a JUMBF Content Box is an AICG Content Box, and could be a single 16-byte UUID.
[0192] For example, the field value of the Type field in the JUMBF Description Box may be set to a pre-configured identifier value, another field may be populated, and the JUMBF Description Box may be retrieved.
[0193] S405: Encapsulate the AICG Content Box and JUMBF Description Box to obtain the JUMBF box.
[0194] For example, the AICG Content Box and JUMBF Description Box may be encapsulated to obtain a JUMBF Super Box, that is, the JUMBF box, i.e., the image metadata, is obtained.
[0195] It should be understood that an Other Box may be generated before S405. In this case, in S405, the AICG Content Box, JUMBF Description Box, and Other Box may be encapsulated to obtain a JUMBF box. The Other Box may be a Padding Box, or another type of Box as defined by the evolution of the standard. This is not limited to the present application.
[0196] Figure 4b is a diagram showing an example of the structure of a JUMBF box.
[0197] Please refer to Figure 4b. For example, a JUMBF box in an AI-generated image may contain a JUMBF Description Box, n AICG Content Boxes (which may include AICG Content Box 1, AICG Content Box 2, ..., and AICG Content Box n), and an Other Box. "TYPE: AIGC" in the JUMBF Description Box indicates that the Content Type of the JUMBF Content Box is AIGC Content Type.
[0198] Note that both the JUMBF Description Box and the AICG Content Box within a JUMBF box have an identifier (jumd). Thus, the JUMBF Description Box and AICG Content Box can subsequently be read based on their identifiers.
[0199] S406: Retrieve JPEG files based on the image and JUMBF box.
[0200] For example, a JPEG file may be created first, and the JPEG file may contain multiple tag segments. Then, an image and a JUMBF box can be embedded in a different tag segment within each JPEG file. For example, a JUMBF box may be embedded in the APP 11 tag segment of the JPEG file.
[0201] In S403, if it is determined that the image is not AIGC, a JUMBF Content Box of a different content type may be generated, a JUMBF Description Box may be generated, and the field value of the TYPE field in the JUMBF Description Box will be set to a different identifier value (indicating a content type other than AIGC Content Type). Then, S405-S406 will be performed.
[0202] Based on the descriptions in Figures 3a and 3b, in any possible manner, a field may be added to the JUMBF Description Box in this application, which indicates whether the media content is AIGC.
[0203] Figure 5a is an example of the structure of a JUMBF Description Box.
[0204] Please refer to Figure 5a. For example, based on Figure 3b, an AIGCI (AIGC Identity) field may be added to the JUMBF Description Box, and the AIGCI field may indicate whether the media content is AIGC. The AIGCI field in the JUMBF Description Box may be used as the AIGC identifier in the embodiment of Figure 2. For example, the AIGCI field may be defined with multiple identifier values (which may include one pre-configured identifier value and at least one other identifier value). For example, two identifier values, "1" and "0", may be defined. "1" may be a pre-configured identifier value indicating that the media content is AIGC, and "0" may be another identifier value indicating that the media content is not AIGC.
[0205] Figure 5b is a diagram illustrating an example of the metadata generation process. Figure 5b is based on Figure 5a.
[0206] S501: Retrieve the image.
[0207] S502: Determine whether the image is AIGC.
[0208] S503: Generate a JUMBF Content Box.
[0209] For example, image-related information can be encapsulated as a JUMBF Content Box corresponding to one of the following: Codestream Content Type, UUID Content Type, XML Content Type, JSON Content Type, CBOR Content Type, and Embedded File Content Type.
[0210] Figure 5c is an example of the structure of a JUMBF Content Box.
[0211] See (1) in Figure 5c. For example, the Content Type of a JUMBF Content Box is a Codestream Content Type. In this case, the JUMBF Content Box is sometimes called a Codestream Box. A Codestream Box contains a Code field, which is used to store relevant information about the media content. For example, relevant information about an image may be encoded and then entered into the Code field to obtain a Codestream Box.
[0212] See (2) in Figure 5c. For example, the Content Type of a JUMBF Content Box is either XML Content Type or JSON Content Type. In this case, the JUMBF Content Box may be called an XML Box or a JSON Box. An XML Box or JSON Box may contain a Data field, which is used to store relevant information about the media content. For example, relevant information about an image may be represented using XLM, which is then populated into the Data field to obtain an XML Box. For example, relevant information about an image may be represented using JSON, which is then populated into the Data field to obtain a JSON Box.
[0213] See (3) in Figure 5c. For example, the Content Type of a JUMBF Content Box is a UUID Content Type. In this case, a JUMBF Content Box is sometimes called a UUID Box. A UUID Box may contain an ID field and a Data field. The ID field may contain a single 16-byte UUID, which describes the specific information stored in the Data field. The Data field is used to store information related to the media content. For example, information related to an image may be represented using a UUID, which is then entered into the Data field, and the ID field is entered accordingly to obtain the UUID Box.
[0214] For example, there might be a single JUMBF Content Box. In this case, the Data field within the JUMBF Content Box could contain all the information related to the image.
[0215] For example, there may be multiple JUMBF Content Boxes. In this case, the Data field within each JUMBF Content Box may contain some of the information related to the image, and the Data field within each JUMBF Content Box may contain different related information about the image.
[0216] S504: Generate a JUMBF Description Box and set the field value of the AIGCI field within the Description Box to a pre-configured identifier value.
[0217] For example, in the process of generating a JUMBF Description Box, the field value of the AIGCI field within the JUMBF Description Box may be set to a pre-configured identifier value, another field may be entered, and the JUMBF Description Box may be obtained.
[0218] In the embodiment shown in Figure 5b, note that the identifier value of the TYPE field may be set to a different identifier value (indicating a content type other than AIGC Content Type).
[0219] S505: Retrieve the JUMBF box based on the JUMBF content box and JUMBF description box.
[0220] S506: Retrieve JPEG files based on the image and JUMBF box.
[0221] For example, for S505 and S506, please refer to the above explanation for S405 and S406. Details are not repeated in this specification.
[0222] Figure 5d is a diagram showing an example of the structure of a JUMBF box.
[0223] Please refer to Figure 5d. For example, the JUMBF box of an AI-generated image may contain a JUMBF Description Box, n XML Boxes (which may include XML Box 1, XML Box 2, ..., and XML Box n), and an Other Box. "AIGCI: 1" in the JUMBF Description Box indicates that the image is AIGC, and "TYPE: XML" in the JUMBF Description Box indicates that the Content Type of the JUMBF Content Box is XML Content Type.
[0224] Based on the descriptions in Figures 3a and 3b, in a possible manner, a field may be added to the JUMBF Content Box in this application, which indicates whether the media content is an AIGC.
[0225] Figure 6a is a diagram illustrating an example of the structure of a JUMBF Content Box.
[0226] See (1) in Figure 6a. For example, based on (1) in Figure 5c, an AIGCI field may be added to the Codestream Box, and the AIGCI field may indicate whether the media content is AIGC. The AIGCI field in the Codestream Box may be used as an AIGC identifier in the embodiment of Figure 2.
[0227] See (2) in Figure 6a. For example, based on (2) in Figure 5c, an AIGCI field may be added to the XML Box or JSON Box, and the AIGCI field may indicate whether the media content is AIGC. The AIGCI field in the XML Box or JSON Box may be used as an AIGC identifier in the embodiment of Figure 2.
[0228] See (3) in Figure 6a. For example, based on (3) in Figure 5c, an AIGCI field may be added to the UUID Box, and the AIGCI field may indicate whether the media content is AIGC. The AIGCI field in the UUID Box may be used as an AIGC identifier in the embodiment of Figure 2.
[0229] For example, the AIGCI field may have multiple identifier values defined (which may include one pre-configured identifier value and at least one other identifier value). For instance, two identifier values, "1" and "0," may be defined. "1" could be a pre-configured identifier value indicating that the media content is AIGC, and "0" could indicate that the media content is not AIGC.
[0230] Figure 6b is a diagram illustrating an example of the metadata generation process. Figure 6b is based on Figure 6a.
[0231] S601: Retrieve the image.
[0232] S602: Determine whether the image is AIGC.
[0233] S603: Create a JUMBF Content Box and set the field value of the AIGCI field within the JUMBF Content Box to a pre-configured identifier value.
[0234] For example, as shown in (1) in Figure 6a, the image-related information may be encoded and entered into the Code field, the field value of the AIGCI field may be set to a pre-configured identifier value, and the Codestrem Box may be obtained.
[0235] For example, as shown in (2) in Figure 6a, the image's associated information can be represented using XML and then entered into the Data field, the field value of the AIGCI field can be set to a pre-configured identifier value, and an XML Box can be obtained. Alternatively, the image's associated information can be represented using JSON and then entered into the Data field, the field value of the AIGCI field can be set to a pre-configured identifier value, and a JSON Box can be obtained.
[0236] For example, as shown in (3) in Figure 6a, the image's associated information can be represented using a UUID and then entered into the Data field, the field value of the AIGCI field can be set to a pre-configured identifier value, and the UUID Box can be obtained.
[0237] S604: Generate a JUMBF Description Box.
[0238] For example, in the process of generating a JUMBF Description Box, the field value of the TYPE field within the JUMBF Description Box may be set to a different identifier value, and another field may be populated to obtain the JUMBF Description Box.
[0239] S605: Retrieve the JUMBF box based on the JUMBF content box and JUMBF description box.
[0240] S606: Retrieves JPEG files based on the image and JUMBF box.
[0241] For example, for S605 and S606, please refer to the above explanation for S405 and S406. Details are not repeated in this specification.
[0242] Figure 6c is a diagram showing an example of the structure of a JUMBF box.
[0243] Please refer to Figure 6c. For example, the JUMBF box of an AI-generated image may contain a JUMBF Description Box, an XML Box (which may include XML Box 1, XML Box 2, ..., and XML Box n), and an Other Box. "TYPE: XML" in the JUMBF Description Box indicates that the Content Type of the JUMBF Content Box is XML Content Type, and "AIGCI: 1" in the XML Box indicates that the image is AIGC.
[0244] For example, the metadata of media content may further include a DNT (Full Name: Do not Train) field (sometimes called a trainability identifier) that may indicate whether the media content can be used for model training.
[0245] For example, the DNT field may have two identifier values defined, such as "1" and "0". "1" may indicate that the media content can be used for model training, and "0" may indicate that the media content cannot be used for model training.
[0246] Figure 7a is a diagram illustrating an example of the structure of a JUMBF Description Box. Figure 7a is based on Figure 3b.
[0247] Please refer to Figure 7a. For example, a JUMBF Description Box may further include a DNT field.
[0248] Figure 7b is a diagram illustrating an example of the structure of an AIGC Content Box. Figure 7b is based on Figure 3c.
[0249] Please refer to Figure 7b. For example, the AIGC Content Box may further include a DNT field.
[0250] It should be understood that the DNT field is an optional field. This application does not limit the location of the DNT field to whether it is located within the JUMBF Content Box or the JUMBF Description Box.
[0251] Figure 7c is an example diagram of the structure of a JUMBF Description Box. Figure 7c is based on Figure 3b.
[0252] For example, metadata for media content may further include a first hash value. See Figure 7c. For instance, a HASH field may be added to a JUMBF Description Box, and the first hash value may reside within the HASH field. It should be understood that the HASH field is an optional field, and the first hash value is optional information.
[0253] For example, when a JUMBF Description Box contains only an AIGC identifier, a hash calculation may be performed on the identifier value of the AIGC identifier according to a hash algorithm to obtain a first hash value.
[0254] For example, when a JUMBF Description Box includes an AIGC identifier and at least one of the following fields: TOGGLE(T), LABEL, ID, SHA256HASH, and DNT, a first hash value can be obtained by performing a calculation according to a hash algorithm on the combination result obtained by combining the identifier value of the AIGC identifier with the field value of at least one of the following fields: TOGGLE(T), LABEL, ID, SHA256HASH, and DNT. It should be understood that this application is not limited to the hash algorithm used to calculate the first hash value. This prevents tampering with the field values of the fields in the JUMBF Description Box.
[0255] Figure 7d is an example diagram of the structure of a JUMBF Description Box. Figure 7d is based on Figure 7c.
[0256] For example, the metadata of media content may further include a digital signature of the first hash value. See Figure 7d. For example, a SIGNATURE field may be added to the JUMBF Description Box, and the digital signature of the first hash value may be located within the SIGNATURE field. Specifically, the digital signature may be obtained by performing a digital signature algorithm on the first hash value using a secret key. It should be understood that this application is not limited to the digital signature algorithm used to calculate the digital signature of the first hash value. This helps to prevent the fields in the JUMBF Description Box from being forged.
[0257] Please understand that the SIGNATURE field is an optional field, and the digital signature of the first hash value is optional information.
[0258] Figure 7e is an example of the structure of a Data field within a JUMBF Content Box.
[0259] For example, the metadata of media content further includes a second hash value, a third hash value, and a digital signature of the third hash value. See (1) in Figure 7e. For example, the second hash value, the third hash value, and the digital signature of the third hash value may be located in the Data field within the JUMBF Content Box.
[0260] For example, the second hash value is the hash value of the media content. Specifically, the second hash value can be obtained by performing a hash calculation on the media content according to a hash algorithm. It should be understood that this application is not limited to the hash algorithm used to calculate the second hash value.
[0261] For example, a third hash value is determined based on the media content's associated information and the second hash value. Specifically, the media content's associated information and the second hash value may be combined (sometimes referred to as being combined or cascaded), and a hash calculation is performed on the combined media content's associated information and the second hash value according to a hash algorithm to obtain the third hash value. It should be understood that this application is not limited to the hash algorithm used to calculate the third hash value.
[0262] For example, a digital signature may be performed on a third hash value according to a digital signature algorithm using a secret key, thereby obtaining the digital signature of the third hash value. It should be understood that this application is not limited to the digital signature algorithm used to compute the digital signature of the third hash value.
[0263] For example, the metadata of media content may further include one or more media declarations and one or more fourth hash values. See (2) in Figure 7e. For example, m (where m is a positive integer) media declarations and m fourth hash values may be located in the Data field within the JUMBF Content Box.
[0264] For example, a media declaration is a declaration about media content. A media declaration may include copyright information, thumbnails, whether the media declaration can be modified, permission to operate, permission to use, and the source of the media content. This is not limited to the present application.
[0265] For example, the fourth hash value is the hash value of the media declaration. This prevents the media declaration from being tampered with. Specifically, a hash calculation can be performed on the media declaration according to a hash algorithm to obtain the fourth hash value, and one media declaration corresponds to one fourth hash value. It should be understood that this application is not limited to the hash algorithm used to calculate the fourth hash value.
[0266] For example, the metadata of media content may further include a fifth hash value. See (3) in Figure 7e. For example, the fifth hash value may be located in the Data field within the JUMBF Content Box.
[0267] For example, the fifth hash value may be determined based on the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.
[0268] For example, a hash calculation may be performed on a combination result obtained by combining a second hash value, a third hash value, the digital signature of the third hash value, and one or more fourth hash values, thereby obtaining an intermediate hash value.
[0269] When an intermediate hash value is obtained by performing a hash calculation by combining the second hash value, the third hash value, the digital signature of the third hash value, and the fourth hash value, the intermediate hash value may be used as the fifth hash value.
[0270] When an intermediate hash value is obtained by performing a hash calculation by combining a second hash value, a third hash value, the digital signature of the third hash value, and a portion of one or more fourth hash values, a fifth hash value may be obtained by performing a hash calculation based on the intermediate hash value and the other portions of the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.
[0271] For example, hash calculation may be performed on a second hash value, a third hash value, a digital signature of the third hash value, and one or more fourth hash values using a hash tree, thereby obtaining a fifth hash value. A hash tree is a data structure and may include, but is not limited to, a binary tree, a ternary tree, a Merkle tree, etc. This is not limited to the present application.
[0272] In a possible way, the fifth hash value is the value of the root node of the hash tree, and the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values are the values of the leaf nodes of the hash tree.
[0273] Figure 7f is a diagram illustrating an example of the fifth hash value generation process.
[0274] In FIG. 7f, the hash tree is a Merkle Tree, the fifth hash value is the value of the root node of the Merkle Tree (Merkle Tree Root, MTR), and can be represented by using the MTR. The second hash value (Media Hash), the third hash value (Hash 3), the digital signature of the third hash value (Signature 1), and the two fourth hash values (Claim Hash N1 and Claim Hash N2) are the values of the leaf nodes of the Merkle Tree.
[0275] Refer to FIG. 7f. For example, a hash calculation can be performed on the combined Media Hash and Hash 3 to obtain Hash X1 (i.e., an intermediate hash value), a hash calculation can be performed on the combined Signature 1 and Claim Hash N1 to obtain Hash X2 (i.e., an intermediate hash value), and a hash calculation can be performed on Claim Hash N2 to obtain Hash X3 (i.e., an intermediate hash value). Then, a hash calculation is performed on the combined Hash X1 and Hash X2 to obtain Hash X4, and a hash calculation is performed on Hash X3 to obtain Hash X5. Then, a hash calculation is performed on the combined Hash X4 and Hash X5 to obtain the MTR.
[0276] It should be understood that FIG. 7f is only an example of a Merkle Tree. The Merkle Tree in this application can be another data structure. In this application, this is not limited.
[0277] It should be understood that in this application, the leaf nodes of the Merkle Tree and the specific leaf nodes corresponding to the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values are not limited.
[0278] In possible ways, the fifth hash value is the value of the root node of the hash tree, the third hash value is the value of the root node of the left subtree in the hash tree, and the second hash value, the digital signature of the third hash value, and one or more fourth hash values are the values of the leaf nodes of the right subtree in the hash tree.
[0279] Figure 7g is a diagram illustrating an example of the fifth hash value generation process.
[0280] In Figure 7g, the hash tree is a Merkle Tree, and the fifth hash value is the value of the root node of the Merkle Tree, which can be represented by using MTR. The third hash value (Hash 3) is the value of the root node of the left subtree in the Merkle Tree, and the second hash value (Media Hash), the digital signature of the third hash value (Signature 1), and the two fourth hash values (Claim Hash N1 and Claim Hash N2) are the values of the leaf nodes of the right subtree in the Merkle Tree.
[0281] Please refer to Figure 7g. For example, a hash calculation may be performed on the combined Media Hash and Signature 1 to obtain HASH X6 (i.e., an intermediate hash value), and a hash calculation may be performed on the combined Claim Hash N1 and Claim Hash N2 to obtain Hash X7 (i.e., an intermediate hash value). Next, a hash calculation is performed on the combined Hash X6 and Hash X7 to obtain Hash X8. Next, a hash calculation is performed on the combined Hash X8 and Hash 3 to obtain the MTR.
[0282] In this application, it should be understood that the specific leaf nodes that are leaf nodes of the right subtree in a Merkle Tree and that correspond to the second hash value, the digital signature of the third hash value, and one or more fourth hash values are not limited.
[0283] Next, we will explain the process of recognizing media content.
[0284] Figure 8 is a diagram illustrating an example of the recognition process. The embodiment in Figure 8 is a recognition process that corresponds to the metadata generation process in the embodiment in Figure 2.
[0285] S801: Retrieve metadata for media content. The metadata for media content includes the AIGC identifier.
[0286] For example, from the description of the above embodiment, it can be seen that the metadata of media content includes an AIGC identifier that can indicate whether the media content is AIGC. Furthermore, when it is necessary to know whether any media content in an electronic device (which may be media content contained in a media asset generated by the electronic device, or media content contained in a media asset received by the electronic device from another electronic device) is AIGC, the metadata of the media content can be retrieved. Then, based on the metadata of the media content, it is determined whether the media content is AIGC.
[0287] S802: Read the AIGC identifier from the media content metadata.
[0288] S803: Determine whether media content is AIGC based on the AIGC identifier.
[0289] For example, an AIGC identifier may be determined from the metadata of media content, then the value of the AIGC identifier is read, and then it is determined whether the media content is AIGC based on the value of the AIGC identifier.
[0290] For example, if the AIGC identifier value is a pre-set identifier value, the media content is determined to be AIGC. If the AIGC identifier value is a different identifier value, the media content is determined not to be AIGC.
[0291] The process of recognizing media content will be further explained below by using an example where the media content is an image and the metadata is a JUMBF box.
[0292] For example, in the embodiment shown in Figure 4a, the JUMBF Description Box includes a TYPE field. When the TYPE field is an AIGC identifier, refer to the description in the embodiment shown in Figure 9 for the corresponding process of determining whether an image is an AIGC.
[0293] Figure 9 is a diagram illustrating an example of the recognition process. The embodiment in Figure 9 is a recognition process that corresponds to the metadata generation process in the embodiment in Figure 4a.
[0294] S901: Retrieve the JUMBF box of the image. The JUMBF Description Box within the JUMBF box contains the AIGC identifier.
[0295] For example, based on the description of the embodiment in Figure 4a, we can know that the TYPE field in the JUMBF Description Box within the image's JUMBF box is an AIGC identifier. Furthermore, when it is necessary to determine whether an image is AIGC, the image's JUMBF box can be retrieved.
[0296] For example, the JUMBF box can be read from the APP11 tag segment of a JPEG file. Specifically, after the first identifier (jumd) is read from the APP11 tag segment of the JPEG file, data can continue to be read until the second identifier (jumd) is read. In this case, it is determined that the first JUMBF box has been read. After the second identifier (jumd) is read from the APP11 tag segment of the JPEG file, data can continue to be read until the third identifier (jumd) is read. In this case, it is determined that the second JUMBF box has been read. The rest can be deduced by analogy.
[0297] S902: Read the field value of the TYPE field from the JUMBF Description Box within the JUMBF box.
[0298] For example, each time a JUMBF box is read, the data within the JUMBF box can be read. Specifically, after the first identifier (jumd) is read from the JUMBF box, data continues to be read until the second identifier (jumd) is read. In this case, it can be determined that the JUMBF Description Box within the JUMBF box has been read. Then, the field value of the TYPE field within the JUMBF Description Box is read to obtain the value of the AIGC identifier.
[0299] S903: Determine whether the field value of the TYPE field is the pre-set identifier value.
[0300] Next, it can be determined whether the field value of the TYPE field is the pre-set identifier value, that is, whether the value of the AIGC identifier is the pre-set identifier value.
[0301] For example, if the field value of the TYPE field is a pre-configured identifier value, the image may be determined to be an AIGC. In this case, reading the next JUMBF box from the APP 11 tag field may be stopped.
[0302] For example, if the field value of the TYPE field is not a pre-configured identifier value, the reading of the next JUMBF box from the APP 11 tag field may continue, and then S902 and S903 are performed. If the field value of the TYPE field contained in the JUMBF Description Box within all JUMBF boxes in the APP 11 tag field is not a pre-configured identifier value, the image may be determined not to be an AIGC.
[0303] S904: When the value of the AIGC identifier is a pre-set identifier value, the image is determined to be an AIGC image.
[0304] S905: If the value of the AIGC identifier is not a pre-set identifier value, the image is determined not to be AIGC.
[0305] For example, in the embodiments shown in Figures 4a and 6b, the JUMBF Content Box includes an AIGCI field. When the AIGCI field is an AIGC identifier, refer to the description in the embodiment of Figure 10 for the corresponding process of determining whether an image is an AIGC.
[0306] Figure 10 is a diagram illustrating an example of the recognition process. The embodiment in Figure 10 is a recognition process that corresponds to the metadata generation process in the embodiments of Figures 4a and 6b.
[0307] S1001: Retrieve the JUMBF box of the image. The JUMBF Content Box within the JUMBF box contains the AIGCI field.
[0308] For example, based on the descriptions of the embodiments in Figures 4a and 6b, when it is necessary to determine whether an image is AIGC, it can be known that the image's JUMBF box can be retrieved when the JUMBF Content Box within the image's JUMBF box contains an AIGCI field. For the specific process of reading the image's JUMBF box, see the description in S901. Details are not repeated herein.
[0309] S1002: Read the field value of the AIGCI field from the JUMBF Content Box within the JUMBF box.
[0310] For example, each time a JUMBF box is read, data within the JUMBF box may be read. Specifically, after the second identifier (jumd) is read from the JUMBF box, data continues to be read until the third identifier (jumd) is read. In this case, it is determined that the first JUMBF Content Box within the JUMBF box has been read. After the second identifier (jumd) is read, data continues to be read until the third identifier (jumd) is read. In this case, it may be determined that the second JUMBF Content Box within the JUMBF box has been read. The rest can be deduced by analogy.
[0311] After each JUMBF Content Box is read, the field value of the AIGCI field in the AIGCI field within the JUMBF Content Box is read, and then S1003 is performed.
[0312] S1003: Determine whether the field value of the AIGCI field is a pre-configured identifier value.
[0313] For example, if the field value of the AIGCI field is a pre-configured identifier value, the image may be determined to be AIGC. In this case, reading the next JUMBF Content Box from the JUMBF box may be stopped, and reading the next JUMBF box from the APP 11 tag field may be stopped.
[0314] For example, if the field value of the AIGCI field is not a pre-set identifier value, the following JUMBF Content Box may be read from the JUMBF box, and then S1002 and S1003 are performed. If the field value of the AIGCI field contained in all JUMBF Content Boxes within a JUMBF box is not a pre-set identifier value, the following JUMBF box may be read from the APP 11 tag field. If the field value of the AIGCI field contained in all JUMBF Content Boxes within all JUMBF boxes in the APP 11 tag field is not a pre-set identifier value, the image may be determined not to be an AIGC.
[0315] S1004: When the field value of the AIGCI field is a pre-set identifier value, the image is determined to be AIGC.
[0316] S1005: If the field value of the AIGCI field is not a pre-set identifier value, the image is determined not to be an AIGC image.
[0317] For example, in the embodiment shown in Figure 5b, the JUMBF Description Box includes an AIGCI field. When the AIGCI field is an AIGC identifier, refer to the description in the embodiment shown in Figure 11 for the process of determining whether an image is an AIGC.
[0318] Figure 11 is a diagram illustrating an example of the recognition process. The embodiment in Figure 11 is a recognition process that corresponds to the metadata generation process in the embodiment of Figure 5b.
[0319] S1101: Retrieve the JUMBF box of the image. The JUMBF Description Box within the JUMBF box contains the AIGC identifier.
[0320] S1102: Read the field value of the AIGC field from the JUMBF Description Box within the JUMBF box.
[0321] For example, for S1001 and S1002, please refer to the above explanation for S801 and S802. Details are not repeated in this specification.
[0322] Note that in S1102, after the JUMBF Description Box is read, the field value of the AIGCI field within the JUMBF Description Box may be read to obtain the value of the AIGC identifier.
[0323] S1103: Determine whether the field value of the AIGC field is a pre-configured identifier value.
[0324] S1104: When the field value of the AIGC field is a pre-set identifier value, the image is determined to be an AIGC image.
[0325] S1105: If the field value of the AIGC field is not a pre-set identifier value, the image is determined not to be an AIGC image.
[0326] In addition, when it is necessary to use media content for AI model training, the field value of the DNT field may be read from the metadata of the media content, and then it is determined based on the field value of the DNT field whether it is possible to use the media content for AI model training. If it is determined based on the field value of the DNT field that it is possible to use the media content for AI model training, the media content may be used as a training sample in the AI model's training set. If it is determined based on the field value of the DNT field that it is not possible to use the media content for AI model training, there is no need to add the media content to the AI model's training set. For specific methods of reading the field value of the DNT field, please refer to the description of how to read the value of the AIGC identifier in the embodiments shown in Figures 8 to 11. Details are not repeated in this specification.
[0327] Figure 12 shows an example of a metadata generation device. The metadata generation device may be configured to carry out the method in the above embodiment. Therefore, for the beneficial effects that can be achieved by the metadata generation device, please refer to the beneficial effects in the corresponding method provided above. Details will not be repeated in this specification.
[0328] Please refer to Figure 12. For example, the metadata generation device is A content acquisition module 1201 configured to acquire media content, It may include a metadata generation module 1202 configured to generate metadata for media content, the metadata for media content including an artificial intelligence-generated content AIGC identifier, the AIGC identifier indicating whether the media content is AIGC.
[0329] For example, the metadata generation module 1202 is further configured to retrieve media assets corresponding to media content based on media content and metadata of media content.
[0330] Figure 13 shows an example of a recognition device. The metadata generation device may be configured to carry out the method in the above embodiment. Therefore, for the beneficial effects that can be achieved by the metadata generation device, please refer to the beneficial effects in the corresponding method provided above. Details will not be repeated in this specification.
[0331] Please refer to Figure 13. For example, the recognition device is A metadata retrieval module 1301 configured to retrieve metadata for media content, A reading module 1302 configured to read an AIGC identifier from the metadata of media content, It may include a determination module 1303 configured to determine whether media content is AIGC based on an AIGC identifier.
[0332] For example, Figure 14 is a block diagram of a device 1400 according to one embodiment of the present application. The device 1400 may include a processor 1401 and a transceiver / transceiver pin 1402, and optionally further include a memory 1403.
[0333] Each component of device 1400 is coupled together through bus 1404. In addition to the data bus, bus 1404 further includes a power bus, a control bus, and a status signal bus. However, for clarity, the various types of buses in the diagram are referred to as bus 1404.
[0334] Optionally, memory 1403 may be configured to store the instructions in the above embodiment of the method. The processor 1401 may be configured to execute the instructions in memory 1403, control the receive pin to receive signals, and control the transmit pin to transmit signals.
[0335] The apparatus 1400 may be an electronic device or a chip of an electronic device in the above-described embodiment of the method.
[0336] All relevant content of the steps in the above-described method embodiments may be referenced in the description of the function of the corresponding function module. Details are not repeated herein.
[0337] One embodiment of this application further provides a chip comprising one or more interface circuits and one or more processors. The one or more processors receive or transmit data through the one or more interface circuits. The steps in the above embodiment are carried out when the one or more processors execute computer instructions. The interface circuit is a transceiver / transceiver pin 1402.
[0338] One embodiment further provides a computer-readable storage medium that stores computer instructions. When a computer instruction is executed on an electronic device, the electronic device can perform the associated method steps described above to realize the method in the above embodiment.
[0339] One embodiment further provides a computer program product, which includes computer instructions. When a computer or processor executes a computer instruction, the computer can perform the associated steps described above to realize the method in the above embodiment.
[0340] In addition, one embodiment of the present application further provides an apparatus, which may specifically be a chip, a component, or a module. The apparatus may include an attached processor and memory, the memory being configured to store computer executable instructions. When the apparatus is in operation, the processor executes the computer executable instructions stored in the memory, enabling the chip to carry out the method in the above-described embodiment.
[0341] The electronic devices, computer-readable storage media, computer program products, or chips provided in the embodiments are configured to implement the corresponding methods provided above. Therefore, for the beneficial effects that can be achieved, please refer to the beneficial effects in the corresponding methods provided above. Details are not described herein.
[0342] Based on the above description of the implementation configuration, those skilled in the art will understand that the above division into functional modules is used as an illustrative example for the sake of providing a convenient and simple explanation. In actual applications, the above functions may be assigned to and implemented in different functional modules, depending on the requirements. In other words, the internal structure of the device is divided into different functional modules, each performing all or some of the above functions.
[0343] It should be understood that in some embodiments provided in this application, the disclosed apparatus and methods may be carried out in other forms. For example, the described apparatus embodiments are merely examples. For example, modularization or division into each unit is merely a logical functional division, and other divisions may be possible in actual implementations. For example, multiple units or components may be combined or integrated as a separate apparatus, or some features may be ignored or not implemented. In addition, mutual coupling, direct coupling, or communication connections shown or discussed may be implemented by using some interfaces. Indirect coupling or communication connections between apparatus or units may be implemented electronically, mechanically, or in other forms.
[0344] The units described as separate parts may or may not be physically separate, and the parts shown as a unit may be one or more physical elements, may be located in one place, or may be dispersed in different locations. Some or all of the units may be selected based on the actual requirements for achieving the objectives of the solution of the embodiment.
[0345] In addition, the functional units in the embodiments of this application may be integrated as a single processing unit, or each unit may exist physically independently, or two or more units may be integrated as a single unit. The integrated unit may be implemented in hardware form or in the form of a software functional unit.
[0346] Any content in the embodiments of this application can be freely combined with any content in the same embodiments. Any combination of the above content is within the scope of this application.
[0347] The integrated unit may be implemented in the form of a software function unit and, when sold or used as an independent product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of this application may be implemented in the form of a software product, or the portion contributing to the prior art may be implemented in the form of a software product, or all or part of the technical solutions may be implemented in the form of a software product. The software product is stored in a storage medium and includes several instructions for instructing a device (which may be a single-chip microcomputer, chip, etc.) or processor to perform all or part of the steps of the method described in the embodiments of this application. The storage medium includes various media capable of storing program code, such as USB flash drives, removable hard disk drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0348] Embodiments of the present application have been described above with reference to the attached drawings. However, the present application is not limited to the specific implementation configurations described above. The specific implementation configurations described above are merely examples, not limitations. Those skilled in the art may draw inspiration from the present application and make further modifications without departing from the purpose and scope of the claims of the present application, all modifications being within the scope of the protection of the present application.
[0349] The methods or algorithmic steps described in conjunction with the content disclosed in this embodiment of the application may be implemented by hardware or by a processor by executing software instructions. Software instructions may include corresponding software modules. Software modules may be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, removable hard disks, compact disc read-only memory (CD-ROM), or any other form of storage medium known in the art. For example, the storage medium may be coupled to a processor, thereby enabling the processor to read information from and write information to the storage medium. Of course, the storage medium may be a component of the processor. The processor and storage medium may be located within an ASIC.
[0350] Those skilled in the art should recognize that in one or more of the embodiments described above, the functions described in the embodiments of this application may be implemented by hardware, software, firmware, or any combination thereof. When the functions are implemented by software, the functions may be stored in a computer-readable medium or transmitted as one or more instructions or code in a computer-readable medium. The computer-readable medium includes a computer-readable storage medium and a communication medium, the communication medium including any medium that enables the transmission of a computer program from one location to another. The storage medium may be any available medium accessible by a general-purpose computer or a dedicated computer.
[0351] Embodiments of the present application have been described above with reference to the attached drawings. However, the present application is not limited to the specific implementation configurations described above. The specific implementation configurations described above are merely examples, not limitations. Those skilled in the art may draw inspiration from the present application and make further modifications without departing from the purpose and scope of the claims of the present application, all modifications being within the scope of the protection of the present application. [Explanation of Symbols]
[0352] 101 Main Interface 1201 Content Acquisition Module 1202 Metadata Generation Module 1301 Metadata Retrieval Module 1302 Read Module 1303 Judgment Module 1400 equipment 1401 Processor 1402 Transceiver / Transceiver Pin 1403 memory 1404 Bus
Claims
1. A metadata generation method, wherein the method is Steps to acquire media content, A method comprising the step of generating metadata for the media content, wherein the metadata for the media content includes an artificial intelligence generated content (AIGC) identifier, and the AIGC identifier indicates whether the media content is AIGC.
2. The method according to claim 1, wherein the metadata of the media content further includes a first hash value, the first hash value being a hash value of data including the AIGC identifier.
3. The method according to claim 2, wherein the metadata of the media content further includes a digital signature of the first hash value.
4. The method according to any one of claims 1 to 3, wherein the metadata of the media content further includes a training-enable identifier, the training-enable identifier indicating whether the media content can be used for model training.
5. The method according to any one of claims 1 to 4, wherein the metadata of the media content further includes at least one of a model identifier, a model version identifier, a model parameter data volume identifier, or a model training set data volume identifier.
6. The method according to any one of claims 1 to 5, wherein the metadata of the media content further includes related information of the media content.
7. The method according to claim 6, wherein the metadata of the media content further includes a second hash value, a third hash value, and a digital signature of the third hash value, the second hash value being the hash value of the media content, and the third hash value being the hash value of data including the associated information of the media content and the second hash value.
8. The method according to claim 7, wherein the metadata of the media content further comprises one or more media declarations and one or more fourth hash values, the media declaration being a declaration about the media content and the fourth hash value being the hash value of the media declaration.
9. The method according to claim 8, wherein the metadata of the media content further includes a fifth hash value, the fifth hash value being a hash value of data including the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.
10. The aforementioned method, The method according to any one of claims 1 to 9, further comprising the step of obtaining a media asset corresponding to the media content based on the media content and the metadata of the media content.
11. The method according to any one of claims 1 to 10, wherein the metadata of the media content is a JPEG General Metadata Box format JUMBF box, the JUMBF box includes a JUMBF description box and a JUMBF content box, and the JUMBF description box and / or the JUMBF content box includes an AIGC identifier.
12. The method according to claim 11, wherein the JUMBF content box further includes the relevant information of the media content.
13. The method according to claim 12, wherein the JUMBF content box further includes at least one of the model identifier, the model version identifier, the model parameter data volume identifier, or the model training set data volume identifier.
14. The method according to claim 12 or 13, wherein the related information of the media content includes at least one of the following: the time the media content was created, the name of the author of the media content, the digital content identifier of the media content, the location where the media content was created, information about the media content creation device for the media content, the resolution of the media content, or the size of the media content.
15. The JUMBF description box further includes the first hash value, an implementable state identifier, a content request identifier, identification information, and a sixth hash value. The method according to any one of claims 12 to 14, wherein the sixth hash value is determined based on the JUMBF content box, and the first hash value is a hash value of data including the AIGC identifier, the implementable state identifier, the content request identifier, the identification information, and the sixth hash value.
16. A method of recognition, wherein the method is Steps to obtain metadata for media content, The steps include reading the AIGC identifier for artificial intelligence-generated content from the metadata of the media content, A method comprising the step of determining whether the media content is AIGC based on the AIGC identifier.
17. The aforementioned method, The method according to claim 16, further comprising the step of determining that the media content is AIGC when the value of the AIGC identifier is a pre-set identifier value.
18. The method according to claim 16 or 17, wherein the metadata of the media content is a JPEG General Metadata Box format JUMBF box, the JUMBF box includes a JUMBF description box and a JUMBF content box, and the JUMBF description box and / or the JUMBF content box includes the AIGC identifier.
19. A metadata generation device, wherein the device, A content retrieval module configured to acquire media content, A device comprising: a metadata generation module configured to generate metadata for media content, wherein the metadata for media content includes an artificial intelligence generated content (AIGC) identifier, and the AIGC identifier indicates whether the media content is AIGC.
20. A recognition device, wherein the device is A metadata retrieval module configured to retrieve metadata for media content, A reading module configured to read an AIGC identifier for artificial intelligence-generated content from the metadata of the media content, An apparatus comprising: a determination module configured to determine whether the media content is AIGC based on the AIGC identifier.
21. It is an electronic device, It comprises memory and a processor, the memory being coupled to the processor, The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device is able to carry out the metadata generation method described in any one of claims 1 to 15.
22. It is an electronic device, It comprises memory and a processor, the memory being coupled to the processor, The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device becomes capable of performing the recognition method described in any one of claims 16 to 18.
23. A chip comprising one or more interface circuits and one or more processors, wherein the one or more processors receive or transmit data through the one or more interface circuits, and when the one or more processors execute a computer instruction, the steps of the method according to any one of claims 1 to 18 are performed.
24. A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed on a computer or processor, the computer or processor is able to carry out the method described in any one of claims 1 to 18.
25. A computer program product comprising computer instructions, wherein when the computer instructions are executed by a computer or processor, the steps of the method described in any one of claims 1 to 18 are performed.