Metadata generation method, metadata identification method and electronic equipment

Abstract

The embodiment of the invention provides a metadata generation method, a metadata identification method and electronic equipment. The method comprises the following steps: firstly, acquiring media content; next, metadata of the media content is generated, the metadata of the media content comprises an AIGC (Artificial Intelligence Generation Content) identifier, and the AIGC identifier indicates whether the media content is the AIGC or not; further, subsequently, whether the media content is the AIGC or not can be identified according to the AIGC identifier in the metadata of the media content; therefore, the user can be helped to judge the authenticity of the media content to a certain extent, and the vigilance of the user in using (such as forwarding) the media content is improved to a certain extent.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of data processing, and in particular to a metadata generation method, an identification method and an electronic device. Background Art

[0002] With the development of artificial intelligence (AI) technology, AI-generated content (AIGC) has exploded; AIGC can create novel, interesting, and diverse digital content (such as images, music, and natural language) and meet the preferences and scenarios of different users.

[0003] However, AI generation may affect the authenticity and credibility of information. For example, AIGC may be used to spread false information. Therefore, it is very important to identify AIGC. Summary of the invention

[0004] In order to help users identify whether media content is AIGC, the present application provides a metadata generation method, identification method and electronic device; the metadata generated by the generation method may include an AIGC identifier indicating whether the media content is AIGC, and then the media content may be identified as AIGC based on the AIGC identifier in the metadata of the media content. In this way, it can help users to judge the authenticity of media content to a certain extent, and improve the vigilance of users in using (such as forwarding) media content to a certain extent.

[0005] In a first aspect, an embodiment of the present application provides a method for generating metadata, the method comprising: first, acquiring media content; then, generating metadata of the media content, the metadata of the media content including an AIGC identifier of artificial intelligence generated content, the AIGC identifier indicating whether the media content is AIGC. Then, the AIGC identifier can be obtained from the metadata of the media content, and whether the media content is AIGC can be determined based on the AIGC identifier. In this way, it can help users to judge the authenticity of media content to a certain extent (for example, when it is determined that the media content is AIGC, it can be determined that the probability of the information contained in the media content package being false is high, and other methods can be used to further judge the authenticity of the media content later), and to a certain extent improve the user's vigilance in using (such as forwarding) media content (for example, when it is determined that the media content is AIGC, the user can further verify whether the media content has copyright, determine whether the media content contains personal information, and verify whether the media content contains false information, etc. When it is determined that the media content has copyright, or the media content contains personal information, or the media content contains false information, the media content can be not used. When it is verified that the media content does not have copyright, does not contain personal information, and does not contain false information, the media content can be used.)

[0006] Exemplarily, media content includes, but is not limited to: images, graphics, videos, audios, etc., which are not limited in this application.

[0007] Exemplarily, metadata of media content may include data for describing the media content; for example, metadata may include information describing properties of the media content.

[0008] It should be noted that the metadata generation method of the present application is applied to the generation (creation) stage of media assets, corresponding to the metadata generation process in the media asset generation stage.

[0009] Exemplarily, when the media content is AIGC, the value of the AIGC identifier in the metadata of the media content is a preset identifier value, and the preset identifier value indicates that the media content is AIGC. When the media content is not AIGC, the value of the AIGC identifier in the metadata of the media content is other identifier values, and the other identifier values ​​indicate that the media content is not AIGC. It should be understood that the preset identifier value is different from the other identifier values, and for the AIGC identifier, a preset identifier value and one or more other identifier values ​​can be predefined.

[0010] According to the first aspect, the metadata of the media content further includes a first hash value, which is a hash value of data including the AIGC identifier. In this way, the AIGC identifier can be prevented from being tampered with.

[0011] Exemplarily, the first hash value is a hash value of data including the AIGC identifier, which can be understood as the first hash value is a hash value of certain data; wherein, “certain data” may include the AIGC identifier.

[0012] Exemplarily, when "certain data" only includes the AIGC identifier, the first hash value may refer to the hash value of the AIGC identifier, or the first hash value is obtained by performing a hash calculation on the AIGC identifier. Specifically, a hash algorithm may be used to perform a hash calculation on the value of the AIGC identifier to obtain the first hash value. It should be understood that the present application does not limit the hash algorithm used to calculate the first hash value.

[0013] It should be understood that the first hash value is optional information in the metadata of the media content.

[0014] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content further includes a digital signature of the first hash value, so that the AIGC mark can be prevented from being forged.

[0015] Exemplarily, the first Hash value may be digitally signed using a private key based on a digital signature algorithm to obtain a digital signature of the first Hash value. It should be understood that the present application does not limit the digital signature algorithm used to calculate the digital signature of the first Hash value.

[0016] It should be understood that the digital signature of the first hash value is optional information in the metadata of the media content.

[0017] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content also includes a training enable flag, which indicates whether the media content is allowed to be used for model training. In this way, it is convenient to subsequently determine whether the media content can be used for AI model training.

[0018] Exemplarily, the training enable flag may be a DNT (full name: DonotTrain) field.

[0019] It should be appreciated that training enables identification as optional information in the metadata of the media content.

[0020] According to the first aspect, or any implementation manner of the first aspect above, the metadata of the media content also includes relevant information of the media content.

[0021] Exemplarily, the relevant information of the media content may refer to information related to the media content, and the relevant information of the media content may include data used to describe the media content, for example, may include information used to describe the attributes of the media content.

[0022] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content also includes at least one of the following: a model identifier, a model version identifier, a model parameter data volume identifier, or a model training set data volume identifier.

[0023] Exemplarily, the model identifier may indicate the type of AI model used to generate media content, such as ChatGPT (a natural language processing tool driven by artificial intelligence technology), Midjourney (an AI drawing tool), etc.

[0024] Exemplarily, the model version identifier may indicate the version of the AI ​​model that generates the media content; such as MidjourneyV4, MidjourneyV5, ChatGPTv3.5, ChatGPTv4, etc.

[0025] Exemplarily, the model parameter data volume identifier may indicate the data volume of the AI ​​model parameters for generating media content, such as 1 million parameters or 10 million parameters.

[0026] Exemplarily, the model training set data volume identifier can indicate the data volume size of the training set of the AI ​​model used to generate media content, such as 1G, 47T.

[0027] In this way, it is convenient to subsequently obtain relevant information of the AI ​​model that generates the media content based on the metadata of the media content.

[0028] It should be understood that the model identifier, model version identifier, model parameter data volume identifier, and model training set data volume identifier are all optional information in the metadata of the media content.

[0029] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content further includes: a second hash value, a third hash value, and a digital signature of the third hash value, the second hash value is a hash value of the media content, and the third hash value is a hash value of data including relevant information of the media content and the second hash value. In this way, the media content and the relevant information of the media content can be prevented from being tampered with, and the relevant information of the media content can be prevented from being forged.

[0030] Exemplarily, the third Hash value is a Hash value of data including relevant information of the media content and the second Hash value. It can be understood that the third Hash value is a Hash value of certain data, where “certain data” may include relevant information of the media content and the second Hash value.

[0031] Exemplarily, when the "certain data" only includes the relevant information of the media content and the second hash value, the third hash value can be obtained by performing a hash calculation on the relevant information of the media content and the second hash value. Specifically, the relevant information of the connected media content and the second hash value can be hashed to obtain the third hash value.

[0032] It should be understood that the second hash value, the third hash value, and the digital signature of the third hash value are all optional information in the metadata of the media content.

[0033] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content also includes one or more media declarations and one or more fourth hash values; the media declaration is a declaration of the media content, and the fourth hash value is a hash value of the media declaration.

[0034] Exemplarily, the media statement may include, but is not limited to: copyright information, thumbnails, whether it can be modified, operating permissions, usage permissions, the source of the media content, editing information, etc.

[0035] It should be understood that the media declaration and the fourth hash value are optional information in the metadata, that is, in the process of generating metadata, a declaration may be made for the media content or not; in this way, the flexibility and backward compatibility of the metadata can be improved.

[0036] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content further includes a fifth hash value, and the fifth hash value is a hash value of data including the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values. In this way, multiple hash values ​​can be associated to further prevent the media content and related information of the media content from being tampered with.

[0037] Exemplarily, the fifth hash value is a hash value of data including the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values. It can be understood that the fifth hash value is the hash value of certain data, where "certain data" may include: the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.

[0038] Exemplarily, when “certain data” only includes the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values, the fifth hash value can be obtained by hashing the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.

[0039] Exemplarily, the second hash value, the third hash value, the digital signature of the third hash value, and one or more of the one or more fourth hash values ​​may be connected and hashed to obtain an intermediate hash value. When the intermediate hash value is obtained by connecting the second hash value, the third hash value, the digital signature of the third hash value, and all items in the fourth hash value and performing a hash calculation, the intermediate hash value may be used as the fifth hash value. When the intermediate hash value is obtained by connecting the second hash value, the third hash value, the digital signature of the third hash value, and some items in one or more fourth hash values ​​and performing a hash calculation, the fifth hash value may be obtained by performing a hash calculation based on the intermediate hash value and the second hash value, the third hash value, the digital signature of the third hash value, and another part of the one or more fourth hash values.

[0040] Exemplarily, the metadata of the media content may also include a digital signature of the fifth hash value; it should be understood that the metadata of the media content may also include other information, which is not limited in this application.

[0041] According to the first aspect, or any implementation of the first aspect above, a media asset corresponding to the media content is obtained according to the media content and metadata of the media content.

[0042] Exemplarily, media content and metadata of the media content may be encapsulated to obtain media assets corresponding to the media content. For example, if the media content is a JPEG (Joint Picture Encoding Group) image, the image and metadata of the image may be encapsulated to obtain a JPEG file (ie, media asset).

[0043] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content is a JUMBF (JPEG Universal Metadata Box Format) box, the JUMBF box includes a JUMBF description box and a JUMBF content box, and the JUMBF description box and / or the JUMBF content box include an AIGC identifier. In this way, whether the media content is AIGC can be identified based on the AIGC identifier read from the JUMBF description box and / or the JUMBF content box.

[0044] Exemplarily, the JUMBF description box is JUMBF Description Box, and the JUMBF content box is JUMBFContent Box.

[0045] For example, a new content type (ContentType) may be defined in JUMBF, which may be called AIGCContent Type, and the corresponding JUMBF Content Box may be called AICG Content Box. Also, for the TYPE field in the JUMBFDescriptionBox, a new identification value (which may be called a preset identification value) may be defined, and the preset identification value may indicate that the JUMBF Content Box is an AICG Content Box (or indicate that the type of the JUMBF Content Box is an AIGC Content Type, which may also be understood as indicating that the media content is AIGC). In this case, the AIGC identification may refer to the TYPE field in the JUMBF Description Box.

[0046] Exemplarily, the present application may add a new field AIGCI (AIGCIidentify) in the JUMBFDescriptionBox, and the AIGCI field may indicate whether the media content is AIGC; the AIGCI field in the JUMBFDescription Box may be used as an AIGC identifier. Exemplarily, multiple identification values ​​(which may include a preset identification value and at least one other identification value) may be defined for the AIGCI field; for example, two identification values ​​"1" and "0" are defined. "1" may be a preset identification value, indicating that the media content is AIGC, and "0" may be another identification value, indicating that the media content is not AIGC.

[0047] Exemplarily, a new field AIGCI field may be added in JUMBFContentBox, and the AIGCI field may indicate whether the media content is AIGC; the AIGCI field in JUMBFContentBox may be used as an AIGC identifier.

[0048] Exemplarily, the JUMBFDescriptionBox may also include a training enable flag.

[0049] According to the first aspect, or any implementation of the first aspect above, the JUMBF content box further includes relevant information of the media content.

[0050] According to the first aspect, or any implementation of the first aspect above, the JUMBF content box further includes at least one of the following: a model identifier, a model version identifier, a model parameter data volume identifier, or a model training set data volume identifier.

[0051] Among them, when the media content is AIGC, JUMBFContentBox can be called AICGContentBox.

[0052] Exemplarily, AICGContentBox may include but is not limited to: AIGCI field, AIModel (AI model) field, AIModelVer (full name AIModelVersion, AI model version) field, ParaSize (full name ParameterSize, AI model parameter data size) field, DataSize (AI model training set data size) field and Data (load data) field.

[0053] Exemplarily, the AIGCI field (also called the AIGC identifier, where the AIGC identifier represented by the TYPE field in the JUMBFDescriptionBox and the AIGC identifier represented by the AIGCI field in the AICGContentBox are two identifiers, but the two have the same function) can also indicate whether the JUMBFContentBox is an AICGContent Box (which can also be understood as indicating whether the media content is AIGC). For example, two identifier values ​​are defined for the AIGCI field: "1" and "0"; "1" indicates that the JUMBFContentBox is an AICGContentBox, and "0" indicates that the JUMBFContentBox is not an AICGContentBox.

[0054] Exemplarily, the AIModel field may also be referred to as a model identifier.

[0055] Exemplarily, the AIModelVer field can also be called a model version identifier.

[0056] Exemplarily, the ParaSize field may also be referred to as a model parameter data size identifier.

[0057] Exemplarily, the DataSize field can also be referred to as the model training set data size identifier.

[0058] Exemplarily, the Data field may be used to store information related to the media content.

[0059] Exemplarily, the JUMBF content box also includes a second hash value, a third hash value, and a digital signature of the third hash value.

[0060] Exemplarily, the JUMBF content box further includes one or more media declarations and one or more fourth hash values.

[0061] Exemplarily, the JUMBF content box also includes a fifth hash value.

[0062] Exemplarily, the JUMBF content box also includes a training enable flag.

[0063] It should be understood that the training enable flag is optional information in the metadata of the media content, and the present application does not limit whether the training enable flag is located in the JUMBFContentBox or the JUMBFDescriptionBox.

[0064] According to the first aspect, or any implementation of the first aspect above, the relevant information of the media content includes at least one of the following: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, information of the media content generation device, the resolution of the media content, or the size of the media content.

[0065] It should be understood that the relevant information of the media content may also include other information such as the media type of the media content or the generation method of the media content, and this application does not limit this.

[0066] Exemplarily, the media type may include, but is not limited to: image type, video type, audio type, graphic type, and text type.

[0067] Exemplarily, the generation methods of media content may include: AI generation method and non-AI generation method. For example, if the media content is an image, the corresponding generation method may include but is not limited to: shooting generation method, screenshot generation method and AI generation method; among which, shooting generation method and screenshot generation method are non-AI generation methods.

[0068] In this way, in addition to identifying whether the media content is AIGC based on the AIGC identifier read from JUMBFDescriptionBox or JUMBFContentBox, it is also possible to identify whether the media content is AIGC based on the generation method of the media content read from the Data field of JUMBFContentBox.

[0069] According to the first aspect, or any implementation of the first aspect above, the JUMBF description box also includes a first hash value, an enablement status identifier, a content request identifier, an identity identifier, and a sixth hash value, and the sixth hash value is determined according to the JUMBF content box; the first hash value is a hash value of data including the AIGC identifier, the enablement status identifier, the content request identifier, the identity identifier, and the sixth hash value. In other words, the field values ​​of each field in the JUMBF description box can be hashed to obtain the first hash value; in this way, the field value of any field in the JUMBF description box can be prevented from being tampered with.

[0070] Exemplarily, the first hash value is a hash value of data including an AIGC identifier, an enabled status identifier, a content request identifier, an identity identifier and a sixth hash value. It can be understood that the first hash refers to the hash value of certain data, where "certain data" may include an AIGC identifier, an enabled status identifier, a content request identifier, an identity identifier and a sixth hash value.

[0071] Exemplarily, when "certain data" only includes the hash value of the AIGC identifier, the enabled status identifier, the content request identifier, the identity identifier and the sixth hash value, the first hash value can be obtained by hashing the AIGC identifier, the enabled status identifier, the content request identifier, the identity identifier and the sixth hash value.

[0072] Exemplarily, the value of the AIGC identifier, the value of the enablement status identifier, the value of the content request identifier, the value of the identity identifier, and one or more of the sixth hash value may be connected and hashed to obtain an intermediate hash value. When the intermediate hash value is obtained by connecting the value of the AIGC identifier, the value of the enablement status identifier, the value of the content request identifier, the value of the identity identifier, and all of the items in the sixth hash value and performing a hash calculation, the intermediate hash value may be used as the first hash value. When the intermediate hash value is obtained by connecting the value of the AIGC identifier, the value of the enablement status identifier, the value of the content request identifier, the value of the identity identifier, and some of the items in the sixth hash value and performing a hash calculation, the first hash value may be obtained by performing a hash calculation based on the intermediate hash value and the value of the AIGC identifier, the value of the enablement status identifier, the value of the content request identifier, the value of the identity identifier, and another part of the items in the sixth hash value.

[0073] Exemplarily, JUMBFDescriptionBox may include multiple fields: TYPE field (type field), TOGGLES (T) field (enabled status field), LABEL field (content request field), ID field (identity field), SHA256HASH field (field for storing the sixth hash value).

[0074] Exemplarily, the TYPE field (which may be referred to as a JUMBF type field or a type identifier) ​​may be used to describe the JUMBF content type (ie, the type of the JUMBF Content Box).

[0075] Exemplarily, the TYPE field may contain a 16-byte UUID, the value of which specifies the type of the JUMBFContent Box.

[0076] Exemplarily, the types of JUMBF Content Box may include, but are not limited to: Codestream Content Type (image codestream content type), UUID Content Type ((Universally unique identifier) ​​content type), XML Content Type ((eXtensible Markup Language) content type), JSON Content Type ((JavaScript Object Notation, JSON, JavaScript object representation) content type), CBOR Content Type ((Concise Binary Object Representation, concise binary object representation) content type), Embedded File Content Type (embedded file content type) and other content types (can be customized).

[0077] Exemplarily, the TYPE field is a required field.

[0078] For example, the TOGGLES(T) field (also referred to as an enable status flag) may contain a 1-byte (8-bit) binary number, which may be used to represent the value of an option associated with the JUMBF box. Each bit is used to represent an option, and when the value of the bit is 1, it indicates that the option is enabled; when the value of the bit is 0, it indicates that the option is disabled.

[0079] Exemplarily, the LABEL field (also referred to as a content request identifier) ​​may include a text label of variable length, which may be used to reference or request the content of the JUMBF box.

[0080] Illustratively, the ID field (also referred to as an identity tag) may contain a unique 4-byte ID assigned by a user, which may be used to reference the JUMBF box in a binary manner.

[0081] Exemplarily, the SHA256HASH field may be used to store a sixth hash value, which is determined based on n JUMBF Content Boxes. Exemplarily, the n JUMBF Content Boxes may be connected in the order in which they are in the JUMBF Super Box and then hashed to obtain the sixth hash value.

[0082] Exemplarily, the TOGGLES(T) field, the LABEL field, the ID field, and the SHA256HASH field may be optional fields.

[0083] Exemplarily, a hash algorithm may be used to calculate the identification value of the connected AIGC identification, the field value of at least one of the TOGGLES(T) field, the LABEL field, the ID field, the SHA256HASH field, and the DNT field to obtain a first hash value.

[0084] Exemplarily, the JUMBF description box may also include a digital signature of the first hash value.

[0085] In a second aspect, an embodiment of the present application provides an identification method, which includes: first, obtaining metadata of media content; then, reading an artificial intelligence generated content AIGC identifier from the metadata of the media content; thereafter, judging whether the media content is AIGC based on the AIGC identifier.

[0086] According to the second aspect, when the value of the AIGC identifier is a preset identifier value, it is determined that the media content is AIGC.

[0087] According to the second aspect, or any implementation of the second aspect above, the metadata of the media content is a JPEG universal metadata box format JUMBF box, the JUMBF box includes a JUMBF description box and a JUMBF content box, and the JUMBF description box and / or the JUMBF content box includes an AIGC identifier.

[0088] In a third aspect, an embodiment of the present application proposes a metadata generation device, which includes: a content acquisition module for acquiring media content; a metadata generation module for generating metadata of the media content, the metadata of the media content includes an artificial intelligence generated content AIGC identifier, and the AIGC identifier indicates whether the media content is AIGC.

[0089] It should be understood that the metadata generation device of the third aspect can execute the steps in the first aspect and any implementation manner of the first aspect, which will not be described in detail herein.

[0090] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0091] In a fourth aspect, an embodiment of the present application proposes an identification device, which includes: a metadata acquisition module for acquiring metadata of media content; a reading module for reading an artificial intelligence generated content AIGC identifier from the metadata of the media content; and a judgment module for judging whether the media content is AIGC based on the AIGC identifier.

[0092] It should be understood that the identification device of the fourth aspect can execute the steps in the second aspect and any implementation method of the second aspect, which will not be repeated here.

[0093] The fourth aspect and any implementation of the fourth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can refer to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, which will not be repeated here.

[0094] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising: a memory and a processor, the memory being coupled to the processor; the memory storing program instructions, which, when executed by the processor, enables the electronic device to execute the metadata generation method in the first aspect or any possible implementation of the first aspect.

[0095] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0096] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising: a memory and a processor, wherein the memory is coupled to the processor; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the identification method in the second aspect or any possible implementation of the second aspect.

[0097] The sixth aspect and any implementation of the sixth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the sixth aspect and any implementation of the sixth aspect can refer to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, which will not be repeated here.

[0098] In the seventh aspect, an embodiment of the present application provides a chip, comprising one or more interface circuits and one or more processors; the interface circuit is used to receive signals from a memory of an electronic device and send signals to the processor, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the steps in the first aspect or any possible implementation of the first aspect are executed.

[0099] The seventh aspect and any implementation of the seventh aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the seventh aspect and any implementation of the seventh aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0100] In an eighth aspect, an embodiment of the present application provides a chip comprising one or more interface circuits and one or more processors; the one or more processors receive or send data through the one or more interface circuits, and when the one or more processors execute computer instructions, the steps in the second aspect or any possible implementation method of the second aspect are executed.

[0101] The eighth aspect and any implementation of the eighth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the eighth aspect and any implementation of the eighth aspect can refer to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, which will not be repeated here.

[0102] In a ninth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer or a processor, the computer or the processor executes the metadata generation method in the first aspect or any possible implementation of the first aspect.

[0103] The ninth aspect and any implementation of the ninth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the ninth aspect and any implementation of the ninth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0104] In the tenth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer or a processor, the computer or the processor executes the identification method in the second aspect or any possible implementation of the second aspect.

[0105] The tenth aspect and any implementation of the tenth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the tenth aspect and any implementation of the tenth aspect can refer to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, which will not be repeated here.

[0106] In the eleventh aspect, an embodiment of the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or a processor, the computer or the processor executes the metadata generation method in the first aspect or any possible implementation of the first aspect.

[0107] The eleventh aspect and any implementation of the eleventh aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the eleventh aspect and any implementation of the eleventh aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0108] In the twelfth aspect, an embodiment of the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or a processor, the computer or the processor executes the identification method in the second aspect or any possible implementation of the second aspect.

[0109] The twelfth aspect and any implementation of the twelfth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the twelfth aspect and any implementation of the twelfth aspect can refer to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0110] Figure 1a is a schematic diagram of an application scenario shown as an example;

[0111] Figure 1b is a schematic diagram of an application scenario shown as an example;

[0112] Figure 1c is a schematic diagram of an exemplary identification method;

[0113] Figure 2 is a schematic diagram of an exemplary metadata generation process;

[0114] Figure 3a is a schematic diagram of the structure of a JUMBF frame shown as an example;

[0115] Figure 3b is a schematic diagram of the structure of a JUMBFDescriptionBox shown as an example;

[0116] Figure 3c is a schematic diagram of the structure of an AICGContentBox shown as an example;

[0117] Figure 4a The schematic diagram of the metadata generation process is shown as an example;

[0118] Figure 4b is a schematic diagram of the structure of a JUMBF frame shown as an example;

[0119] Figure 5a is a schematic diagram of the structure of a JUMBFDescriptionBox shown as an example;

[0120] Figure 5b The schematic diagram of the metadata generation process is shown as an example;

[0121] Figure 5c is a schematic diagram of the structure of JUMBFContentBox shown as an example;

[0122] Figure 5d is a schematic diagram of the structure of a JUMBF frame shown as an example;

[0123] Figure 6a is a schematic diagram of the structure of JUMBFContentBox shown as an example;

[0124] Figure 6b The schematic diagram of the metadata generation process is shown as an example;

[0125] Figure 6c is a schematic diagram of the structure of a JUMBF frame shown as an example;

[0126] Figure 7a is a schematic diagram of the structure of a JUMBFDescriptionBox shown as an example;

[0127] Figure 7b is a schematic diagram of the structure of an AIGCContentBox shown as an example;

[0128] Figure 7c is a schematic diagram of the structure of a JUMBFDescriptionBox shown as an example;

[0129] Figure 7d is a schematic diagram of the structure of a JUMBFDescriptionBox shown as an example;

[0130] Figure 7e This is a schematic diagram of the structure of the Data field in the JUMBFContentBox;

[0131] Figure 7f is a schematic diagram of a fifth Hash value generation process shown as an example;

[0132] Figure 7g is a schematic diagram of a fifth Hash value generation process shown as an example;

[0133] Figure 8 is a schematic diagram of an exemplary recognition process;

[0134] Fig. 9 is a schematic diagram of an exemplary recognition process;

[0135] Fig.10 is a schematic diagram of an exemplary recognition process;

[0136] Fig.11 is a schematic diagram of an exemplary recognition process;

[0137] Fig.12 is a schematic diagram of an exemplary metadata generation device;

[0138] Fig.13 is a schematic diagram of an illustrative identification device;

[0139] Fig.14 Schematic diagram of the structure of the device shown as an example. DETAILED DESCRIPTION

[0140] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0141] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0142] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0143] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0144] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0145] To facilitate understanding, some professional terms mentioned in the embodiments of the present application are first introduced.

[0146] 1. Media Asset

[0147] Media assets may include media content and metadata of the media content. The metadata of the media content is bound to the media content, or the metadata of the media content is associated with the media content).

[0148] It should be noted that in some scenarios, media assets are also referred to as media files; for example, if the media content is a JPEG (Joint Picture Encoding Group) image, the corresponding media asset can be referred to as a JPEG file.

[0149] 2. Media Content

[0150] Media content can also be called digital content. Digital content is the content of different content types such as text, images, and sounds in digital form. It can be stored on digital carriers such as CDs and hard disks, and spread through the Internet and other means. Digital content is the overall product or service that integrates images, text, audio and video through digital technology. It is the product of the combination of digital media technology and cultural creativity.

[0151] Digital technology is a science and technology that is closely associated with electronic computers. It refers to the technology that uses certain equipment to convert various information, including pictures, text, sound, and images, into binary numbers "0" and "1" that can be recognized by electronic computers for calculation, processing, storage, transmission, dissemination, and restoration. Since computers are used to encode, compress, and decode information in the calculation and storage process, it is also called digital technology, computer digital technology, etc. Digital technology is also called digital control technology.

[0152] 3. Metadata

[0153] Metadata may include data describing media content; for example, metadata may include information describing properties of the media content.

[0154] Figure 1a FIG. 1 is a schematic diagram of an exemplary application scenario. Figure 1a In the example, the media content is an image.

[0155] Reference Figure 1a For example, after mobile phone A of user A receives an image sent by mobile phone B of user B, if user A needs to use the image (such as forwarding), mobile phone A can first determine whether the image is AIGC. After determining that the image is AIGC, it can further verify whether the media content has copyright, determine whether the media content contains personal information, and verify whether the media content contains false information, etc.; then determine whether to use the image.

[0156] It should be understood that Figure 1a The mobile phone A may also be other electronic devices with strong computing capabilities, such as a personal computer, a computer workstation, a tablet computer, etc., and this application does not impose any restrictions on this.

[0157] Figure 1b FIG. 1 is a schematic diagram of an exemplary application scenario. Figure 1b In the example, the media content is an image.

[0158] Reference Figure 1b For example, when a user needs to determine whether an image in a smart watch is AIGC, the image in the smart watch can be sent to a mobile phone, and the mobile phone determines whether the image is AIGC.

[0159] It should be understood that Figure 1b The smart watch may also be other electronic devices with weaker computing power, such as media consumption devices, wearable devices, set-top boxes, game consoles, etc., and this application does not impose any restrictions on this. Figure 1b The mobile phone may also be other electronic devices with strong computing capabilities, such as a personal computer, a computer workstation, a tablet computer, etc., and this application does not impose any restrictions on this.

[0160] Figure 1c FIG. 1 is a schematic diagram of an exemplary identification method. Figure 1c , the process of using a mobile phone to determine whether an image is AIGC is shown.

[0161] Exemplarily, the user can open the client of the AIGC recognition platform in the mobile phone (such as an application, a mini-program, a web page, etc.) to perform AIGC recognition.

[0162] Reference Figure 1c (1) The main interface 101 of the client of the AIGC recognition platform may include one or more controls, including but not limited to: an input box, a recognition button, etc., which is not limited in this application.

[0163] Exemplarily, the user can click on the input box, and the client of the AIGC recognition platform can display the file selection interface in response to the user's operation. Then, after the user selects the image to be recognized in the file selection interface, he can click the recognition button in the main interface 101; correspondingly, the client of the AIGC recognition platform can obtain the metadata of the image in response to the user's operation (it should be understood that when mobile phone A receives the image sent by mobile phone B (or when the mobile phone receives the image sent by the smart watch), it also receives the metadata of the image); then, based on the metadata of the image, it identifies whether the image is AIGC.

[0164] In a possible manner, the client of the AIGC recognition platform may perform the recognition of whether the image is AIGC. For example, when there is only one image to be recognized, the client of the AIGC recognition platform may perform the recognition locally.

[0165] In one possible approach, the server of the AIGC recognition platform may perform the identification of whether the image is AIGC. For example, when there are multiple images to be identified, the client of the AIGC recognition platform may send the multiple images to be identified to the server of the AIGC recognition platform, and the server of the AIGC recognition platform may identify the multiple images to be identified and return the identification results to the client of the AIGC recognition platform.

[0166] It should be noted that in the present application, whether the image is AIGC is identified by the client of the AIGC identification platform or by the server of the AIGC identification platform, and is not limited by the number of images to be identified.

[0167] Exemplarily, the client of the AIGC recognition platform may display the recognition result, wherein the recognition result may include that the image is AIGC and that the image is not AIGC.

[0168] Reference Figure 1c (2) Figure 1c The recognition result shown in (2) is that the image is AIGC.

[0169] Reference Figure 1c (3) Figure 1c The recognition result shown in (3) is that the image is not AIGC.

[0170] It should be understood that the user can also manually view the metadata of the image, and then identify whether the image is AIGC based on the metadata of the image; this application does not impose any restrictions on this.

[0171] The following describes the metadata generation process and the media content identification process.

[0172] First, the process of generating metadata of media content is described.

[0173] Figure 2 The following is a schematic diagram of an exemplary metadata generation process.

[0174] S201, acquiring media content.

[0175] Exemplarily, media content may include, but is not limited to: images, audio, video, text, and graphics, etc., which are not limited in this application.

[0176] Exemplarily, when the media content is acquired, the related information of the media content can also be acquired, wherein the related information of the media content can refer to information related to the media content, and the related information of the media content can include data used to describe the media content, for example, can include information used to describe the attributes of the media content. Exemplarily, the related information of the media content can include, but is not limited to: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, the information of the media content generation device, the resolution of the media content, the size of the media content, the media type of the media content, or the generation method of the media content.

[0177] Exemplarily, the media type may include, but is not limited to: image type, video type, audio type, graphic type, and text type.

[0178] Exemplarily, the generation methods of media content may include: AI generation method and non-AI generation method. For example, if the media content is an image, the corresponding generation method may include but is not limited to: shooting generation method, screenshot generation method and AI generation method; among which, shooting generation method and screenshot generation method are non-AI generation methods.

[0179] Exemplarily, the media content in S201 may refer to media content without metadata, and metadata of the media content may be generated based on relevant information of the media content, ie, S202 is executed.

[0180] It should be noted that the metadata generation method of the present application is applied to the generation (creation) stage of media assets, corresponding to the metadata generation process in the media asset generation stage.

[0181] S202: Generate metadata of media content, where the metadata of the media content includes an AIGC identifier, and the AIGC identifier indicates whether the media content is AIGC.

[0182] Exemplarily, in the process of generating metadata of media content, when it is determined that the media content is AIGC, the value of the AIGC identifier can be set to a preset identifier value; wherein the preset identifier value indicates that the media content is AIGC. When it is determined that the media content is not AIGC, the value of the AIGC identifier can be set to other identifier values; wherein the other identifier values ​​indicate that the media content is not AIGC. Then, the metadata of the media content is generated using the relevant information of the media content and the AIGC identifier; that is, the metadata of the media content can include the relevant information of the media content and the AIGC identifier.

[0183] Exemplarily, whether the media content is AIGC can be determined based on the generation method of the media content in the relevant information of the media content. When the generation method of the media content is AI generation method, it can be determined that the media content is AIGC; when the generation method of the media content is non-AI generation method, it can be determined that the media content is not AIGC.

[0184] In this way, it is possible to subsequently identify whether the media content is AIGC based on the AIGC identifier in the metadata of the media content.

[0185] The following takes the case where the media content is an image and the metadata of the media content is a JUMBF (JPEG Universal MetadataBox Format) box as an example to further illustrate the metadata generation process.

[0186] First, the JUMBF frame is introduced.

[0187] Figure 3a FIG. 1 is a schematic diagram of the structure of a JUMBF frame shown as an example.

[0188] Reference Figure 3a For example, the JUMBF box is a super box (JUMBF Super Box), and the JUMBF Super Box must include a JUMBF description box (JUMBF Description Box), n (n is a positive integer) JUMBF content boxes (JUMBFContent Box), and other boxes (for example, a padding box (Padding Box), which can be other types of boxes). Among them, the JUMBF Description Box is located before the JUMBF Content Box.

[0189] For example, the JUMBF Description Box can be used to describe the JUMBF Content Box; the JUMBF Content Box can include relevant information of the media content; and the Padding Box can be used to fill in the data. Of course, other types of Boxes can also be defined, and this application does not limit this.

[0190] Figure 3b FIG. 1 is a schematic diagram showing the structure of a JUMBF Description Box.

[0191] Reference Figure 3b Exemplarily, the JUMBF Description Box may include multiple fields: a TYPE field (type field), a TOGGLES (T) field (enablement status field), a LABEL field (content request field), an ID field (identity field), and a SHA256HASH field (a field for storing a sixth hash value).

[0192] It should be understood that Figure 3b This is only an example of the present application, and the present application may include Figure 3b There may be more or fewer fields, and this application does not impose any restrictions on this.

[0193] Exemplarily, the TYPE field (which may be referred to as a JUMBF type field or a type identifier) ​​may be used to describe the JUMBF content type (ie, the type of the JUMBF Content Box).

[0194] Exemplarily, the TYPE field may contain a 16-byte UUID, the value of which specifies the type of the JUMBFContent Box.

[0195] Exemplarily, the types of JUMBF Content Box may include, but are not limited to: Codestream Content Type (image codestream content type), UUID Content Type ((Universally unique identifier) ​​content type), XML Content Type ((eXtensible Markup Language) content type), JSON Content Type ((JavaScript Object Notation, JSON, JavaScript object representation) content type), CBOR Content Type ((Concise Binary Object Representation, concise binary object representation) content type), Embedded File Content Type (embedded file content type) and other content types (can be customized).

[0196] Exemplarily, the TYPE field is a required field.

[0197] For example, the TOGGLES(T) field (also referred to as an enable status flag) may contain a 1-byte (8-bit) binary number, which may be used to represent the value of an option associated with the JUMBF box. Each bit is used to represent an option, and when the value of the bit is 1, it indicates that the option is enabled; when the value of the bit is 0, it indicates that the option is disabled.

[0198] Exemplarily, the LABEL field (also referred to as a content request identifier) ​​may include a text label of variable length, which may be used to reference or request the content of the JUMBF box.

[0199] Illustratively, the ID field (also referred to as an identity tag) may contain a unique 4-byte ID assigned by a user, which may be used to reference the JUMBF box in a binary manner.

[0200] Exemplarily, the SHA256HASH field may be used to store a sixth hash value, which is determined according to n JUMBFContentBoxes. Exemplarily, the n JUMBFContentBoxes may be connected in the order in which they are in the JUMBF SuperBox and then hashed to obtain the sixth hash value.

[0201] Exemplarily, the TOGGLES(T) field, LABEL field, ID field, and SHA256HASH field are optional fields.

[0202] based on Figure 3a and Figure 3b In one possible way, the present application may define a new content type (ContentType) in JUMBF, which may be called AIGCContentType, and the corresponding JUMBFContentBox may be called AICGContentBox. Also, for the TYPE field in JUMBFDescriptionBox, a new identification value (which may be called a preset identification value) may be defined, and the preset identification value may indicate that the JUMBFContentBox is AICGContentBox (or indicate that the type of the JUMBFContentBox is AIGCContentType, which may also be understood as indicating that the media content is AIGC). In this case, Figure 2 The AIGC identifier in may refer to the TYPE field in the JUMBF DescriptionBox.

[0203] Figure 3c It is a structural diagram of AICGContentBox shown as an example.

[0204] Reference Figure 3c For example, AICGContentBox may include but is not limited to: AIGCI field, AIModel (AI model) field, AIModelVer (full name AIModelVersion, AI model version) field, ParaSize (full name ParameterSize, AI model parameter data size) field, DataSize (AI model training set data size) field and Data (load data) field.

[0205] For example, the AIGCI field (also called the AIGC identifier, where the AIGC identifier represented by the TYPE field in the JUMBFDescriptionBox and the AIGC identifier represented by the AIGCI field in the AICGContentBox are two identifiers, but the two have the same function) can also indicate whether the JUMBFContentBox is an AICGContent Box. For example, two identifier values ​​are defined for the AIGCI field: "1" and "0"; "1" indicates that the JUMBFContent Box is an AICGContentBox, and "0" indicates that the JUMBFContentBox is not an AICGContentBox.

[0206] Exemplarily, the AIModel field (also referred to as a model identifier) ​​can indicate the type of AI model used to generate media content, such as ChatGPT (a natural language processing tool driven by artificial intelligence technology), Midjourney (an AI drawing tool), etc.

[0207] Exemplarily, the AIModelVer field (also known as the model version identifier) ​​can indicate the version of the AI ​​model that generates the media content; such as MidjourneyV4, MidjourneyV5, ChatGPTv3.5, ChatGPTv4, etc.

[0208] For example, the ParaSize field (also known as the model parameter data volume identifier) ​​can indicate the data volume size of the AI ​​model parameters for generating media content, such as 1 million parameters or 10 million parameters.

[0209] Exemplarily, the DataSize field (also referred to as the model training set data volume identifier) ​​can indicate the data volume size of the training set of the AI ​​model used to generate media content, such as 1G, 47T.

[0210] Exemplarily, the Data field may be used to store information related to the media content.

[0211] It should be noted that in Figure 3c In AICGContentBox, the Data field is a required field, and other fields are optional fields.

[0212] Figure 4a The figure is a schematic diagram of the metadata generation process shown as an example. Figure 4a For Figure 3a to Figure 3c shown on the basis of.

[0213] S401, acquiring an image.

[0214] S402, determining whether the image is AIGC.

[0215] Exemplarily, when it is determined that the image is AIGC, S403 may be executed.

[0216] S403, generate AICGContentBox.

[0217] Assume that AICGContentBox is Figure 3cAs shown, the field value of the AIGCI field can be set to 1. When the image is AIGC, the relevant information of the image can also include relevant information of the AI ​​model used to generate the image, such as the type of AI model used to generate the image, the version number of the AI ​​model used to generate the image, the model parameter magnitude of the AI ​​model used to generate the image, and the amount of data in the training set of the AI ​​model used to generate the image; and then the AIModel field, AIModelVer identifier, ParaSize field, and DataSize field can be filled in sequence according to the type of AI model used to generate the image, the version number of the AI ​​model used to generate the image, the model parameter magnitude of the AI ​​model used to generate the image, and the amount of data in the training set of the AI ​​model used to generate the image. And the Data field can be filled with relevant information of the image. In this way, the AICGContentBox can be obtained.

[0218] Exemplarily, there may be one AICGContentBox; in this case, the Data field of the AICGContentBox may contain all the information related to the image.

[0219] Exemplarily, there may be multiple AICGContentBoxes; in this case, the Data field of each AICGContentBox may contain part of the relevant information of the image. The relevant information of the image contained in the Data field of each AICGContentBox is different.

[0220] It should be understood that the present application does not limit the number of AICGContentBoxes generated during the media asset generation phase.

[0221] S404, generating a JUMBFDescriptionBox and setting the field value of the TYPE field in the JUMBFDescriptionBox to a preset identification value.

[0222] Exemplarily, the preset identification value may be an identification value indicating that the JUMBFContentBox is an AICGContentBox, and may be a 16-byte UUID.

[0223] Exemplarily, the field value of the TYPE field in the JUMBFDescriptionBox may be set to a preset identification value, and other fields may be filled to obtain the JUMBFDescriptionBox.

[0224] S405, encapsulate AICGContentBox and JUMBFDescriptionBox to obtain a JUMBF frame.

[0225] Exemplarily, AICGContentBox and JUMBFDescriptionBox may be encapsulated to obtain JUMBFSuperBox, i.e., JUMBF box; thus, metadata of the image may be obtained.

[0226] It should be understood that before S405, OtherBox may be generated. In this case, S405 may encapsulate AICGContentBox, JUMBFDescriptionBox and OtherBox to obtain a JUMBF box. OtherBox may be a PaddingBox or other types of Box defined as the standard evolves, which is not limited in this application.

[0227] Figure 4b FIG. 1 is a schematic diagram of the structure of a JUMBF frame shown as an example.

[0228] Reference Figure 4b For example, the JUMBF box of the AI-generated image may include: JUMBFDescriptionBox, n AICGContentBoxes (which may include AICGContentBox1, AICGContentBox2, ..., AICGContentBoxn) and OtherBox; wherein, "TYPE: AIGC" in JUMBFDescriptionBox indicates that the ContentType of JUMBFContentBox is AIGCContentType.

[0229] It should be noted that both the JUMBFDescriptionBox and the AICGContentBox in the JUMBF box have an identifier (jumd); thus, the JUMBF Description Box and the AICG ContentBox can be read later according to the identifier.

[0230] S406, obtaining a JPEG file according to the image and the JUMBF box.

[0231] Exemplarily, a JPEG file may be created first, wherein the JPEG file includes multiple marker segments. Then, the image and the JUMBF box may be embedded into different marker segments of the JPEG file. For example, the JUMBF box may be embedded into the APP11 marker segment of the JPEG file.

[0232] It should be understood that in S403, when it is determined that the image is not AIGC, a JUMBF Content Box of other content types can be generated, and a JUMBF Description Box can be generated and the field value of the TYPE field in the JUMBF Description Box can be set to other identification values ​​(indicating content types other than AIGC Content Type); thereafter, S405 to S406 are executed.

[0233] based on Figure 3a and Figure 3b In one possible manner, the present application may add a new field in the JUMBF DescriptionBox to indicate whether the media content is AIGC.

[0234] Figure 5a FIG. 1 is a schematic diagram showing the structure of a JUMBF Description Box.

[0235] Reference Figure 5a , for example, in Figure 3b Based on this, a new field AIGCI (AIGC Iidentify) is added to the JUMBF Description Box. The AIGCI field can indicate whether the media content is AIGC. The AIGCI field in the JUMBF Description Box can be used as Figure 2 AIGC identification in the embodiment. Exemplarily, multiple identification values ​​(including a preset identification value and at least one other identification value) may be defined for the AIGCI field; for example, two identification values ​​"1" and "0" are defined. "1" may be a preset identification value, indicating that the media content is AIGC, and "0" may be another identification value, indicating that the media content is not AIGC.

[0236] Figure 5b FIG. 1 is a schematic diagram of an exemplary metadata generation process. Figure 5b is Figure 5a shown on the basis of.

[0237] S501, acquiring an image.

[0238] S502, determining whether the image is AIGC.

[0239] S503, generate a JUMBF Content Box.

[0240] Exemplarily, the image-related information may be encapsulated into a JUMBF Content Box corresponding to any one of the content types of Codestream Content Type, UUIDContent Type, XML Content Type, JSON Content Type, CBOR Content Type, and EmbeddedFile Content Type.

[0241] Figure 5c FIG. 1 is a schematic diagram of the structure of the JUMBF Content Box.

[0242] Reference Figure 5c (1) For example, the Content Type of the JUMBF Content Box is CodestreamContent Type. In this case, the JUMBF Content Box can be called Codestream Box. The Codestream Box includes a Code field, which is used to store relevant information about the media content. For example, the relevant information of the image can be encoded and filled into the Code field to obtain the Codestream Box.

[0243] Reference Figure 5c (2) Exemplarily, the Content Type of the JUMBF Content Box is XML Content Type or JSON Content Type; in this case, the JUMBF Content Box can be called an XML Box or a JSON Box. The XML Box or the JSON Box can include a Data field, and the Data field is used to store relevant information about the media content. Exemplarily, the relevant information about the image can be expressed in XLM and then filled into the Data field to obtain an XMLBox. Exemplarily, the relevant information about the image can be expressed in JSON and then filled into the Data field to obtain a JSONBox.

[0244] Reference Figure 5c(3), exemplarily, the ContentType of JUMBFContentBox is UUIDContentType; in this case, JUMBFContentBox can be called UUIDBox. Among them, UUIDBox can include an ID field and a Data field; the ID field can include a 16-byte UUID indicating the interpretation of specific information stored in the Data field, and the Data field is used to store relevant information of the media content. Exemplarily, the relevant information of the image can be represented by UUID and filled into the Data field, and the ID field can be filled accordingly, so as to obtain a UUIDBox.

[0245] Exemplarily, there may be one JUMBFContentBox; in this case, the Data field in the JUMBFContentBox may include all the information related to the image.

[0246] Exemplarily, there may be multiple JUMBFContentBoxes; in this case, the Data field in each JUMBFContentBox may include part of the image-related information; the image-related information included in the Data field in each JUMBFContentBox is different.

[0247] S504, generating a JUMBFDescriptionBox and setting the field value of the AIGCI field in the DescriptionBox to a preset identification value.

[0248] Exemplarily, in the process of generating the JUMBFDescriptionBox, the field value of the AIGCI field in the JUMBFDescriptionBox may be set to a preset identification value, and other fields may be filled, so as to obtain the JUMBFDescriptionBox.

[0249] It should be noted that in Figure 5b In the embodiment, for the TYPE field, the identification value of the TYPE field can be set to other identification values ​​(indicating a content type other than AIGCContentType).

[0250] S505, obtaining a JUMBF frame according to the JUMBF content frame and the JUMBF description frame.

[0251] S506, obtaining a JPEG file according to the image and the JUMBF box.

[0252] Exemplarily, S505 to S506 may refer to the description of S405 to S406 above, which will not be repeated here.

[0253] Figure 5d FIG. 1 is a schematic diagram of the structure of a JUMBF frame shown as an example.

[0254] Reference Figure 5d , exemplarily, the JUMBF box of the AI-generated image may include: JUMBFDescriptionBox, n XMLBoxes (which may include XMLBox1, XMLBox2, ..., XMLBoxn) and OtherBox; wherein, "AIGCI: 1" in the JUMBFDescriptionBox indicates that the image is AIGC, and "TYPE: XML" in the JUMBFDescription Box indicates that the ContentType of the JUMBFContentBox is XMLContentType.

[0255] based on Figure 3a and Figure 3b In one possible manner, the present application may add a new field in the JUMBFContentBox to indicate whether the media content is AIGC.

[0256] Figure 6a FIG. 1 is a schematic diagram of the structure of a JUMBFContentBox shown as an example.

[0257] Reference Figure 6a (1), for example, in Figure 5c Based on (1), a new field AIGCI is added to CodestreamBox. The AIGCI field can indicate whether the media content is AIGC. The AIGCI field in CodestreamBox can be used as Figure 2 The AIGC identifier in the embodiment.

[0258] Reference Figure 6a (2), illustratively, in Figure 5c Based on (2), a new field AIGCI is added to XMLBox or JSONBox. The AIGCI field can indicate whether the media content is AIGC. The AIGCI field in XMLBox or JSONBox can be used as Figure 2 The AIGC identifier in the embodiment.

[0259] Reference Figure 6a (3), illustratively, in Figure 5c Based on (3), a new field AIGCI is added to UUIDBox. The AIGCI field can indicate whether the media content is AIGC. The AIGCI field in UUIDBox can be used as Figure 2 The AIGC identifier in the embodiment.

[0260] Exemplarily, multiple identification values ​​(including one preset identification value and at least one other identification value) may be defined for the AIGCI field. For example, two identification values ​​"1" and "0" are defined; "1" may be a preset identification value, indicating that the media content is AIGC, and "0" indicates that the media content is not AIGC.

[0261] Figure 6b FIG. 1 is a schematic diagram of an exemplary metadata generation process. Figure 6b is Figure 6a shown on the basis of.

[0262] S601, acquiring an image.

[0263] S602, determining whether the image is AIGC.

[0264] S603, generating a JUMBFContentBox and setting the field value of the AIGCI field in the JUMBFContentBox to a preset identification value.

[0265] For example, Figure 6a As shown in (1), the relevant information of the image can be encoded and filled into the Code field, and the field value of the AIGCI field can be set to a preset identification value, so as to obtain the CodestreamBox.

[0266] For example, Figure 6a As shown in (2), the image-related information may be expressed in XML and then filled into the Data field, and the field value of the AIGCI field may be set to a preset identification value, thereby obtaining an XMLBox. Alternatively, the image-related information may be expressed in JSON and then filled into the Data field, and the field value of the AIGCI field may be set to a preset identification value, thereby obtaining a JSONBox.

[0267] For example, Figure 6a As shown in (3), the image related information can be represented by UUID and filled into the Data field, and the field value of the AIGCI field can be set to a preset identification value, so that the UUIDBox can be obtained.

[0268] S604, generate JUMBFDescriptionBox.

[0269] Exemplarily, in the process of generating the JUMBFDescriptionBox, the field value of the TYPE field in the JUMBFDescriptionBox may be set to other identification values, and other fields may be filled, so as to obtain the JUMBFDescriptionBox.

[0270] S605, obtaining a JUMBF frame according to the JUMBF content frame and the JUMBF description frame.

[0271] S606, obtaining a JPEG file according to the image and the JUMBF box.

[0272] Exemplarily, S605 to S606 may refer to the description of S405 to S406 above, which will not be repeated here.

[0273] Figure 6c FIG. 1 is a schematic diagram of the structure of a JUMBF frame shown as an example.

[0274] Reference Figure 6c , exemplarily, the JUMBF box of the AI-generated image may include: JUMBFDescriptionBox, XMLBox (which may include XMLBox1, XMLBox2, ..., XMLBoxn) and OtherBox; wherein, "TYPE: XML" in JUMBFDescriptionBox indicates that the ContentType of JUMBFContentBox is XMLContentType, and "AIGCI: 1" in XMLBox indicates that the image is AIGC.

[0275] Exemplarily, the metadata of the media content may also include a DNT (full name: Do not Train) field (also referred to as a training enable flag), which may indicate whether the media content is allowed to be used for model training.

[0276] Exemplarily, two identification values ​​may be defined for the DNT field, such as "1" and "0." "1" may indicate that the media content is allowed to be used for model training, and "0" indicates that the media content is not allowed to be used for model training.

[0277] Figure 7a FIG. 1 is a schematic diagram of the structure of a JUMBFDescriptionBox. Figure 7a For Figure 3b shown on the basis of.

[0278] Reference Figure 7a , exemplary, JUMBFDescriptionBox may also include a DNT field.

[0279] Figure 7b : is a schematic diagram of the structure of AIGCContentBox shown as an example. Figure 7b For Figure 3c shown on the basis of.

[0280] Reference Figure 7b, exemplarily, the AIGCContentBox may also include a DNT field.

[0281] It should be understood that the DNT field is an optional field, and the present application does not limit whether the DNT field is located in the JUMBFContentBox or the JUMBFDescriptionBox.

[0282] Figure 7c FIG. 1 is a schematic diagram of the structure of a JUMBFDescriptionBox. Figure 7c For Figure 3b shown on the basis of.

[0283] Exemplarily, the metadata of the media content may also include the first hash value. Figure 7c , exemplarily, a new field HASH may be added in the JUMBFDescriptionBox, and the first HASH value is located in the HASH field. It should be understood that the HASH field is an optional field, and the first HASH value is optional information.

[0284] Exemplarily, when the JUMBFDescriptionBox includes only the AIGC identifier, a hash algorithm may be used to calculate the identifier value of the AIGC identifier to obtain a first hash value.

[0285] Exemplarily, when the JUMBFDescriptionBox includes an AIGC identifier, and at least one of a TOGGLES(T) field, a LABEL field, an ID field, a SHA256HASH field, and a DNT field, a hash algorithm can be used to calculate the identifier value of the connected AIGC identifier, and the field value of at least one of the TOGGLES(T) field, the LABEL field, the ID field, the SHA256HASH field, and the DNT field to obtain a first hash value. It should be understood that the present application does not limit the hash algorithm used to calculate the first hash value. In this way, the field values ​​of the fields in the JUMBFDescriptionBox can be prevented from being tampered with.

[0286] Figure 7d FIG. 1 is a schematic diagram of the structure of a JUMBFDescriptionBox. Figure 7d For Figure 7c shown on the basis of.

[0287] Exemplarily, the metadata of the media content may also include a digital signature of the first hash value. Figure 7dFor example, a new field SIGNATURE can be added to JUMBFDescriptionBox, and the digital signature of the first hash value is located in the SIGNATURE field. Specifically, based on the digital signature algorithm, the first hash value can be digitally signed using a private key to obtain the digital signature of the first hash value. It should be understood that the present application does not limit the digital signature algorithm used to calculate the digital signature of the first hash value. In this way, the fields in JUMBFDescriptionBox can be prevented from being forged.

[0288] It should be understood that the SIGNATURE field is an optional field and the digital signature of the first hash value is optional information.

[0289] Figure 7e FIG. 1 is a schematic diagram showing the structure of the Data field in the JUMBFContentBox.

[0290] Exemplarily, the metadata of the media content may further include: a second hash value, a third hash value, and a digital signature of the third hash value. Figure 7e (1) Exemplarily, the second hash value, the third hash value, and the digital signature of the third hash value may be located in the Data field in the JUMBFContentBox.

[0291] Exemplarily, the second Hash value is a Hash value of the media content. Specifically, a Hash algorithm can be used to perform Hash calculation on the media content to obtain the second Hash value. It should be understood that the present application does not limit the Hash algorithm used to calculate the second Hash value.

[0292] Exemplarily, the third hash value is determined based on the relevant information of the media content and the second hash value. Specifically, the relevant information of the media content and the second hash value can be combined (also called connection or cascade); the combined relevant information of the media content and the second hash value are hashed using a hash algorithm to obtain the third hash value. It should be understood that the present application does not limit the hash algorithm used to calculate the third hash value.

[0293] Exemplarily, the third Hash value may be digitally signed using a private key based on a digital signature algorithm to obtain a digital signature of the third Hash value. It should be understood that the present application does not limit the digital signature algorithm used to calculate the digital signature of the third Hash value.

[0294] Exemplarily, the metadata of the media content may further include: one or more media declarations and one or more fourth hash values. Figure 7e (2) For example, m (m is a positive integer) media declarations and m fourth hash values ​​may be located in the Data field in the JUMBFContentBox.

[0295] Exemplarily, a media declaration is a declaration of media content, wherein the media declaration may include copyright information, thumbnails, whether it can be modified, operating permissions, usage permissions, the source of the media content, etc., and this application does not impose any restrictions on this.

[0296] Exemplarily, the fourth hash value is a hash value of the media statement, so that the media statement can be prevented from being tampered with. Specifically, a hash algorithm can be used to perform a hash calculation on the media statement to obtain a fourth hash value; wherein one media statement corresponds to one fourth hash value. It should be understood that the present application does not limit the hash algorithm used to calculate the fourth hash value.

[0297] Exemplarily, the metadata of the media content may further include a fifth hash value; Figure 7e (3) For example, the fifth hash value may be located in the Data field in the JUMBFContentBox.

[0298] Exemplarily, the fifth hash value can be determined based on the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values.

[0299] Exemplarily, the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values ​​may be concatenated and then hashed to obtain an intermediate hash value.

[0300] When the intermediate hash value is obtained by performing a hash calculation by connecting all items in the second hash value, the third hash value, the digital signature of the third hash value, and the fourth hash value, the intermediate hash value can be used as the fifth hash value.

[0301] When the intermediate hash value is obtained by hashing the second hash value, the third hash value, the digital signature of the third hash value, and part of one or more fourth hash values, the fifth hash value can be obtained by hashing the intermediate hash value and the second hash value, the third hash value, the digital signature of the third hash value, and another part of one or more fourth hash values.

[0302] Exemplarily, a hash tree may be used to perform hash calculation on the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values ​​to obtain a fifth hash value. A hash tree is a data structure, and a hash tree may include but is not limited to a binary tree, a ternary tree, a Merkle Tree, etc., and this application does not limit this.

[0303] In one possible manner, the fifth hash value is the value of the root node of the hash tree, and the second hash value, the third hash value, the digital signature of the third hash value and one or more fourth hash values ​​are respectively the values ​​of the leaf nodes of the hash tree.

[0304] Figure 7f FIG. 1 is a schematic diagram of an exemplary fifth hash value generation process.

[0305] exist Figure 7f In the example, the hash tree is a MerkleTree, and the fifth hash value is the value of the root node (MerkleTreeRoot, MTR) of the MerkleTree, which can be represented by MTR. The second hash value (MediaHash), the third hash value (Hash3), the digital signature of the third hash value (Signature1), and the two fourth hash values ​​(ClaimHashN1 and ClaimHashN2) are the values ​​of the leaf nodes of the MerkleTree.

[0306] Reference Figure 7f For example, the concatenated MediaHash and Hash3 can be hashed to obtain HashX1 (i.e., the intermediate hash value), the concatenated Signature1 and ClaimHashN1 can be hashed to obtain HashX2 (i.e., the intermediate hash value); ClaimHashN2 can be hashed to obtain HashX3 (i.e., the intermediate hash value). After that, the concatenated HashX1 and HashX2 can be hashed to obtain HashX4; and HashX3 can be hashed to obtain HashX5. Then, the concatenated HashX4 and HashX5 can be hashed to obtain MTR.

[0307] It should be understood that Figure 7f This is just an example of MerkleTree. The MerkleTree of this application can be other data structures, and this application does not limit this.

[0308] It should be understood that the present application does not restrict which leaf node of the Merkle Tree the second hash value, the third hash value, the digital signature of the third hash value, and one or more fourth hash values ​​correspond to.

[0309] In one possible manner, the fifth hash value is the value of the root node of the hash tree, the third hash value is the value of the root node of the left subtree of the hash tree, and the second hash value, the digital signature of the third hash value and one or more fourth hash values ​​are respectively the values ​​of the leaf nodes of the right subtree of the hash tree.

[0310] Figure 7g FIG. 1 is a schematic diagram of an exemplary fifth hash value generation process.

[0311] exist Figure 7g In the example, the hash tree is a MerkleTree, the fifth hash value is the value of the root node of the MerkleTree, and can be represented by MTR. The third hash value (Hash3) is the value of the root node of the left subtree of the MerkleTree, and the second hash value (MediaHash), the digital signature of the third hash value (Signature1), and the two fourth hash values ​​(ClaimHash N1 and ClaimHashN2) are the values ​​of the leaf nodes of the right subtree of the MerkleTree.

[0312] Reference Figure 7g For example, the concatenated MediaHash and Signature1 can be hashed to obtain HASHX6 (i.e., the intermediate hash value), and the concatenated ClaimHashN1 and ClaimHashN2 can be hashed to obtain HashX7 (i.e., the intermediate hash value). After that, the concatenated HashX6 and Hash X7 are hashed to obtain HashX8. Subsequently, the concatenated HashX8 and Hash3 are hashed to obtain MTR.

[0313] It should be understood that the present application does not restrict which leaf node of the right subtree of the MerkleTree the second hash value, the digital signature of the third hash value, and one or more fourth hash values ​​correspond to.

[0314] Next, the process of identifying media content is described.

[0315] Figure 8 FIG. 1 is a schematic diagram showing an exemplary recognition process. Figure 8 The embodiment is Figure 2 The metadata generation process of the embodiment corresponds to the identification process.

[0316] S801, obtaining metadata of media content, where the metadata of media content includes an AIGC identifier.

[0317] Exemplarily, according to the description in the above embodiment, the metadata of the media content includes an AIGC identifier that can indicate whether the media content is AIGC; furthermore, for any media content in an electronic device (which can be media content contained in a media asset generated by the electronic device, or media content contained in a media asset received by the electronic device from other electronic devices), when it is necessary to identify whether the media content is AIGC, the metadata of the media content can be obtained; and then, based on the metadata of the media content, it is identified whether the media content is AIGC.

[0318] S802: Read the AIGC identifier from the metadata of the media content.

[0319] S803: Determine whether the media content is AIGC according to the AIGC identifier.

[0320] Exemplarily, the AIGC identifier can be determined from the metadata of the media content; then the value of the AIGC identifier is read; and then, based on the value of the AIGC identifier, it is determined whether the media content is AIGC.

[0321] Exemplarily, when the value of the AIGC identifier is a preset identifier value, the media content is determined to be AIGC. When the value of the AIGC identifier is another identifier value, the media content is determined not to be AIGC.

[0322] The following takes the case where the media content is an image and the metadata is a JUMBF box as an example to further illustrate the process of identifying the media content.

[0323] For example, in Figure 4a In the embodiment, JUMBFDescriptionBox includes a TYPE field. When the TYPE field is an AIGC identifier, the corresponding process of identifying whether the image is AIGC can refer to Fig. 9 Description of embodiments.

[0324] Fig. 9 FIG. 1 is a schematic diagram of an exemplary recognition process. Fig. 9 An embodiment is with Figure 4a The metadata generation process in the embodiment corresponds to the identification process.

[0325] S901, obtaining the JUMBF box of the image, wherein the JUMBFDescriptionBox in the JUMBF box includes an AIGC logo.

[0326] For example, based on Figure 4a From the description of the embodiment, it can be seen that the TYPE field in the JUMBFDescriptionBox of the JUMBF box of the image is an AIGC identifier; further, when it is necessary to determine whether an image is AIGC, the JUMBF box of the image can be obtained.

[0327] Exemplarily, the JUMBF frame can be read from the APP11 marker segment of the JPEG file. Specifically, after the first identifier (jumd) is read in the APP11 marker segment of the JPEG file, data reading can continue until the second identifier (jumd) is read, and it is determined that the first JUMBF frame has been read. After the second identifier (jumd) is read in the APP11 marker segment of the JPEG file, data reading can continue until the third identifier (jumd) is read, and it is determined that the second JUMBF frame has been read, and so on.

[0328] S902, read the field value of the TYPE field from the JUMBFDescriptionBox of the JUMBF box.

[0329] Exemplarily, after each JUMBF box is read, the data in the JUMBF box can be read. Specifically, after the first identifier (jumd) is read in the JUMBF box, data reading continues until the second identifier (jumd) is read. At this time, it can be determined that the JUMBFDescriptionBox in the JUMBF box has been read. Afterwards, the field value of the TYPE field in the JUMBFDescriptionBox is read to obtain the value of the AIGC identifier.

[0330] S903: Determine whether the field value of the TYPE field is a preset identification value.

[0331] Subsequently, it can be determined whether the field value of the TYPE field is a preset identification value, that is, it can be determined whether the value of the AIGC identification is a preset identification value.

[0332] Exemplarily, when the field value of the TYPE field is a preset identification value, it can be determined that the image is AIGC; at this time, reading the next JUMBF box in the APP11 marker segment can be stopped.

[0333] Exemplarily, when the field value of the TYPE field is not the preset identification value, you can continue to read the next JUMBF box in the APP11 marker segment, and then execute S902 and S903; when the field value of the TYPE field included in the JUMBFDescriptionBox in all JUMBF boxes in the APP11 marker segment is not the preset identification value, it can be determined that the image is not AIGC.

[0334] S904: When the value of the AIGC identifier is a preset identifier value, determine that the image is AIGC.

[0335] S905: When the value of the AIGC flag is not a preset flag value, determine that the image is not AIGC.

[0336] For example, in Figure 4a and Figure 6b In the embodiment, JUMBFContentBox includes an AIGCI field. When the AIGCI field is an AIGC identifier, the corresponding process of identifying whether the image is AIGC can refer to Fig.10 Description of embodiments.

[0337] Fig.10 FIG. 1 is a schematic diagram of an exemplary recognition process. Fig.10 The embodiment is with 4a and Figure 6bThe metadata generation process in the embodiment corresponds to the identification process.

[0338] S1001, obtaining the JUMBF box of the image, wherein the JUMBF box JUMBFContentBox includes an AIGCI field.

[0339] For example, based on Figure 4a and Figure 6b As can be seen from the description of the embodiment, when the JUMBF frame of the image includes the AIGCI field, if it is necessary to determine whether an image is AIGC, the JUMBF frame of the image can be obtained. The specific process of reading the JUMBF frame of the image can refer to the description of S901 above, which will not be repeated here.

[0340] S1002, read the field value of the AIGCI field from the JUMBFContentBox of the JUMBF box.

[0341] Exemplarily, after each JUMBF box is read, the data in the JUMBF box can be read. Specifically, after the second identifier (jumd) is read in the JUMBF box, data reading continues until the third identifier (jumd) is read, and it is determined that the first JUMBFContentBox in the JUMBF box has been read. After the second identifier (jumd) is read, data reading continues until the third identifier (jumd) is read, at which point it can be determined that the second JUMBFContentBox in the JUMBF box has been read, and so on.

[0342] After reading each JUMBFContentBox, the field value of the AIGCI field in the JUMBFContentBox may be read; then S1003 is executed.

[0343] S1003, determine whether the field value of the AIGCI field is a preset identification value.

[0344] Exemplarily, when the field value of the AIGCI field is a preset identification value, it can be determined that the image is AIGC; at this time, reading the next JUMBFContentBox from the JUMBF box can be stopped, and reading the next JUMBF box in the APP11 marker segment can be stopped.

[0345] Exemplarily, when the field value of the AIGCI field is not a preset identification value, the next JUMBFContentBox can be read from the JUMBF box, and then S1002 to S1003 can be executed. When the field value of the AIGCI field included in all JUMBF ContentBoxes in the JUMBF box is not a preset identification value, the next JUMBF box can be read from the APP11 marker segment. When the field value of the AIGCI field included in all JUMBFContentBoxes in all JUMBF boxes in the APP11 marker segment is not a preset identification value, it can be determined that the image is not AIGC.

[0346] S1004: When the field value of the AIGCI field is a preset identification value, it is determined that the image is AIGC.

[0347] S1005: When the field value of the AIGCI field is not a preset identification value, it is determined that the image is not AIGC.

[0348] For example, in Figure 5b In the embodiment, JUMBFDescriptionBox includes an AIGCI field. When the AIGCI field is an AIGC identifier, the process of identifying whether the image is AIGC can refer to Fig.11 Description of embodiments.

[0349] Fig.11 FIG. 1 is a schematic diagram of an exemplary recognition process. Fig.11 An embodiment is with Figure 5b The metadata generation process in the embodiment corresponds to the identification process.

[0350] S1101, obtaining a JUMBF box of an image, wherein the JUMBFDescriptionBox of the JUMBF box includes an AIGC logo.

[0351] S1102, read the field value of the AIGC field from the JUMBFDescriptionBox of the JUMBF box.

[0352] Illustratively, S1001 to S1002 may refer to the description of S801 to S802 above, which will not be repeated here.

[0353] It should be noted that, after reading the JUMBFDescriptionBox in S1102, the field value of the AIGCI field in the JUMBFDescriptionBox may be read to obtain the value of the AIGC identifier.

[0354] S1103, determining whether the field value of the AIGC field is a preset identification value.

[0355] S1104: When the field value of the AIGC field is a preset identification value, determine that the image is AIGC.

[0356] S1105: When the field value of the AIGC field is not a preset identification value, it is determined that the image is not AIGC.

[0357] In addition, when media content is needed to train an AI model, the field value of the DNT field can be read from the metadata of the media content; then, based on the field value of the DNT field, determine whether the media content is allowed to be used to train the AI ​​model. When it is determined based on the field value of the DNT field that the media content is allowed to be used to train the AI ​​model, the media content can be used as a training sample in the training set of the AI ​​model; when it is determined based on the field value of the DNT field that the media content is not allowed to be used to train the AI ​​model, there is no need to add the media content to the training set of the AI ​​model. For the specific method of reading the field value of the DNT field, please refer to the above Figure 8 to Figure 11 The description of the method of reading the value of the AIGC identifier in the embodiment will not be repeated here.

[0358] Fig.12 The schematic diagram of the metadata generation device is shown as an example. The metadata generation device can be used to execute the method of the above embodiment, so the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding method provided above, which will not be repeated here.

[0359] Reference Fig.12 , exemplary, the metadata generation device may include:

[0360] Content acquisition module 1201, used to acquire media content;

[0361] The metadata generation module 1202 is used to generate metadata of media content. The metadata of media content includes an artificial intelligence generated content AIGC identifier, and the AIGC identifier indicates whether the media content is AIGC.

[0362] Exemplarily, the metadata generation module 1202 is further configured to obtain media assets corresponding to the media content according to the media content and the metadata of the media content.

[0363] Fig.13 The metadata generation device can be used to execute the method of the aforementioned embodiment, and therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding method provided above, which will not be repeated here.

[0364] Reference Fig.13 , exemplary, the identification device may include:

[0365] The metadata acquisition module 1301 is used to acquire metadata of media content;

[0366] The reading module 1302 is used to read the AIGC identifier from the metadata of the media content;

[0367] The determination module 1303 is used to determine whether the media content is AIGC according to the AIGC identifier.

[0368] In one example, Fig.14 A schematic block diagram of a device 1400 according to an embodiment of the present application is shown. The device 1400 may include: a processor 1401 and a transceiver / transceiver pin 1402 , and optionally, a memory 1403 .

[0369] The components of the device 1400 are coupled together via a bus 1404, wherein the bus 1404 includes a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, all buses are referred to as bus 1404 in the figure.

[0370] Optionally, the memory 1403 may be used to store instructions in the aforementioned method embodiment. The processor 1401 may be used to execute the instructions in the memory 1403, and control the receiving pin to receive a signal, and control the sending pin to send a signal.

[0371] The apparatus 1400 may be the electronic device or a chip of the electronic device in the above method embodiment.

[0372] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0373] The embodiment of the present application further provides a chip, including one or more interface circuits and one or more processors; the one or more processors receive or send data through the one or more interface circuits, and when the one or more processors execute computer instructions, the steps of the above embodiment are executed. The interface circuit is a transceiver / transceiver pin 1402.

[0374] This embodiment further provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method in the above-mentioned embodiment.

[0375] This embodiment further provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or a processor, the computer executes the above-mentioned related steps to implement the method in the above-mentioned embodiment.

[0376] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the chip executes the methods in the above-mentioned method embodiments.

[0377] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.

[0378] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0379] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0380] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0381] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0382] Any content of each embodiment of the present application, as well as any content of the same embodiment, can be freely combined. Any combination of the above content is within the scope of the present application.

[0383] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0384] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0385] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in a hardware manner, or can be implemented by a processor executing a software instruction. The software instruction can be composed of corresponding software modules, and the software module can be stored in a random access memory (Random Access Memory, RAM), a flash memory, a read-only memory (Read Only Memory, ROM), an erasable programmable read-only memory (Erasable Programmable ROM, EPROM), an electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disk (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0386] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented with hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer-readable storage media and communication media, wherein the communication media include any media that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium that a general or special-purpose computer can access.

[0387] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for generating metadata, characterized in that: The method comprises: Get media content; Generate metadata for the media content, wherein the metadata for the media content includes an artificial intelligence generated content (AIGC) identifier, and the AIGC identifier indicates whether the media content is AIGC.

2. The method according to claim 1, characterized in that: The metadata of the media content also includes a first hash value, which is a hash value of data including the AIGC identifier.

3. The method according to claim 2, characterized in that The metadata of the media content also includes a digital signature of the first hash value.

4. The method according to any one of claims 1 to 3, characterized in that: The metadata of the media content also includes a training enable flag, which indicates whether the media content is allowed to be used for model training.

5. The method according to any one of claims 1 to 4, characterized in that: The metadata of the media content also includes at least one of the following: a model identifier, a model version identifier, a model parameter data volume identifier, or a model training set data volume identifier.

6. The method according to any one of claims 1 to 5, characterized in that: The metadata of the media content also includes relevant information of the media content.

7. The method according to claim 6, characterized in that The metadata of the media content also includes: a second hash value, a third hash value, and a digital signature of the third hash value, wherein the second hash value is a hash value of the media content, and the third hash value is a hash value of data including relevant information of the media content and the second hash value.

8. The method according to claim 7, characterized in that The metadata of the media content further includes one or more media declarations and one or more fourth Hash values; the media declaration is a declaration of the media content, and the fourth Hash value is a Hash value of the media declaration.

9. The method according to claim 8, characterized in that The metadata of the media content also includes a fifth hash value, which is a hash value of data including the second hash value, the third hash value, a digital signature of the third hash value, and the one or more fourth hash values.

10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: According to the media content and the metadata of the media content, a media asset corresponding to the media content is obtained.

11. The method according to any one of claims 1 to 10, characterized in that: The metadata of the media content is a JPEG universal metadata frame format JUMBF frame, the JUMBF frame includes a JUMBF description frame and a JUMBF content frame, and the JUMBF description frame and / or the JUMBF content frame include the AIGC identifier.

12. The method according to claim 11, characterized in that The JUMBF content frame also includes relevant information of the media content.

13. The method according to claim 12, characterized in that The JUMBF content box also includes at least one of the following: a model identifier, a model version identifier, a model parameter data volume identifier, or a model training set data volume identifier.

14. The method according to claim 12 or 13, characterized in that The relevant information of the media content includes at least one of the following: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, information of the media content generation device of the media content, the resolution of the media content or the size of the media content.

15. The method according to any one of claims 12 to 14, characterized in that The JUMBF description box also includes a first hash value, an enablement status identifier, a content request identifier, an identity identifier, and a sixth hash value; The sixth hash value is determined according to the JUMBF content box, and the first hash value is a hash value of data including the AIGC identifier, the enabling status identifier, the content request identifier, the identity identifier and the sixth hash value.

16. A recognition method, characterized in that: The method comprises: Get metadata of media content; Reading an AIGC identifier of artificial intelligence generated content from the metadata of the media content; According to the AIGC identifier, it is determined whether the media content is AIGC.

17. The method according to claim 16, characterized in that The method further comprises: When the value of the AIGC identifier is a preset identifier value, it is determined that the media content is AIGC.

18. The method according to claim 16 or 17, characterized in that The metadata of the media content is a JPEG universal metadata frame format JUMBF frame, the JUMBF frame includes a JUMBF description frame and a JUMBF content frame, and the JUMBF description frame and / or the JUMBF content frame include the AIGC identifier.

19. A metadata generation device, characterized in that: The device comprises: A content acquisition module, used to acquire media content; The metadata generation module is used to generate metadata of the media content, wherein the metadata of the media content includes an artificial intelligence generated content AIGC identifier, and the AIGC identifier indicates whether the media content is AIGC.

20. An identification device, characterized in that: The device comprises: A metadata acquisition module, used to acquire metadata of media content; A reading module, used to read the AIGC identifier of the artificial intelligence generated content from the metadata of the media content; The judging module is used to judge whether the media content is AIGC according to the AIGC identifier.

21. An electronic device, characterized in that: include: a memory and a processor, the memory being coupled to the processor; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the metadata generation method according to any one of claims 1 to 15.

22. An electronic device, characterized in that: include: a memory and a processor, the memory being coupled to the processor; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the identification method according to any one of claims 16 to 18.

23. A chip, characterized in that: It comprises one or more interface circuits and one or more processors; the one or more processors receive or send data through the one or more interface circuits, and when the one or more processors execute computer instructions, the steps of the method as claimed in any one of claims 1 to 18 are executed.

24. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program runs on a computer or a processor, the computer or the processor executes the method according to any one of claims 1 to 18.

25. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are executed by a computer or a processor, the steps of the method according to any one of claims 1 to 18 are performed.

Images