Metadata creation method and electronic device
By privacy protection processing of the third information of media content, metadata containing privacy protection is generated, which solves the risk of leakage of user privacy faced during the transmission and release of media content, and realizes the security and effectiveness of user privacy.
Patent Information
- Application Number
- PCT/CN2024/113621
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-06
- Filing Date
- 2024-08-21
- Publication Date
- 2025-03-13
AI Technical Summary
With the popularity of portable shooting devices and media editing software, the threshold for users to create and edit media content has been lowered, resulting in an increase in the use of media content, and user privacy faces the risk of leakage during the transmission and release of media content.
A metadata generation method is provided, by acquiring media content and performing privacy protection processing on part of the information in its third information, to generate metadata containing the first information after privacy protection. This method can use encryption processing or hard binding processing to ensure that privacy information is invisible and avoid leakage.
It effectively avoids the leakage of user privacy, ensures the security of user privacy, and prevents sensitive information from being accessed by unauthorized users during the transmission and publication of media content.
Smart Images

Figure CN2024113621_13032025_PF_FP_ABST
Abstract
Description
Metadata generation method and electronic device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on September 6, 2023, with application number 202311149600.X and application name “Method for generating metadata and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present invention relates to the field of data processing, and more particularly to a method for generating metadata and an electronic device. Background Art
[0003] With the popularity of portable camera devices such as mobile phones and the development of various simple and efficient media editing software, the threshold for people to create and edit media content (such as images, music, and videos) is getting lower and lower; and with the increase in the use scenarios of media content (such as sending it to other users through various instant messaging software; and publishing it on various social software (or trading platforms)), people's motivation to create / edit media content has been further increased, resulting in a blowout development of media content.
[0004] Media content often includes metadata, such as the time and location of a photo, and the person who took it. This metadata can help creators and consumers better understand the content and, in many scenarios, can be used to verify its authenticity. However, some of this metadata may involve user privacy, potentially exposing it to potential privacy breaches when the content is shared with other users or posted on social platforms (or trading platforms).
[0005] Summary of the Invention
[0006] To solve the above technical problems, the present application provides a metadata generation method and electronic device. The method can prevent user privacy leakage and ensure user privacy security.
[0007] In a first aspect, an embodiment of the present application provides a method for generating metadata, the method comprising: first, acquiring media content, and then generating metadata for the media content; wherein the metadata for the media content includes first information, the first information is obtained by performing privacy protection processing based on second information, and the second information is at least part of third information of the media content.
[0008] Among them, the second information is invisible after privacy protection processing, so other users cannot view or obtain the second information that has been privacy-protected; thereby, the security of the second information that has been privacy-protected can be guaranteed, and the leakage of the second information that has been privacy-protected can be avoided.
[0009] When the second information that has undergone privacy protection processing is the user's private information, leakage of the user's privacy can be avoided and the user's privacy security can be guaranteed.
[0010] Exemplarily, the second information is all or part of the third information of the media content. "The first information is obtained by performing privacy protection processing based on the second information, and the second information is at least part of the third information of the media content" can be understood as the first information being obtained by performing privacy protection processing based on all or part of the third information.
[0011] For example, private information may refer to information that one does not want to disclose, and may also be referred to as non-public information.
[0012] For example, the third information of media content may refer to information associated with the media content; for example, the address where the media content was generated, the time when the media content was generated, etc. The third information of media content may include the type of the third information and the value of the third information (i.e., the value of the type). For example, if the location where the media content was generated is "Address: ** Province," the type of the third information is "Address," and the value of the third information is "** Province." The aforementioned privacy protection processing based on the second information refers to the privacy protection processing of the value of the second information.
[0013] Exemplarily, the first aspect can also be described as follows: obtaining media content, performing privacy protection processing based on the second information in the third information of the media content, and obtaining first information; the first information is recorded in the metadata of the media content, and the second information is at least part of the information in the third information of the media content.
[0014] Illustratively, the present application may be applied to the generation (creation) stage of media assets, and may also be applied to the editing and processing stage of media assets, and the present application does not impose any limitation on this.
[0015] Exemplarily, the media content in the generation stage of the media asset can be generated by an electronic device. For example, if the media content is an image, it can be obtained by shooting with a camera, generating it using an AI model, or taking a screenshot, etc.
[0016] For example, the media content used for editing in the editing process stage of the media asset can be obtained from other electronic devices.
[0017] For example, a media asset may include media content and metadata associated with the media content. The metadata associated with the media content is bound to the media content (or associated with the media content). It should be noted that in some scenarios, media assets are also referred to as media files.
[0018] Exemplarily, the media content may include at least one of the following: images, videos, audio, graphics, or text; it should be understood that the media content may also include other types of media content, which is not limited in this application.
[0019] In one possible approach, it is possible to determine in advance (or during the process of generating metadata for the media content) which of the third information of the media content is public information and which is non-public information based on a first preset rule. The first preset rule can be set by the electronic device system or customized by the user, and this application does not limit this.
[0020] For example, the first preset rule may be: the hard binding of media content, the generation method of media content and the digital content identifier of media content are public information, and the generation time of media content, the generation location of media content, the author name of media content and the information of the generation device of media content are non-public information.
[0021] In one possible approach, a privacy level can be set in advance (or during the process of generating metadata for the media content) for the third information of the media content according to a second preset rule; the third information of the media content that exceeds the level threshold is determined to be non-public information, and the third information of the media content that does not exceed the level threshold is determined to be public information. The second preset rule can be set by the electronic device system or can be customized by the user, and this application does not limit this.
[0022] For example, the second preset rule may be: the privacy level of the hard binding of media content is L1, the privacy level of the media content generation method and the privacy level of the media content's digital content identifier is L2, the privacy level of the media content's generation time is L3, and the privacy level of the media content's generation location, the privacy level of the media content's author name, and the privacy level of the media content's generation device information is L4; where L1-L4 correspond to privacy levels from low to high, and the level threshold is L2. In this way, the hard binding of media content, the media content generation method, and the media content's digital content identifier are public information, while the media content's generation time, media content generation location, media content's author name, and media content's generation device information are non-public information.
[0023] It should be understood that the first preset rule and the second preset rule can be set according to specific requirements, and the above examples do not constitute a limitation to the first preset rule and the second preset rule.
[0024] According to the first aspect, the privacy protection process includes at least one of an encryption process or a hard binding process.
[0025] For example, hard binding refers to processing original information using a one-way function, where the result cannot be used to derive the original information, and it is also impossible to forge other original information that uses the same result processed using the one-way function. Hash calculation is a type of hard binding.
[0026] Exemplarily, encryption processing may refer to processing original information using an encryption algorithm and a key.
[0027] It should be understood that privacy protection processing may also include other processing such as commitment processing (processing the original information using a commitment algorithm, which is a data confidentiality algorithm), etc. This application does not impose any restrictions on this.
[0028] According to the first aspect, or any implementation of the first aspect above, there are multiple second information, and the first information is obtained by encrypting multiple second information using multiple keys; wherein one key is used to encrypt at least one second information.
[0029] Exemplarily, in this case, the first information is the ciphertext of the second information.
[0030] For example, if there are X1 (X1 is a positive integer) pieces of second information, there may be X2 (X2 is a positive integer) keys; where X1 is greater than or equal to X2. When X1 is greater than X2, one key can be used to encrypt multiple pieces of second information. In other words, multiple pieces of second information in the X1 pieces of second information share the same key. When X1 is equal to X2, one key can be used to encrypt one piece of second information. In other words, different pieces of second information in the X1 pieces of second information correspond to different keys.
[0031] Exemplarily, the key used for encryption processing may be referred to as a first key; that is, the first information is obtained by encrypting multiple pieces of second information using multiple first keys.
[0032] According to the first aspect, or any implementation of the first aspect above, the multiple keys are obtained by processing at least a master key using a key derivation algorithm.
[0033] Exemplarily, a key derivation algorithm may be used to process at least the master key and the third information of the media content to obtain multiple keys. For example, a key derivation algorithm may be used to process at least the hard binding between the master key and the media content to obtain multiple keys.
[0034] It should be understood that multiple keys can also be obtained by processing the master key and other information using a key derivation algorithm, and this application does not impose any restrictions on this.
[0035] According to the first aspect, or any implementation of the first aspect above, there are multiple second information; the first information is obtained by hard binding processing based on multiple random numbers and multiple second information; wherein, at least one random number is used for hard binding processing with at least one second information.
[0036] In one possible approach, a second piece of information may be hashed using at least one random number to obtain the first piece of information. Specifically, the at least one random number and the second piece of information may be concatenated; then, a hash algorithm may be used to hash the concatenated information to obtain the first piece of information.
[0037] In one possible approach, at least one random number may be used to perform a hash calculation on information obtained by combining multiple pieces of second information to obtain the first information. Specifically, the at least one random number and multiple pieces of second information may be concatenated; then, a hash algorithm may be used to perform a hash calculation on the concatenation of the at least one random number and the multiple pieces of second information to obtain the first information.
[0038] Since the value of the second information with a relatively simple value can be reversely deduced by looking up a table after hard binding processing, the present application connects the value of the second information with a random number and performs hard binding processing, which can avoid the value of the second information from being reversely deduced and prevent the value of the second information from being leaked.
[0039] According to the first aspect, or any implementation of the first aspect above, there are multiple second information, there are multiple first information, and one first information is obtained by performing privacy protection processing based on at least one second information.
[0040] For example, a second information may be processed for privacy protection to obtain a first information; or a combination of multiple second information may be processed for privacy protection to obtain a first information; this application does not impose any restrictions on this.
[0041] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content further includes at least one of the following: a statement or a digital signature, the statement is determined based on at least the first information, and the digital signature is a signature of the statement.
[0042] Exemplarily, the claim may include at least one of the following: a hard binding of the first information, a hard binding of the fourth information (information in the third information of the media content that has not been privacy-protected), a hard binding of the media content, or a hard binding determined based on the hard binding of the first information, the fourth information, and the media content. It should be understood that the claim may also include other information, which is not limited by this application.
[0043] For example, a digital signature algorithm may be used to sign the claim to obtain a digital signature of the claim (Claim Signature). It should be understood that this application does not impose any restrictions on this digital signature algorithm.
[0044] According to the first aspect, or any implementation of the first aspect, there are multiple pieces of second information, and the privacy levels of the multiple pieces of second information are the same or different.
[0045] According to the first aspect, or any implementation of the first aspect above, there are multiple pieces of second information, and the privacy levels of the multiple pieces of second information are greater than the level threshold.
[0046] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content further includes fourth information, and the fourth information is information in the third information of the media content that has not been privacy-protected.
[0047] Exemplarily, the privacy level of the fourth information is less than or equal to a level threshold; the privacy levels of the fourth information are the same or different.
[0048] According to the first aspect, or any implementation of the first aspect above, the method further includes: obtaining third information of the media content; performing privacy protection processing on the second information in the third information of the media content to obtain first information; and encapsulating at least the first information to obtain encapsulated data.
[0049] Illustratively, the encapsulated data may include at least one of the following first encapsulated data, second encapsulated data, third encapsulated data, fourth encapsulated data, fourth encapsulated data, and sixth encapsulated data.
[0050] Exemplarily, when in the generation stage of a media asset, the first information and the fourth information can be encapsulated to obtain encapsulated data (hereinafter referred to as the first encapsulated data (or the Mandatory Assertion)). Then, the first encapsulated data, the declaration and the digital signature are encapsulated to obtain the second encapsulated data (or the Trust Declaration). After that, the second encapsulated data is encapsulated to obtain the third encapsulated data (or the Trust Record). It should be noted that the second information (or the fourth information) used to generate the first information in the first encapsulated data may include at least one of the following: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, the information of the generation device of the media content, the generation method of the media content, the resolution of the media content, the size of the media content, the media type of the media content, the hard binding of the media content, the copyright information of the media content or the training identifier of the media content.
[0051] Exemplarily, when in the editing processing stage of a media asset, the first information and the fourth information can be encapsulated to obtain fourth encapsulated data (or assertion). It should be noted that the second information (or fourth information) used to generate the first information in the fourth encapsulated data may include at least one of the following: editing operation information of the media content, editing time of the media content, editing location of the media content, editing tool information of the media content, or information of the editing device of the media content. Then, the fourth encapsulated data, the declaration, and the digital signature are encapsulated to obtain the fifth encapsulated data (or trust manifests). Afterwards, the second encapsulated data (generated in the generation stage of the media asset) and the fifth encapsulated data can be encapsulated to obtain the sixth encapsulated data (or trust record).
[0052] Illustratively, in the process of generating metadata of media content, after performing privacy protection processing on the second information to obtain the first information, the second information can be replaced by the first information, and at least the first information can be encapsulated into the metadata of the media content.
[0053] According to the first aspect, or any implementation of the first aspect above, the third information of the media content includes at least one of the following: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, the information of the generation device of the media content, the generation method of the media content, the resolution of the media content, the size of the media content, the media type of the media content, the hard binding of the media content, the copyright information of the media content, the training identifier of the media content, the editing operation information of the media content, the editing time of the media content, the editing location of the media content, the editing tool information of the media content, or the information of the editing device of the media content.
[0054] For example, the media content's initial information may include the time the media content was generated, the name of the media content's author, the media content's digital content identifier, the media content's generation location, information about the media content's generation device, the media content's generation method, the media content's resolution, the media content's size, the media content's media type, the media content's copyright information, and the media content's training identifier. The initial information of the media content may refer to information generated when the media content was generated; the initial information of the media content may also include other information, which is not limited in this application.
[0055] For example, information about media content editing operations, the time of media content editing, the location of media content editing, information about media content editing tools, or information about media content editing equipment can be referred to as media content editing information. Media content editing information can refer to information related to the editing process of media content; it should be understood that media content editing information can also include other information, which is not limited in this application.
[0056] It should be noted that the hard binding of media content is not the second information, that is, this application does not perform privacy protection processing on the hard binding of media content.
[0057] According to the first aspect, or any implementation of the first aspect above, the metadata of the media content also includes a privacy indicator; the privacy indicator is used to indicate whether the third information of the media content is public information or non-public information. In this way, subsequent use / display restrictions can be implemented based on the privacy indicator.
[0058] For example, the privacy flag can be set by the electronic device's system or by a user-defined setting, which is not limited in this application. During the media asset creation phase, after obtaining the media content, a privacy flag setting interface can be displayed, and the user can set the privacy flag on the privacy flag interface. During the media asset editing phase, after obtaining the edited media content, a privacy flag setting interface can also be displayed, and the user can set the privacy flag on the privacy flag interface.
[0059] In one possible way, the privacy identifier can be used to directly indicate whether the third information of the media content is public information or non-public information. Exemplarily, the privacy identifier can be represented by h (h is a positive integer) bits, where h can refer to the number of third information of the media content; that is, 1 bit in the privacy identifier corresponds to 1 third information of the media content. In one possible way, for 1 bit in the privacy identifier, when the value of the bit is "1", it indicates that the third information of the corresponding media content is public information, and when the value of the bit is "0", it indicates that the third information of the corresponding media content is non-public information. In one possible way, for 1 bit in the privacy identifier, when the value of the bit is "1", it indicates that the third information of the corresponding media content is non-public information, and when the value of the bit is "0", it indicates that the third information of the corresponding media content is public information; this application does not impose any restrictions on this.
[0060] In one possible approach, a privacy indicator can be used to indirectly indicate whether third information of media content is public or non-public. Exemplarily, the privacy indicator can be used to indicate the privacy level of the third information of media content, and the privacy level can be used to indicate whether the third information of media content is non-public or non-public. Specifically, third information of media content above the privacy level is public information, while third information of media content below or equal to the privacy level is non-public information. Alternatively, third information of media content above the privacy level is non-public information, while third information of media content below or equal to the privacy level is public information. The value of the privacy level indicated by the privacy indicator can be the level threshold mentioned above. Exemplarily, if the value of the privacy indicator is L2, and the privacy level of the first information is set according to the second preset rule, then when the first information of media content above the privacy level is non-public information and the first information of media content below or equal to the privacy level is public information, then the hard binding of the media content, the generation method of the media content, and the digital content identifier of the media content are public information, while the generation time, generation location, author name, and generation device of the media content are non-public information. When the first information of media content with a privacy level higher than the privacy level is public information, and the first information of media content with a privacy level lower than or equal to the privacy level is non-public information, the hard binding of the media content, the generation method of the media content, and the digital content identifier of the media content are non-public information, and the generation time of the media content, the generation location of the media content, the author name of the media content, and the information of the device that generated the media content are public information.
[0061] According to the first aspect, or any implementation of the first aspect above, there are multiple second information, and the method also includes: using multiple keys to encrypt the multiple second information to obtain at least one first information; wherein, one key is used to encrypt at least one second information.
[0062] According to the first aspect, or any implementation of the first aspect above, there are multiple second information, and the method also includes: performing hard binding processing based on multiple random numbers and multiple second information to obtain at least one first information; wherein, at least one random number is used to perform hard binding processing with at least one second information.
[0063] In a second aspect, an embodiment of the present application provides a method for displaying media assets, which is applied to an electronic device with a display. The method includes: obtaining an operation on a media asset, where the media asset includes media content and metadata of the media content, where the metadata of the media content includes first information and fourth information, where the first information is obtained by performing privacy protection processing based on the second information, the second information is at least part of the third information of the media content, and the fourth information is information in the third information of the media content that has not been privacy protected; and displaying the fourth information in response to the operation on the media asset. In this way, the fourth information (i.e., public information) in the metadata of the media content can be viewed for media assets generated by the electronic device or obtained from other electronic devices.
[0064] For example, the operation on the media asset may be an operation of viewing metadata of the media asset.
[0065] According to a second aspect, in response to an operation on a media asset, the first information is also displayed. In this way, the user can learn that the metadata of the media content includes the first information; when the user needs to obtain the second information later, the user can request the second information from the electronic device that performs the privacy protection process.
[0066] According to the second aspect, or any implementation of the second aspect above, the first information includes information obtained by encrypting the second information using the first key. When the electronic device holds the first key, in response to an operation on the media asset, the second information obtained by decrypting the first information using the first key is also displayed.
[0067] According to the second aspect, or any implementation of the second aspect above, the privacy protection processing includes at least one of encryption processing or hard binding processing.
[0068] According to the second aspect, or any implementation of the above second aspect, there are multiple first keys and multiple second information, and one first key is used to encrypt at least one second information; the multiple first keys are obtained by processing at least the master key using a key derivation algorithm.
[0069] Exemplarily, the type of the fourth information and the type of the second information may also be displayed in response to an operation on the media asset.
[0070] It should be understood that the present application does not limit which information in the metadata of the media content is displayed.
[0071] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0072] In a third aspect, an embodiment of the present application provides a metadata generation device, the device comprising:
[0073] An acquisition module, used to acquire media content;
[0074] The generation module is used to generate metadata of the media content, where the metadata of the media content includes first information, which is obtained by performing privacy protection processing on the second information, and the second information is at least part of the third information of the media content.
[0075] According to a third aspect, the privacy protection process includes at least one of an encryption process or a hard binding process.
[0076] According to the third aspect, or any implementation of the third aspect above, there are multiple second information, and the first information is obtained by encrypting multiple second information using multiple keys; wherein one key is used to encrypt at least one second information.
[0077] According to the third aspect, or any implementation of the third aspect above, the multiple keys are obtained by processing at least a master key using a key derivation algorithm.
[0078] According to the third aspect, or any implementation of the third aspect above, there are multiple second information; the first information is obtained by hard binding processing based on multiple random numbers and multiple second information; wherein, at least one random number is used for hard binding processing with at least one second information.
[0079] According to the third aspect, or any implementation of the third aspect, there are multiple second information and multiple first information, and one first information is obtained by performing privacy protection processing based on at least one second information.
[0080] According to the third aspect, or any implementation of the third aspect above, the metadata of the media content further includes at least one of the following: a statement or a digital signature, the statement is determined based on at least the first information, and the digital signature is a signature of the statement.
[0081] According to the third aspect, or any implementation of the third aspect, there are multiple pieces of second information, and the privacy levels of the multiple pieces of second information are the same or different.
[0082] According to the third aspect, or any implementation of the third aspect, there are multiple pieces of second information, and the privacy levels of the multiple pieces of second information are greater than a level threshold.
[0083] According to the third aspect, or any implementation of the third aspect above, the metadata of the media content further includes fourth information, and the fourth information is information in the third information of the media content that has not been privacy-protected.
[0084] According to the third aspect, or any implementation of the third aspect above,
[0085] The acquisition module is further used to obtain third information of the media content;
[0086] The device also includes:
[0087] a privacy processing module, configured to perform privacy protection processing on the second information in the third information of the media content to obtain the first information;
[0088] The encapsulation module is used to encapsulate at least the first information to obtain encapsulated data.
[0089] According to the third aspect, or any implementation of the above third aspect, the third information of the media content includes at least one of the following: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, the information of the generation device of the media content, the generation method of the media content, the resolution of the media content, the size of the media content, the media type of the media content, the hard binding of the media content, the copyright information of the media content, the training identifier of the media content, the editing operation information of the media content, the editing time of the media content, the editing location of the media content, the editing tool information of the media content, or the information of the editing device of the media content.
[0090] According to the third aspect, or any implementation of the third aspect above, the metadata of the media content further includes a privacy identifier; the privacy identifier is used to indicate whether the third information of the media content is public information or non-public information.
[0091] According to the third aspect, or any implementation method of the third aspect above, there are multiple second information, and the privacy processing module is specifically used to use multiple keys to encrypt the multiple second information to obtain at least one first information; wherein, one key is used to encrypt at least one second information.
[0092] According to the third aspect, or any implementation method of the third aspect above, the second information is multiple, and the privacy processing module is specifically used to perform hard binding processing based on multiple random numbers and multiple second information to obtain at least one first information; wherein, at least one random number is used to perform hard binding processing with at least one second information.
[0093] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0094] In a fourth aspect, an embodiment of the present application provides a device for displaying media assets, the device comprising:
[0095] a receiving module configured to receive an operation on a media asset, the media asset comprising media content and metadata of the media content, the metadata of the media content comprising first information and fourth information, the first information being obtained by performing privacy protection processing on the second information, the second information being at least a portion of third information of the media content, and the fourth information being information of the third information of the media content that has not been subjected to privacy protection processing;
[0096] The display module is configured to display fourth information in response to an operation on the media asset.
[0097] According to a fourth aspect, the display module is configured to further display first information in response to an operation on a media asset.
[0098] According to the fourth aspect, or any implementation of the third aspect, the first information includes information obtained by encrypting the second information using the first key.
[0099] The display module is configured to display second information obtained by decrypting first information using the first key in response to an operation on a media asset when the electronic device holds the first key.
[0100] According to the fourth aspect, or any implementation of the fourth aspect above, the privacy protection processing includes at least one of encryption processing or hard binding processing.
[0101] According to the fourth aspect, or any implementation of the fourth aspect above, there are multiple first keys and multiple second information, and one first key is used to encrypt at least one second information; the multiple first keys are obtained by processing at least the master key using a key derivation algorithm.
[0102] The fourth aspect and any implementation of the fourth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can be referred to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, and will not be repeated here.
[0103] In a fifth aspect, an embodiment of the present application provides an electronic device comprising: a memory and a processor, the memory being coupled to the processor; the memory storing program instructions, which, when executed by the processor, enables the electronic device to execute the metadata generation method of the first aspect or any possible implementation of the first aspect.
[0104] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0105] In a sixth aspect, an embodiment of the present application provides an electronic device comprising: a memory and a processor, the memory being coupled to the processor; the memory storing program instructions, which, when executed by the processor, enables the electronic device to execute the method for displaying media assets in the second aspect or any possible implementation of the second aspect.
[0106] The sixth aspect and any implementation of the sixth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the sixth aspect and any implementation of the sixth aspect can be referred to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, and will not be repeated here.
[0107] In the seventh aspect, an embodiment of the present application provides a chip comprising one or more interface circuits and one or more processors; the interface circuit is used to receive signals from a memory of an electronic device and send signals to the processor, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device executes the metadata generation method in the first aspect or any possible implementation of the first aspect.
[0108] The seventh aspect and any implementation of the seventh aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the seventh aspect and any implementation of the seventh aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0109] In an eighth aspect, an embodiment of the present application provides a chip comprising one or more interface circuits and one or more processors; the one or more processors receive or send data through the one or more interface circuits, and when the one or more processors execute computer instructions, the electronic device executes the method for displaying media assets in the second aspect or any possible implementation of the second aspect.
[0110] The eighth aspect and any implementation of the eighth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the eighth aspect and any implementation of the eighth aspect can be referred to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, and will not be repeated here.
[0111] In a ninth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer or a processor, the computer or the processor executes the metadata generation method in the first aspect or any possible implementation of the first aspect.
[0112] The ninth aspect and any implementation of the ninth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the ninth aspect and any implementation of the ninth aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0113] In a tenth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer or a processor, the computer or the processor executes the method for displaying media assets in the fourth aspect or any possible implementation of the fourth aspect.
[0114] The tenth aspect and any implementation of the tenth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the tenth aspect and any implementation of the tenth aspect can be referred to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, and will not be repeated here.
[0115] In the eleventh aspect, an embodiment of the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or a processor, the computer or the processor executes the metadata generation method in the first aspect or any possible implementation of the first aspect.
[0116] The eleventh aspect and any implementation of the eleventh aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the eleventh aspect and any implementation of the eleventh aspect can be referred to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, and will not be repeated here.
[0117] In the twelfth aspect, an embodiment of the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or a processor, the computer or the processor executes the encoding method in the second aspect or any possible implementation of the second aspect.
[0118] The twelfth aspect and any implementation of the twelfth aspect correspond to the second aspect and any implementation of the second aspect, respectively. The technical effects corresponding to the twelfth aspect and any implementation of the twelfth aspect can be referred to the technical effects corresponding to the above-mentioned second aspect and any implementation of the second aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0119] FIG1A is a schematic diagram illustrating an exemplary application scenario;
[0120] FIG1B is a schematic diagram illustrating an exemplary application scenario;
[0121] FIG1C is a schematic diagram illustrating an exemplary application scenario;
[0122] FIG1D is a schematic diagram illustrating an exemplary application scenario;
[0123] FIG1E is a schematic diagram illustrating an exemplary application scenario;
[0124] FIG1F is a schematic diagram illustrating an exemplary application scenario;
[0125] FIG1G is a schematic diagram illustrating an exemplary application scenario;
[0126] FIG2A is a schematic diagram illustrating an exemplary metadata generation process;
[0127] FIG2B is a schematic diagram illustrating the structure of metadata of media content;
[0128] FIG2C is a schematic diagram illustrating the structure of metadata of media content;
[0129] FIG2D is a schematic diagram illustrating the structure of metadata of media content;
[0130] FIG3A is a schematic diagram illustrating an exemplary encryption process;
[0131] FIG3B is a schematic diagram illustrating an exemplary encryption process;
[0132] FIG3C is a schematic diagram showing an exemplary structure of metadata;
[0133] FIG3D is a schematic diagram illustrating an exemplary hash calculation process;
[0134] FIG3E is a schematic diagram showing an exemplary structure of metadata;
[0135] FIG4A is a schematic diagram showing an exemplary structure of metadata;
[0136] FIG4B is a schematic diagram showing an exemplary structure of metadata;
[0137] FIG5A is a schematic diagram illustrating the structure of metadata;
[0138] FIG5B is a schematic diagram showing an exemplary structure of metadata;
[0139] FIG5C is a schematic diagram illustrating the structure of metadata;
[0140] FIG6 is a schematic diagram of an exemplary apparatus for generating metadata;
[0141] FIG7 is a schematic diagram of a display device exemplarily showing a media asset;
[0142] FIG8 is a schematic structural diagram of an exemplary device. DETAILED DESCRIPTION
[0143] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0144] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0145] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.
[0146] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.
[0147] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.
[0148] Figure 1A is a schematic diagram of an exemplary application scenario, which illustrates a scenario of sharing media content.
[0149] For example, media content can also be referred to as digital content. Media content can be part of a media asset, representing the actual content of the media. Digital content is content of different content types, such as text, images, and sounds, that exists in digital form. It can be stored on digital media such as optical discs and hard drives and distributed through means such as the Internet. Digital content is the overall product or service that integrates images, text, audio, and other content through digital technology. It is the product of the combination of digital media technology and cultural creativity. For example, media content can be the pixel data of an image, as well as any additional technical metadata required to understand or present the content (for example, color profiles or encoding parameters).
[0150] For example, digital technology is a science and technology that has grown alongside computers. It refers to the technology that uses certain equipment to convert various types of information, including images, text, sound, and video, into binary digits "0" and "1" that computers can recognize, and then perform operations, processing, storage, transmission, dissemination, and restoration. Because computers are used to encode, compress, and decode information during operations and storage, it is also called digital technology, computer digital technology, etc. Digital technology is also known as digital control technology.
[0151] For example, media content and its metadata can constitute a media asset. The metadata of the media content is bound to the media content (or, in other words, the metadata of the media content is associated with the media content). It should be noted that in some scenarios, media assets are also referred to as media files.
[0152] Exemplarily, metadata may include data used to describe media content; for example, metadata may include information describing properties of the media content. Exemplarily, metadata may be a trust record. Exemplarily, a trust record of media content may be a type of metadata for the media content, which records information related to the generation and changes (e.g., editing) of the media content and may be used to trace the source of the media content.
[0153] Exemplarily, metadata of the media content may be generated based on the media content and third information of the media content.
[0154] For example, the third information of the media content may refer to information associated with the media content. The third information of the media content may include, but is not limited to, initial information of the media content, hard binding of the media content, and editing information of the media content. It should be understood that the third information of the media content may also include other information, and this application does not limit this.
[0155] Exemplarily, the initial information of the media content may refer to information generated when the media content is generated. For example, the initial information of the media content may include, but is not limited to: the generation time of the media content, the name of the author of the media content, the digital content identifier of the media content, the generation location of the media content, information about the device used to generate the media content, the generation method of the media content, the resolution of the media content, the size of the media content, the media type of the media content, the hard binding of the media content, the copyright information of the media content, the training identifier of the media content, etc. It should be understood that the initial information of the media content may also include other information, which is not limited in this application.
[0156] Exemplarily, the editing information of media content may refer to information related to the editing process of the media content. For example, the editing information of media content may include, but is not limited to, information about the editing operation of the media content, the time of editing the media content, the location of editing the media content, information about the editing tool used for the media content, or information about the editing device used for the media content. It should be understood that the editing information of media content may also include other information, which is not limited in this application.
[0157] Exemplarily, hard binding of media content may refer to information obtained by hard binding the media content. Hard binding processing may refer to: processing the original information using a one-way function, where the result obtained cannot be used to derive the original information, and it is also impossible to forge other original information that obtains the same result by processing using a one-way function. Hash calculation is a type of hard binding processing, that is, the hard binding of media content may be a hash value obtained by hashing the media content (the hard binding of media content may also be referred to as the hash value of the media content).
[0158] 1A , illustratively, after user B generates an image using mobile phone B (e.g., by capturing it with a camera; using an AI model; or taking a screenshot, etc.), mobile phone B can obtain the image's third information. Next, mobile phone B can generate image metadata based on the image's third information and the generated image to obtain a media asset (this process corresponds to the media asset creation phase). In the embodiment of FIG1A , the image metadata can include the image's hard binding and the image's initial information.
[0159] For example, some of the third information of an image may be private to user B (that is, information that user B does not wish to disclose, also known as non-public information). Therefore, when generating metadata for the image, mobile phone B can perform privacy protection on the non-public information in the third information of the image. This privacy-protected non-public information is not visible to other users.
[0160] For example, later when user B wants to share the image with user A, user B can use the communication software on mobile phone B to send the image to user A's mobile phone A (wherein the image metadata is also sent to mobile phone A). For example, after mobile phone A receives the image (and the image metadata), when user A wants to view the image metadata, he can perform a metadata viewing operation; thus, mobile phone A can display the metadata of the media content in response to the metadata viewing operation, as shown in Figure 1A.
[0161] It should be noted that the metadata of the image shown in FIG1A is a visual representation of the metadata of the image. It should be understood that the metadata of the image can also be represented in other visual representations, and this application does not impose any restrictions on this.
[0162] 1A , illustratively, some of the information in the metadata of the image of Example 1 is ciphertext (or some of the information is ciphertext of the non-public information in the third information of the media content; wherein the ciphertext may be represented in a variety of forms, for example, a string of at least one of numbers, letters, or symbols), and some of the information is plaintext (or some of the information is the public information itself in the third information of the media content). For example, the author name of the image is ciphertext, the generation time of the image is ciphertext, the AIGC identifier (the generation method of the image) is ciphertext, the generation location of the image is ciphertext, and the name of the device that generated the image is ciphertext; the name of the image is plaintext, and the media type of the image is plaintext. Among them, the non-public information that is ciphertext is invisible.
[0163] 1A , illustratively, part of the information in the metadata of the image of Example 2 is a hash value of the non-public information in the third information of the media content, and part of the information is the public information itself in the third information of the media content. For example, the author name of the image is a hash value (i.e., hash1), the generation time of the image is a hash value (i.e., hash2), the AIGC identifier is a hash value (i.e., hash3), the generation location of the image is a hash value (i.e., hash4), and the name of the device that generated the image is a hash value (i.e., hash5); the name of the image is in plain text, and the media type of the image is in plain text. Among them, the non-public information that is a hash value is invisible.
[0164] In this way, user A cannot obtain user B's non-public information, which can prevent user B's private information from being leaked and ensure the security of user B's private information to a certain extent.
[0165] Figure 1B is a schematic diagram of an exemplary application scenario. Figure 1B shows a scenario of editing and processing media content.
[0166] For example, after user 1 sends generated image 1 to PC 2 via PC 1 , PC 2 may edit image 1 in response to an editing operation of user 2 to obtain image 2 .
[0167] It should be noted that when user 1 determines that there is no non-public information in the initial information of image 1, privacy protection processing may not be performed on the initial information of image 1 during the process of generating the metadata of image 1; in this way, the initial information of image 1 in the metadata of image 1 is visible to other users, as shown in Figure 1B; it should be noted that the metadata of image 1 shown in Figure 1B is a visual representation of the metadata of image 1, and it should be understood that the metadata of image 1 can also adopt other visual representation methods, and this application does not impose any restrictions on this.
[0168] 1B , illustratively, in the metadata of Image 1 , the author name of the image, the generation time of the image, the AIGC identifier, the generation location of the image, the name of the image generation device, the name of the image, and the media type of the image are all visible.
[0169] It should be understood that in the embodiment of Figure 1B, in one possible manner, in the process of generating the metadata of image 1, PC1 can perform privacy protection processing on the non-public information in the initial information of image 1, so that the non-public information in the initial information of image 1 is not visible in the metadata of image 1. Please refer to Figure 1A and will not repeat it here.
[0170] For example, after PC2 receives image 1, when user 2 needs to edit image 1, he can perform editing operations (for example, adding filter operations, rotation operations, scaling operations, etc.); correspondingly, PC2 can edit media content 1 (such as adding filters, rotating, scaling, etc.) in response to the editing operations of user 2 to obtain image 2.
[0171] For example, during the editing process of image 1 or after completing the editing process of image 1 to obtain image 2, PC2 can generate metadata of image 2 based on image 2, third information of image 2 (that is, editing information of image 2) and metadata of image 1.
[0172] For example, when the editing information of image 2 contains private information for user 2, in the process of generating the metadata of image 2, the non-public information in the editing information of image 2 can be privacy-protected, so that the non-public information in the editing information of image 2 is invisible to other users, thereby avoiding the leakage of user 2's private information and ensuring the security of user 2's private information to a certain extent.
[0173] It should be noted that the metadata of image 2 shown in FIG1B is a visual representation of the metadata of image 2. It should be understood that the metadata of image 2 may also be represented in other visual representations, and this application does not impose any restrictions on this.
[0174] 1B , illustratively, PC 2 performs privacy protection processing on the editing location of Image 2 and the name of the editor of Image 2 ; thus, the editing location of Image 2 and the name of the editor of Image 2 are invisible to other users.
[0175] For example, in some scenarios, the user is required to provide metadata proof of the media content to prove the authenticity of the media content; please refer to the scenarios described in Figures 1C to 1E below.
[0176] It should be noted that in Figures 1C to 1E, the metadata of the media content includes information obtained by privacy protection processing of the non-public information in the third information of the media content; therefore, the non-public information in the third information of the media content cannot be read or viewed from the metadata of the media content.
[0177] Figure 1C is a schematic diagram of an exemplary application scenario, which illustrates a scenario where a seller provides metadata proof to a data trading platform when placing a media asset on the data trading platform for sale.
[0178] S11, the mobile phone sends a media asset selling request to the server of the data trading platform.
[0179] For example, a seller may send a media asset sale request to a server of a data trading platform via a mobile phone; the media asset sale request may include information such as the media asset, the price of the media asset (or the price of the media content), and content description information of the media content (such as the subject and object of the image).
[0180] For example, in the embodiment of FIG1C , information on the generation method of the media content, the author name of the media content, the generation time of the media content, the generation location of the media content, and the generation device of the media content in the metadata of the media content is privacy protected.
[0181] S12, the server of the data trading platform reads the metadata of the media content.
[0182] For example, before publishing media content on a client of the data trading platform, the server of the data trading platform can determine whether the media content meets the selling conditions based on the metadata of the media content. The selling conditions can be set as needed and are not limited in this application; for example, the image must be taken with a certain model of mobile phone; another example is that the image is not AIGC; another example is that the image is original, etc.
[0183] For example, the server of the data trading platform determines the third information to be read (hereinafter referred to as target information) according to the selling conditions; then, the target information is read from the metadata of the media content. If the target information cannot be read from the metadata of the media content, S13 can be executed.
[0184] As shown in FIG. 1C , when the target information is the generation time of the media content and the generation location of the media content, S13 may be executed.
[0185] It should be noted that the metadata of the media content shown in FIG1C is a visual representation of the metadata of the media content. It should be understood that the metadata of the media content can also be represented in other visual representations, and this application does not impose any restrictions on this.
[0186] S13, the server of the data trading platform sends a certification request to the mobile phone.
[0187] Illustratively, the certification request may include an identification of the target information.
[0188] S14, the mobile phone sends the key to the server of the data trading platform.
[0189] Exemplarily, the mobile phone may send a key for encrypting target information to a server of the data trading platform.
[0190] S15, the server of the data trading platform decrypts the encrypted information according to the key.
[0191] Exemplarily, the server of the data trading platform may use the key to decrypt the encrypted target information to obtain the target information (ie, the decryption result).
[0192] S16 , when the server of the data trading platform determines that the media asset meets the selling conditions based on the decryption result, it sends a publishing request to the PC.
[0193] For example, when the data trading platform server determines that the decrypted target information meets the selling conditions, it can send a publishing request to the PC containing the data trading platform client. The publishing request can include a sample of the media content, the price of the media content, and a description of the media content, so that the data trading platform client can display it.
[0194] It should be understood that when the mobile phone and the data trading platform are in the same space (that is, when the seller and the administrative user of the data trading platform's server are in the same space), the seller can use the key on the mobile phone to decrypt the encrypted target information, obtain the target information, and display the target information; in this way, after the administrative user views the target information through the seller's mobile phone and determines that the target information meets the selling conditions, he instructs the data trading platform's server to execute S16. It should be understood that this application does not limit whether the encrypted target information is decrypted by the electronic device that performs privacy protection processing on the target information or by other electronic devices.
[0195] S17, the PC publishes media content on the client side of the data trading platform.
[0196] Illustratively, the PC publishing the media content on the client of the data trading platform may include the PC displaying a sample of the media content, a price of the media content, and content description information of the media content on a sales interface of the client of the data trading platform.
[0197] For example, after a buyer successfully pays, the data trading platform's server can send the media asset to the buyer's terminal device. It should be noted that the non-public information in the metadata of the media asset sent by the data trading platform's server to the buyer's terminal device is still privacy-protected (for example, encrypted); this ensures the security of the seller's private information.
[0198] Figure 1D is a schematic diagram of an exemplary application scenario, wherein Figure 1D illustrates a scenario in which a journalist provides metadata proof to a news media publishing platform when sending media assets to the platform.
[0199] S21, mobile phone 1 sends media assets to the server of the news media publishing platform.
[0200] For example, a reporter may send media assets to a server of a news media publishing platform via mobile phone 1 .
[0201] For example, in the embodiment of FIG. 1D , information on the author name of the media content, the generation time of the media content, the generation location of the media content, and the generation device of the media content in the metadata of the media content is privacy protected.
[0202] S22, the server of the news media publishing platform reads metadata of the media content.
[0203] For example, before publishing media content to a client on the news media publishing platform, the server of the news media publishing platform can determine whether the media content meets the news publishing conditions based on the metadata of the media content. The news publishing conditions can be set as needed and are not limited in this application; for example, the location where the image was taken matches the news content, or the time when the image was taken matches the news content.
[0204] For example, the server of the news media publishing platform determines the third information of the media content to be read (hereinafter referred to as target information) according to the news publishing conditions; then, the target information is read from the metadata of the media content. If the target information cannot be read from the metadata of the media content, S23 can be executed.
[0205] As shown in FIG. 1D , when the target information is the generation time of the media content and the generation location of the media content, S23 may be executed.
[0206] It should be noted that the metadata of the media content shown in Figure 1D is a visual representation of the metadata of the media content. It should be understood that the metadata of the media content can also be represented in other visual representations, and this application does not impose any restrictions on this.
[0207] S23, the server of the news media publishing platform sends a certification request to mobile phone 1.
[0208] For example, S23 may refer to the description of S13 above, which will not be repeated here.
[0209] S24, the mobile phone 1 sends the generation time and generation location of the media content and the hash algorithm identifier to the server of the news media publishing platform.
[0210] For example, in FIG1D , the metadata of the media content includes a hash value of the target information; therefore, the target information and the identifier of the corresponding hash algorithm can be sent to the server of the news media publishing platform so that the news media publishing platform can determine the authenticity of the target information and whether it meets the news publishing conditions.
[0211] In FIG. 1D , the target information may refer to the generation time of the media content and the generation location of the media content.
[0212] S25, the server of the news media publishing platform uses a hash algorithm to perform hash calculations on the generation time and generation location of the media content.
[0213] S26, when the server of the news media publishing platform determines that the hash value of the generation time of the media content is the same as hash2, the hash value of the generation location of the media content is the same as hash3, and the generation time and generation location of the media content meet the news publishing conditions, the news is sent to mobile phone 2.
[0214] For example, if the hash value of the media content's generation time, as determined by hash calculation, is the same as hash2, and the hash value of the media content's generation location is the same as hash3, the generation time and location of the media content are determined to be authentic. Next, a determination can be made as to whether the generation time and location of the media content meet the news release conditions. If the generation time and location of the media content meet the news release conditions, news can be generated and sent to mobile phone 2, which has a client installed on the news media publishing platform.
[0215] It should be understood that when mobile phone 1 and the news media publishing platform are in the same space (that is, when the reporter and the administrative user of the server of the news media publishing platform are in the same space), the reporter can use the hash algorithm on mobile phone 1 to perform hash calculation on the target information, obtain the hash value of the target information and display the hash value of the target information; in this way, after the administrative user checks the hash value of the target information through the reporter's mobile phone 1, it is determined that the hash value of the target information determined by the hash calculation of mobile phone 1 is the same as the hash value of the target information in the metadata of the media asset sent by mobile phone 1. If it is determined that the target information meets the news release conditions, the server of the news media publishing platform is instructed to execute S26. It should be understood that this application does not limit the target information for hash calculation, whether it is hashed by an electronic device that performs privacy protection processing on the target information or by other electronic devices.
[0216] For example, news may include samples of media assets or media content. It should be noted that the non-public information in the metadata of the media assets included in the news is still processed for privacy protection (for example, the non-public information is its hash value); thus, subsequent users of the news media publishing platform will not be able to obtain the reporter's private information after downloading the media content and the metadata of the media content from the news media publishing platform client.
[0217] S27, mobile phone 2 displays the news on the client of the news media publishing platform.
[0218] Figure 1E is a schematic diagram of an exemplary application scenario, wherein Figure 1E shows a scenario for determining infringement of media content.
[0219] S31 , PC 1 sends media asset 1 to the server of the social software.
[0220] S32 , PC 2 sends media asset 2 to the server of the social software.
[0221] S33 , when the server of the social software determines that the media content 1 and the media content 2 are identical / similar, it sends a certification request to PC 1 and PC 2 respectively.
[0222] S34, PC1 sends the key to the server of the social software.
[0223] S35, PC2 sends the key to the server of the social software.
[0224] S36 , the server of the social software decrypts the encrypted information in the metadata of media content 1 , and decrypts the encrypted information in the metadata of media content 2 .
[0225] For example, S31 to S36 may refer to the description in FIG1C above, and will not be repeated here.
[0226] S37, the social software server determines whether media content 1 or media content 2 is infringing based on the decryption result.
[0227] For example, assuming that the third information of media content 1 contained in the metadata of media content 1 is the same as the third information of media content 2 contained in the metadata of media content 2, if the author name of media content 1 is the same as the user name of PC 1, and the author name of media content 2 is different from the user name of PC 2, then media content 2 is determined to be infringing.
[0228] For another example, assuming that the third information of media content 1 contained in the metadata of media content 1 and the third information of media content 2 contained in the metadata of media content 2 are different, it is determined that neither media content 1 nor media content 2 is infringing.
[0229] It should be noted that the metadata of the media content shown in Figure 1E (including the metadata of media content 1 and the metadata of media content 2) is a visual representation of the metadata of the media content. It should be understood that the metadata of the media content can also be represented in other visual ways, and this application does not impose any restrictions on this.
[0230] Figures 1F and 1G are schematic diagrams of exemplary application scenarios. Figures 1F and 1G illustrate display scenarios of media assets.
[0231] Referring to FIG1F(1), illustratively, after a mobile phone receives an image (or generates an image) from another electronic device and stores it locally, when a user wants to view the image or the metadata of the image, the album interface 11 can be opened. The album interface 11 may include one or more controls, including but not limited to image thumbnails, video thumbnails, time, etc., which are not limited in this application. The user can click on the image they want to view in the album interface 11, and the mobile phone can display the image in the display interface 12 in response to the user's operation, as shown in FIG1F(2). The display interface 12 may include one or more controls, including but not limited to images, metadata viewing options 13, etc., which are not limited in this application.
[0232] Continuing to refer to FIG1F(2), illustratively, when the user wants to view the metadata of the image, he or she can click on the metadata viewing option 13, and the mobile phone displays the metadata of the image in response to the user's operation, as shown in FIG1G.
[0233] Assume that the metadata of the image includes information in the third information of the image that has not been processed for privacy protection (hereinafter referred to as the fourth information), and information (hereinafter referred to as the first information) obtained by performing privacy protection processing based on at least part of the information in the third information of the image (wherein the information that has been processed for privacy protection is hereinafter referred to as the second information); then the metadata of the image shown in Figure 1G may include multiple situations; wherein the fourth information may include the name of the image and the type of media content, and the second information may include the name of the author of the image, the time when the image was generated, the method of generating the image, the location where the image was generated, and information of the device that generated the image.
[0234] In one possible manner, the value of the fourth information, the type of the fourth information, the ciphertext obtained by encrypting the second information, and the type of the second information are displayed. 1G(1), exemplarily, the name of the image (which can be understood as a type of the fourth information) and the value of the name of the image (i.e., sunset at the seaside), the type of media content (which can be understood as a type of the fourth information) and the value of the type of media content (i.e., image) are displayed; as well as the author name of the image (which can be understood as a type of the second information) and the ciphertext of the value of the author name of the image (i.e., 9981h6hd71s9), the generation time of the image (which can be understood as a type of the second information) and the ciphertext of the value of the generation time of the image (i.e., 001010132jdh), the generation method of the image (which can be understood as a type of the second information) and the ciphertext of the value of the generation method of the image (i.e., 098suyal01076), the generation location of the image (which can be understood as a type of the second information) and the ciphertext of the value of the generation location of the image (i.e., hoxjy90631k9), and the information of the generation device of the image (which can be understood as a type of the second information) and the ciphertext of the value of the information of the generation device of the image (i.e., mihxiy987hya).
[0235] In one possible manner, the value of the fourth information, the type of the fourth information, the hash value obtained by hashing the second information, and the type of the second information are displayed. Referring to FIG1G(2), for example, the name of the image (which can be understood as a type of the fourth information) and the value of the image name (i.e., sunset by the sea), the type of media content (which can be understood as a type of the fourth information) and the value of the type of media content (i.e., image) are displayed; and the author name of the image (which can be understood as a type of the second information) and the hash value of the value of the author name of the image (i.e., hash1) are displayed, the generation time of the image (which can be understood as a type of the second information) and the hash value of the value of the generation time of the image (i.e., hash2) are displayed, the generation method of the image (which can be understood as a type of the second information) and the hash value of the value of the generation method of the image (i.e., hash3) are displayed, the generation location of the image (which can be understood as a type of the second information) and the hash value of the value of the generation location of the image (i.e., hash4) are displayed, and the information of the generation device of the image (which can be understood as a type of the second information) and the hash value of the value of the information of the generation device of the image (i.e., hash5) are displayed.
[0236] In one possible manner, the value of the fourth information, the type of the fourth information, and the type of the second information are displayed. Referring to FIG1G (3), for example, the name of the image (which can be understood as a type of the fourth information) and the value of the image name (i.e., seaside sunset), the type of media content (which can be understood as a type of the fourth information) and the value of the type of media content (i.e., image) are displayed; and the author name of the image (which can be understood as a type of the second information), the time when the image was generated (which can be understood as a type of the second information), the method of generating the image (which can be understood as a type of the second information), the location where the image was generated (which can be understood as a type of the second information), and the information of the device that generated the image (which can be understood as a type of the second information) are displayed.
[0237] In one possible embodiment, only the value and type of the fourth information are displayed, and the type of the second information and the information obtained by performing privacy protection processing on the second information are not displayed. Referring to FIG1G(4), for example, the name of the image (which can be understood as a type of the fourth information) and the value of the image name (i.e., seaside sunset) are displayed, as well as the type of the media content (which can be understood as a type of the fourth information) and the value of the media content type (i.e., image).
[0238] The following describes the process of generating metadata for media content.
[0239] FIG2A is a schematic diagram illustrating an exemplary metadata generation process.
[0240] S201: Acquire media content.
[0241] Exemplarily, the media content may include at least one of the following: images, videos, audio, graphics, or text; it should be understood that the media content may also include other types of media content, which is not limited in this application.
[0242] Illustratively, the present application may be applied to the generation (creation) stage of media assets, and may also be applied to the editing and processing stage of media assets, and the present application does not impose any limitation on this.
[0243] Exemplarily, the media content in the generation stage of the media asset can be generated by an electronic device. For example, if the media content is an image, it can be obtained by shooting with a camera, generating it using an AI model, or taking a screenshot, etc.
[0244] For example, the media content used for editing in the editing process stage of the media asset can be obtained from other electronic devices.
[0245] S202: Generate metadata of the media content, where the metadata of the media content includes first information, and the first information is obtained by performing privacy protection processing on at least part of third information of the media content.
[0246] For example, third information of the media content may be obtained, and privacy protection processing may be performed on at least a portion of the third information of the media content to obtain the first information; wherein at least a portion of the third information of the media content is non-public information. For the convenience of subsequent description, at least a portion of the third information of the media content that has been subjected to privacy protection processing may be referred to as the second information.
[0247] Exemplarily, during the generation phase of the media asset, the acquired third information of the media content may include a hard binding between the initial information and the generated media content.
[0248] For example, during the editing process of the media asset, the acquired third information of the media content may include a hard binding between the editing information and the edited media content.
[0249] In one possible approach, it is possible to determine in advance (or during the process of generating metadata for the media content) which of the third information of the media content is public information and which is non-public information based on a first preset rule. The first preset rule can be set by the electronic device system or customized by the user, and this application does not limit this.
[0250] For example, the first preset rule may be: the hard binding of media content, the generation method of media content and the digital content identifier of media content are public information, and the generation time of media content, the generation location of media content, the author name of media content and the information of the generation device of media content are non-public information.
[0251] In one possible approach, a privacy level can be set in advance (or in the process of generating metadata for the media content) for the third information of the media content according to a second preset rule; and the third information of the media content that is higher than the level threshold is determined as non-public information, and the third information of the media content that is not higher than the level threshold is determined as public information; or, the third information of the media content that is higher than the level threshold is determined as public information, and the third information of the media content that is not higher than the level threshold is determined as non-public information (this application takes the example of determining the third information of the media content that is higher than the level threshold as non-public information and the third information of the media content that is not higher than the level threshold as public information). The second preset rule can be set by the system of the electronic device or can be customized by the user, and this application does not impose any restrictions on this.
[0252] For example, the second preset rule may be: the privacy level of the hard binding of media content is L1, the privacy level of the media content generation method and the privacy level of the media content's digital content identifier is L2, the privacy level of the media content's generation time is L3, and the privacy level of the media content's generation location, the privacy level of the media content's author name, and the privacy level of the media content's generation device information is L4; where L1-L4 correspond to privacy levels from low to high, and the level threshold is L2. In this way, the hard binding of media content, the media content generation method, and the media content's digital content identifier are public information, while the media content's generation time, media content generation location, media content's author name, and media content's generation device information are non-public information.
[0253] It should be understood that the first preset rule and the second preset rule can be set according to specific requirements, and the above examples do not constitute a limitation to the first preset rule and the second preset rule.
[0254] For example, when there are multiple pieces of second information, there may also be multiple pieces of corresponding first information. Here, privacy protection processing can be performed on one piece of second information to obtain one piece of first information, or privacy protection processing can be performed on the combination of multiple pieces of second information to obtain one piece of first information; this application does not impose any restrictions on this.
[0255] Exemplarily, the privacy protection process may include at least one of encryption process or hard binding process. Exemplarily, the encryption process may refer to processing the original information (the original information in this application refers to the second information) using an encryption algorithm and a key to obtain encrypted information.
[0256] It should be understood that privacy protection processing may also include other processing such as commitment processing (processing the original information using a commitment algorithm, which is a data confidentiality algorithm), etc. This application does not impose any restrictions on this.
[0257] Exemplarily, metadata of the media content may be generated based on the first information. For example, the first information may be directly used as part of the metadata of the media content.
[0258] FIG. 2B is a schematic diagram illustrating the structure of metadata of media content.
[0259] Exemplarily, the metadata of the media content may include multiple first information. Referring to FIG. 2B , the metadata of the media content may include the author name (Creator(Privacy)) of the privacy-protected media content, the location (Location(Privacy)) of the privacy-protected media content, and the time (Time(Privacy)) of the privacy-protected media content.
[0260] It should be noted that this application does not limit the location of each first information in the metadata of the media content.
[0261] Exemplarily, the metadata of the media content may further include fourth information, wherein the fourth information may refer to information in the third information of the media content that has not been processed for privacy protection, and the fourth information may be public information.
[0262] FIG. 2C is a schematic diagram illustrating the structure of metadata of media content.
[0263] Exemplarily, the metadata of the media content may include multiple first information and multiple fourth information. Referring to FIG2C , exemplarily, the metadata of the media content includes the author name (Creator(Privacy)) of the media content processed for privacy protection, the generation location (Location(Privacy)) of the media content processed for privacy protection, the generation time (Time(Privacy)) of the media content processed for privacy protection, the hash value (Media Hash) of the media content, and the digital content identifier (Content ID) of the media content.
[0264] It should be noted that this application does not limit the position of each first information and the position of multiple fourth information in the metadata of the media content.
[0265] Exemplarily, the metadata of the media content may further include at least one of the following: a statement or a digital signature, where the statement is determined based on at least the first information, and the digital signature is a signature of the statement.
[0266] Exemplarily, the claim may include at least one of the following: a hard binding of the first information, a hard binding of the fourth information, a hard binding of the media content, or a hard binding determined based on the hard binding of the first information, the fourth information, and the media content. It should be understood that the claim may also include other information, which is not limited in this application.
[0267] For example, a digital signature algorithm may be used to sign the statement to obtain a digital signature of the statement. It should be understood that this application does not limit the digital signature algorithm.
[0268] FIG. 2D is a schematic diagram illustrating the structure of metadata of media content.
[0269] Exemplarily, the metadata of the media content may include multiple first information, multiple fourth information, a statement, and a digital signature. Referring to FIG2D , exemplarily, the metadata of the media content includes the author name (Creator(Privacy)) of the media content processed for privacy protection, the generation location (Location(Privacy)) of the media content processed for privacy protection, the generation time (Time(Privacy)) of the media content processed for privacy protection, a hash value (Media Hash) of the media content, a digital content identifier (Content ID) of the media content, a statement (Claim), and a digital signature (Claim Signature).
[0270] It should be noted that this application does not limit the position of each first information, the position of multiple fourth information, the position of the declaration, and the position of the signature in the metadata of the media content.
[0271] The following describes the privacy protection process.
[0272] In one possible approach, the privacy protection process is encryption, and accordingly, the first information may be ciphertext, that is, the first information is the ciphertext of the second information.
[0273] In one possible manner, a key may be used to encrypt a second information to obtain a first information.
[0274] In one possible manner, a key may be used to encrypt information obtained by combining multiple pieces of second information to obtain a first piece of information.
[0275] Illustratively, the encryption keys for different second information may be the same or different, and this application does not impose any limitation on this.
[0276] Illustratively, the encryption keys for the second information with different privacy levels may be the same or different, and this application does not impose any limitation on this.
[0277] Illustratively, the encryption keys for the second information with the same privacy level may be the same or different, and this application does not impose any limitation on this.
[0278] FIG3A is a schematic diagram illustrating an exemplary encryption process.
[0279] In Figure 3A, the three second information are x, y, and z; the three keys are K1, K2, and K3. K1 can be used to encrypt x to obtain the first information Enc(x, K1); K2 can be used to encrypt y to obtain the first information Enc(y, K2); and K3 can be used to encrypt z to obtain the first information Enc(z, K3).
[0280] It should be understood that FIG. 3A is only an example of the present application, and the present application does not limit which key is used to encrypt which correlation in the second information.
[0281] In one possible approach, when there are multiple keys used to encrypt multiple second information, the multiple keys can be obtained by processing at least a master key using a key derivation algorithm. Exemplarily, the multiple keys can be obtained by processing at least a master key and part of the third information of the media content using a key derivation algorithm. It should be noted that the intersection of the information used to generate the key in the third information and the second information may or may not be empty, and this application does not impose any restrictions on this. For example, the information used to generate the key in the third information may be hard-bound to the media content.
[0282] FIG3B is a schematic diagram illustrating an exemplary encryption process.
[0283] In Figure 3B, the three second information are: x, y, and z. First, a master key (Master Key) K can be generated. Then, a key derivation algorithm is used to hard-bind the master key to the media content, resulting in three subkeys: K1, K2, and K3. K1 can be used to encrypt x, resulting in the first information Enc(x, K1); K2 can be used to encrypt y, resulting in the first information Enc(y, K2); and K3 can be used to encrypt z, resulting in the first information Enc(z, K3).
[0284] It should be understood that FIG. 3B is merely an example of the present application, and the present application does not limit which key is used to encrypt which correlation in the second information.
[0285] It should be understood that when there are multiple keys used to encrypt multiple second information, these multiple keys can also be generated in other ways, such as random generation. This application does not limit the method of generating multiple keys.
[0286] FIG3C is a schematic diagram showing an exemplary structure of metadata.
[0287] 3C , exemplarily, the metadata of the media content may include the generation location of the encrypted media content (Enc(Location, K1)), the generation time of the encrypted media content (Enc(Time, K2)), the author name of the encrypted media content (Enc(Creator, K1)), the hash value of the media content (Media Hash), and the digital content identifier (Content ID) of the media content.
[0288] In one possible approach, the privacy protection process is a hard binding process. This application takes the hard binding process as a hash calculation as an example for explanation, and correspondingly, the first information is the hash value of the second information.
[0289] In one possible approach, a second piece of information may be hashed using at least one random number to obtain the first piece of information. Specifically, the at least one random number and the second piece of information may be concatenated; then, a hash algorithm may be used to hash the concatenated information to obtain the first piece of information.
[0290] In one possible approach, at least one random number may be used to perform a hash calculation on information obtained by combining multiple pieces of second information to obtain the first information. Specifically, the at least one random number and multiple pieces of second information may be concatenated; then, a hash algorithm may be used to perform a hash calculation on the concatenation of the at least one random number and the multiple pieces of second information to obtain the first information.
[0291] For example, the random numbers used for hash calculations on different second information may be the same or different, and this application does not impose any limitation on this.
[0292] For example, the random numbers used in the hash calculation for the second information with different privacy levels may be the same or different, and this application does not impose any limitation on this.
[0293] For example, the random numbers used in the hash calculation for the second information with the same privacy level may be the same or different, and this application does not impose any limitation on this.
[0294] FIG3D is a schematic diagram illustrating an exemplary hash calculation process.
[0295] In Figure 3D , the three pieces of second information are x, y, and z, and the three randomly generated numbers are r, s, and t. A hash algorithm can be used to hash the concatenated r and x to obtain the first information hash(x||r); a hash algorithm can be used to hash the concatenated s and y to obtain the first information hash(y||s); and a hash algorithm can be used to hash the concatenated t and z to obtain the first information hash(z||t).
[0296] It should be understood that FIG3D is only an example of the present application, and the present application does not limit which random number is used in conjunction with which of the second information for hash calculation.
[0297] FIG3E is a schematic diagram showing the structure of metadata.
[0298] 3E , exemplarily, the metadata of the media content may include a hash value of the location where the media content was generated (hash(Location||r)), a hash value of the time when the media content was generated (hash(Time||s)), a hash value of the author's name of the media content (hash(Creator||t)), a hash value of the media content (Media Hash), and a digital content identifier (Content ID) of the media content.
[0299] It should be noted that there is no need to generate a random number. In one possible approach, only one second information may be hashed to obtain one first information. In another possible approach, only multiple second information may be hashed to obtain one first information.
[0300] Exemplarily, when in the generation stage of a media asset, the first information and the fourth information can be encapsulated to obtain encapsulated data (hereinafter referred to as the first encapsulated data (or the Mandatory Assertion)). Then, the first encapsulated data, the declaration and the digital signature are encapsulated to obtain the second encapsulated data (or the Trust Declaration). After that, the second encapsulated data is encapsulated to obtain the third encapsulated data (or the Trust Record). It should be noted that the second information (or the fourth information) used to generate the first information in the first encapsulated data may include at least one of the following: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, the information of the generation device of the media content, the generation method of the media content, the resolution of the media content, the size of the media content, the media type of the media content, the hard binding of the media content, the copyright information of the media content or the training identifier of the media content.
[0301] FIG4A is a schematic diagram showing an exemplary structure of metadata.
[0302] 4A , illustratively, the encrypted media content's generation location (Enc(Location, K1)), the encrypted media content's generation time (Enc(Time, K2)), the encrypted media content's author name (Enc(Creator, K1)), the media content's hash value (Media Hash), and the media content's digital content identifier (Content ID) are encapsulated into a Mandatory Assertion; the Mandatory Assertion, the Declaration Claim, and the digital signature (Claim Signature) are encapsulated into a Trust Declaration; the Trust Declaration is encapsulated into a Trust Record; and the Trust Record is encapsulated into metadata for the media content.
[0303] It should be noted that the dotted box in FIG4A represents optional information, that is, the declaration (Declaration Claim) and the digital signature (Claim Signature) are optional information.
[0304] Exemplarily, when in the editing processing stage of a media asset, the first information and the fourth information can be encapsulated to obtain fourth encapsulated data (or assertion). It should be noted that the second information (or fourth information) used to generate the first information in the fourth encapsulated data may include at least one of the following: editing operation information of the media content, editing time of the media content, editing location of the media content, editing tool information of the media content, or information of the editing device of the media content. Then, the fourth encapsulated data, the declaration, and the digital signature are encapsulated to obtain the fifth encapsulated data (or trust manifests). Afterwards, the second encapsulated data (generated in the generation stage of the media asset) and the fifth encapsulated data can be encapsulated to obtain the sixth encapsulated data (or trust record).
[0305] FIG4B is a schematic diagram showing an exemplary structure of metadata.
[0306] 4B , for example, the encrypted media content's edit time (Enc(Edit Time, K5)), the encrypted media content's edit location (Enc(Edit Location, K4)), the encrypted media content's editor name (Enc(Editor, K6)), the edited media content's hash value (Media Hash 1), the media content's editing device information (Device), and the media content's editing tool information (Tool) are encapsulated into an Assertion; the Assertion, claim, and digital signature (Claim Signature) are encapsulated into Trust Manifests; and the Trust Manifests and Trust Declaration are encapsulated into a Trust Record. A description of the Trust Declaration can be found in FIG4A and will not be repeated here.
[0307] It should be noted that the dotted box in FIG4B represents optional information, that is, the declaration (Declaration Claim or Claim) and the digital signature (Claim Signature) are optional information.
[0308] Exemplarily, the metadata of the media content further includes a privacy flag; the privacy flag is used to indicate whether the third information of the media content is public information or non-public information.
[0309] For example, the privacy flag can be set by the electronic device's system or by a user-defined setting, which is not limited in this application. During the media asset creation phase, after obtaining the media content, a privacy flag setting interface can be displayed, and the user can set the privacy flag on the privacy flag interface. During the media asset editing phase, after obtaining the edited media content, a privacy flag setting interface can also be displayed, and the user can set the privacy flag on the privacy flag interface.
[0310] In one possible manner, the privacy identifier can be used to directly indicate whether the third information of the media content is public information or non-public information. Exemplarily, the privacy identifier can be represented by h (h is a positive integer) bits, where h can refer to the number of third information of the media content; that is, 1 bit in the privacy identifier corresponds to 1 third information of the media content. In one possible manner, for 1 bit in the privacy identifier, when the value of the bit is "1", it indicates that the third information of the corresponding media content is public information, and when the value of the bit is "0", it indicates that the third information of the corresponding media content is non-public information. In one possible manner, for 1 bit in the privacy identifier, when the value of the bit is "1", it indicates that the third information of the corresponding media content is non-public information, and when the value of the bit is "0", it indicates that the third information of the corresponding media content is public information; this application does not impose any restrictions on this.
[0311] Exemplarily, the privacy indicator may be specifically used to indicate that the second information is non-public information, and to indicate that the fourth information is public information.
[0312] FIG5A is a schematic diagram showing an exemplary structure of metadata.
[0313] In FIG. 5A , the initial information of the media content is 5, and the privacy flag (Privacy Flag) in the Mandatory Assertion can be represented by 5 bits such as “00011”. Among them, the first bit of the privacy identifier from left to right is used to indicate whether the generation location Enc (Location, K1) of the media content is non-public information or public information. The first bit is "0", which indicates that the generation location Enc (Location, K1) of the media content is non-public information; the second bit from left to right is used to indicate whether the generation time Enc (Time, K2) of the media content is non-public information or public information. The second bit is "0", which indicates that the generation time Enc (Time, K2) of the media content is non-public information; the third bit from left to right is used to indicate whether the author name Enc (Creator, K3) of the media content is non-public information or public information. The third bit is "0", which indicates that the author name Enc (Creator, K3) of the media content is non-public information; the fourth bit from left to right is used to indicate whether the hash value (Media Hash 0) of the media content is non-public information or public information. The fourth bit is "1", which indicates that the hash value (Media Hash 0) is public information; the fifth bit from left to right is used to indicate whether the digital content identifier (Content ID) of the media content is non-public information or public information. The fifth bit is "1", which indicates that the digital content identifier (Content ID) of the media content is public information.
[0314] In FIG5A , there are five pieces of editing information for the media content, and the privacy flag in the Assertion can be represented by five bits, such as “00101”. The first bit of the privacy flag from left to right is used to indicate whether the editing location Enc (Edit Location, K4) of the media content is non-public information or public information. The first bit is “0”, which indicates that the editing location Enc (Edit Location, K4) of the media content is non-public information; the second bit from left to right is used to indicate whether the editing time Enc (Edit Time, K5) of the media content is non-public information or public information. The second bit is “0”, which indicates that the editing time Enc (Edit Location, K5) of the media content is non-public information or public information. Time, K5) is non-public information; the third bit from left to right is used to indicate whether the name of the editing device (Device) of the media content is non-public information or public information. The third bit is "1", which indicates that the name of the editing device (Device) of the media content is public information; the fourth bit from left to right is used to indicate whether the editor name Enc (Editor, K6) of the media content is non-public information or public information. The fourth bit is "0", which indicates that the editor name Enc (Editor, K6) of the media content is non-public information; the fifth bit from left to right is used to indicate whether the hash value (Media Hash 1) of the media content is non-public information or public information. The fifth bit is "1", which indicates that the hash value (Media Hash 1) of the media content is public information.
[0315] It should be noted that the dotted box in FIG. 5A represents optional information, that is, the privacy flag (Privacy Flag), declaration (Declaration Claim or Claim) and digital signature (Claim Signature) are optional information.
[0316] In one possible approach, a privacy identifier can be used to indirectly indicate whether the third information of the media content is public information or non-public information. For example, the privacy identifier can be used to indicate the privacy level of the third information of the media content, and the privacy level can be used to indicate whether the third information of the media content is non-public information or non-public information. Specifically, the third information of the media content above the privacy level is public information, and the third information of the media content below or equal to the privacy level is non-public information. Alternatively, the third information of the media content above the privacy level is non-public information, and the third information of the media content below or equal to the privacy level is public information. The value of the privacy level indicated by the privacy identifier can be the level threshold mentioned above.
[0317] For example, the third information of the media content can be set to a level in advance or in real time. For example, the privacy level of the hash value of the media content is L1, the privacy level of the media content generation method and the privacy level of the media content's digital content identifier are L2, the privacy level of the media content's generation time is L3, and the privacy level of the media content's generation location, the privacy level of the media content's author name, and the privacy level of the media content's generation device information is L4; wherein the privacy levels corresponding to L1-L4 are from low to high. For example, if the value of the privacy identifier is L2, then when the first information of the media content above the privacy level is non-public information, and the first information of the media content below or equal to the privacy level is public information, the hard binding of the media content, the media content generation method, and the media content's digital content identifier are public information, and the media content's generation time, the media content generation location, the media content's author name, and the media content's generation device information are non-public information. When the first information of media content with a higher privacy level is public information, and the first information of media content with a lower or equal privacy level is non-public information, the hard binding of the media content, the generation method of the media content, and the digital content identifier of the media content are non-public information, while the generation time of the media content, the generation location of the media content, the author name of the media content, and the information of the device that generated the media content are public information. (This application uses the example of media content with a higher privacy level being non-public information and media content with a lower or equal privacy level being public information.)
[0318] FIG5B is a schematic diagram showing an exemplary structure of metadata.
[0319] In Figure 5B, the privacy flag (Privacy Flag) in the Mandatory Assertion is L2, the privacy level of the hash value of the media content (Media Hash0) is L1, the privacy level of the digital content identifier (Content ID) of the media content is L2, the privacy level of the generation time Enc (Time, K2) of the media content is L3, the privacy level of the generation location Enc (Location, K1) of the media content, and the privacy level of the author name Enc (Creator, K3) of the media content are L4.
[0320] In Figure 5B, the privacy identifier in the Assertion is L3, the privacy level of the hash value of the media content (Media Hash 1) is L1, the privacy level of the name of the editing device of the media content (Device) is L3, the privacy level of the editing time Enc (Edit Time, K5) of the media content is L4, the privacy level of the editing location Enc (Edit Location, K4) of the media content and the privacy level of the editor name Enc (Editor, K6) of the media content are L5.
[0321] It should be noted that the dotted box in FIG. 5B represents optional information, that is, the privacy flag (Privacy Flag), declaration (Declaration Claim or Claim) and digital signature (Claim Signature) are optional information.
[0322] It should be noted that the third information of the media content may include the type of the third information and the value of the third information (i.e., the value of the type). For example, if the location of the media content is "Address: ** Province", the type of the third information is "Address" and the value of the third information is "** Province". The aforementioned privacy protection processing based on the second information refers to privacy protection processing based on the value of the second information, that is, privacy protection processing is performed on the second value to obtain the first information.
[0323] For example, in the above embodiment, Creator (Privacy) may refer to the value of the author name of the media content that has been processed for privacy protection; Location (Privacy) may refer to the value of the generation location of the media content that has been processed for privacy protection; Time (Privacy) may refer to the value of the generation time of the media content that has been processed for privacy protection; Content ID may refer to the value of the digital content identifier of the media content.
[0324] In one possible manner, the metadata of the media content may further include the type of the fourth information and / or the type of the second information.
[0325] FIG5C is a schematic diagram showing an exemplary structure of metadata.
[0326] 5C , exemplarily, the metadata of the media content includes the value of the author name of the media content processed for privacy protection (Value_Creator(Privacy)) and the author name of the media content (Creator), the value of the generation location of the media content processed for privacy protection (Value_Location(Privacy)) and the generation location of the media content (Location), the generation time of the media content processed for privacy protection (Value_Time(Privacy)) and the generation time of the media content (Time), the hash value of the media content (Media Hash), the value of the digital content identifier of the media content (Value_Content ID) and the digital content identifier of the media content (Content ID).
[0327] It should be understood that Value_Creator(Privacy) in Figure 5C is equivalent to Creator(Privacy) in the above embodiment; Value_Location(Privacy) in Figure 5C is equivalent to Location(Privacy) in the above embodiment; Value_Time(Privacy) in Figure 5C is equivalent to Time(Privacy) in the above embodiment; Value_Content ID in Figure 5C is equivalent to Content ID in the above embodiment.
[0328] Figure 6 is a schematic diagram of an exemplary metadata generation device. The metadata generation device can be used to execute the method of the aforementioned embodiment. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding method provided above, and will not be repeated here.
[0329] 6 , illustratively, the metadata generating device may include:
[0330] Acquisition module 601, used to acquire media content;
[0331] The generation module 602 is used to generate metadata of the media content. The metadata of the media content includes first information. The first information and second information are obtained by performing privacy protection processing. The second information is at least part of the third information of the media content.
[0332] Exemplarily, the privacy protection process includes at least one of an encryption process or a hard binding process.
[0333] Exemplarily, there are multiple second information, and the first information is obtained by encrypting the multiple second information using multiple keys; wherein one key is used to encrypt at least one second information.
[0334] Illustratively, the multiple keys are obtained by processing at least a master key using a key derivation algorithm.
[0335] Exemplarily, there are multiple second information; the first information is obtained by hard binding multiple random numbers and multiple second information; wherein, at least one random number is used for hard binding with at least one second information.
[0336] Exemplarily, there are multiple second information and multiple first information, and one first information is obtained by performing privacy protection processing based on at least one second information.
[0337] Exemplarily, the metadata of the media content further includes at least one of the following: a statement or a digital signature, the statement is determined based on at least the first information, and the digital signature is a signature of the statement.
[0338] Exemplarily, the privacy levels of the plurality of second information are the same or different.
[0339] Exemplarily, the privacy level of the plurality of second information is greater than a level threshold.
[0340] Exemplarily, the metadata of the media content further includes fourth information, where the fourth information is information in the third information of the media content that has not been processed for privacy protection.
[0341] Exemplarily, the acquisition module 601 is further configured to acquire third information of the media content;
[0342] The device also includes:
[0343] a privacy processing module, configured to perform privacy protection processing on at least part of the third information of the media content to obtain first information;
[0344] The encapsulation module is used to encapsulate at least the first information to obtain encapsulated data.
[0345] Exemplarily, the third information of the media content includes at least one of the following: the generation time of the media content, the author name of the media content, the digital content identifier of the media content, the generation location of the media content, information of the generation device of the media content, the generation method of the media content, the resolution of the media content, the size of the media content, the media type of the media content, the hard binding of the media content, the copyright information of the media content, the training identifier of the media content, the editing operation information of the media content, the editing time of the media content, the editing location of the media content, the editing tool information of the media content, or the information of the editing device of the media content.
[0346] Exemplarily, the metadata of the media content further includes a privacy flag; the privacy flag is used to indicate whether the third information of the media content is public information or non-public information.
[0347] Exemplarily, there are multiple second information, and the privacy processing module is specifically used to use multiple keys to encrypt the multiple second information to obtain at least one first information; wherein, one key is used to encrypt at least one second information.
[0348] Exemplarily, the second information is multiple, and the privacy processing module is specifically used to perform hard binding processing based on multiple random numbers and multiple second information to obtain at least one first information; wherein, at least one random number is used to perform hard binding processing with at least one second information.
[0349] Figure 7 is a schematic diagram of an exemplary display device for media assets. The display device for media assets can be used to execute the method of the aforementioned embodiment. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding method provided above and will not be repeated here.
[0350] 7 , illustratively, a display device for a media asset may include:
[0351] A receiving module 701 is configured to receive an operation on a media asset, where the media asset includes media content and metadata of the media content. The metadata of the media content includes first information and fourth information, where the first information is obtained by performing privacy protection processing on the second information, the second information is at least part of the third information of the media content, and the fourth information is information of the third information of the media content that has not been subjected to privacy protection processing.
[0352] The display module 702 is configured to display fourth information in response to an operation on a media asset.
[0353] Exemplarily, the display module 702 is configured to further display first information in response to an operation on a media asset.
[0354] Exemplarily, the first information includes information obtained by encrypting the second information using the first key, and the display module 702 is used to display the second information obtained by decrypting the first information using the first key in response to an operation on the media asset when the electronic device holds the first key.
[0355] Exemplarily, the privacy protection process includes at least one of an encryption process or a hard binding process.
[0356] Exemplarily, there are multiple first keys and multiple second information, and one first key is used to encrypt at least one second information; the multiple first keys are obtained by processing at least a master key using a key derivation algorithm.
[0357] In an example, FIG8 shows a schematic block diagram of an apparatus 800 according to an embodiment of the present application. The apparatus 800 may include: a processor 801 and a transceiver / transceiver pin 802 , and optionally, a memory 803 .
[0358] The various components of the device 800 are coupled together via a bus 804, wherein the bus 804 includes, in addition to a data bus, a power bus, a control bus, and a status signal bus. However, for the sake of clarity, all buses are referred to as bus 804 in the figure.
[0359] Optionally, the memory 803 may be used to store instructions in the aforementioned method embodiment. The processor 801 may be used to execute the instructions in the memory 803 and control the receiving pin to receive a signal and control the transmitting pin to send a signal.
[0360] The apparatus 800 may be the electronic device or a chip of the electronic device in the above method embodiment.
[0361] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.
[0362] The present application also provides a chip comprising one or more interface circuits and one or more processors. The one or more processors receive or send data via the one or more interface circuits. When the one or more processors execute computer instructions, the electronic device implements the metadata generation method described in the above embodiment by performing the above-mentioned related method steps. The interface circuit is transceiver / transceiver pin 802.
[0363] This embodiment further provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the metadata generation method in the above-mentioned embodiment.
[0364] This embodiment further provides a computer program product, which includes computer instructions. When the computer instructions are executed by a computer or a processor, the computer executes the above-mentioned related steps to implement the metadata generation method in the above-mentioned embodiment.
[0365] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the metadata generation method in the above-mentioned method embodiments.
[0366] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0367] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0368] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0369] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0370] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0371] Any content of each embodiment of this application, as well as any content of the same embodiment, can be freely combined. Any combination of the above content is within the scope of this application.
[0372] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0373] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
[0374] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in a hardware manner, or can be implemented by a processor executing a software instruction. The software instruction can be composed of corresponding software modules, and the software module can be stored in a random access memory (Random Access Memory, RAM), a flash memory, a read-only memory (Read Only Memory, ROM), an erasable programmable read-only memory (Erasable Programmable ROM, EPROM), an electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disc (CD-ROM) or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.
[0375] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer-readable storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. The storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer.
[0376] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
Claims
1. A method for generating metadata, characterized in that: The method comprises: Get media content; Metadata of the media content is generated, where the metadata of the media content includes first information, where the first information is obtained by performing privacy protection processing based on second information, and the second information is at least part of the third information of the media content.
2. The method according to claim 1, characterized in that: The privacy protection process includes at least one of an encryption process or a hard binding process.
3. The method according to claim 1 or 2, characterized in that: The second information is multiple, The first information is obtained by encrypting multiple second information using multiple keys; wherein one key is used to encrypt at least one second information.
4. The method according to claim 3, characterized in that The multiple keys are obtained by processing at least a master key using a key derivation algorithm.
5. The method according to claim 1 or 2, characterized in that: The second information is multiple; The first information is obtained by hard binding processing based on multiple random numbers and multiple second information; wherein at least one random number is used for hard binding processing with at least one second information.
6. The method according to any one of claims 1 to 5, characterized in that: There are multiple pieces of second information, there are multiple pieces of first information, and one piece of first information is obtained by performing privacy protection processing based on at least one piece of second information.
7. The method according to any one of claims 1 to 6, characterized in that: The metadata of the media content further includes at least one of the following: a statement or a digital signature, the statement is determined based on at least the first information, and the digital signature is a signature of the statement.
8. The method according to any one of claims 1 to 7, characterized in that: There are multiple pieces of second information, and the privacy levels of the multiple pieces of second information are the same or different.
9. The method according to any one of claims 1 to 7, characterized in that: There are multiple pieces of second information, and the privacy levels of the multiple pieces of second information are greater than a level threshold.
10. The method according to any one of claims 1 to 9, characterized in that: The metadata of the media content also includes fourth information, where the fourth information is information in the third information of the media content that has not been processed for privacy protection.
11. The method according to any one of claims 1 to 10, characterized in that: The method further comprises: Acquiring third information of the media content; Performing privacy protection processing on second information in the third information of the media content to obtain the first information; At least the first information is encapsulated to obtain encapsulated data.
12. The method according to any one of claims 1 to 11, characterized in that: The third information of the media content includes at least one of the following: generation time of the media content, name of the author of the media content, digital content identifier of the media content, generation location of the media content, information of the generation device of the media content, generation method of the media content, resolution of the media content, size of the media content, media type of the media content, hard binding of the media content, copyright information of the media content, training identifier of the media content, editing operation information of the media content, editing time of the media content, editing location of the media content, editing tool information of the media content, or editing device of the media content. information.
13. The method according to any one of claims 1 to 12, characterized in that: The metadata of the media content also includes a privacy identifier; the privacy identifier is used to indicate whether the third information of the media content is public information or non-public information.
14. The method according to any one of claims 1 to 13, characterized in that: The second information is multiple, and the method further includes: Using multiple keys to encrypt multiple second information to obtain at least one first information; A key is used to encrypt at least one second information.
15. The method according to any one of claims 1 to 13, characterized in that The second information is multiple, and the method further includes: Perform hard binding processing based on multiple random numbers and multiple second information to obtain at least one first information; Wherein, at least one random number is used to perform hard binding processing with at least one second information.
16. A method for displaying a media asset, characterized in that: Applied to an electronic device having a display, the method comprises: An operation for obtaining a media asset, wherein the media asset includes media content and metadata of the media content, wherein the metadata of the media content includes first information and fourth information, wherein the first information is obtained by performing privacy protection processing based on second information, the second information is at least part of third information of the media content, and the fourth information is information of the third information of the media content that has not been subjected to privacy protection processing; In response to the operation on the media asset, the fourth information is displayed.
17. The method according to claim 16, characterized in that In response to the operation on the media asset, the first information is also displayed.
18. The method according to claim 16 or 17, characterized in that The first information includes information obtained by encrypting the second information using a first key, In the case where the electronic device holds the first key, in response to the operation on the media asset, second information obtained by decrypting the first information using the first key is also displayed.
19. The method according to any one of claims 16 to 18, characterized in that The privacy protection process includes at least one of an encryption process or a hard binding process.
20. The method according to claim 18, characterized in that There are multiple first keys, and multiple second information, and one first key is used to encrypt at least one second information; The multiple first keys are obtained by processing at least a master key using a key derivation algorithm.
21. A metadata generation device, characterized in that: The device comprises: An acquisition module, used to acquire media content; The generation module is used to generate metadata of the media content, where the metadata of the media content includes first information, where the first information is obtained by performing privacy protection processing based on second information, and the second information is at least part of the third information of the media content.
22. The device according to claim 21, characterized in that The privacy protection process includes at least one of an encryption process or a hard binding process.
23. The device according to claim 21 or 22, characterized in that The first information is obtained by encrypting multiple second information using multiple keys; wherein one key is used to encrypt at least one second information.
24. The device according to claim 23, characterized in that The multiple keys are obtained by processing at least a master key using a key derivation algorithm.
25. A device for displaying media assets, characterized in that: The device comprises: A receiving module, configured to receive an operation on a media asset, wherein the media asset includes media content and metadata of the media content, wherein the metadata of the media content includes first information and fourth information, wherein the first information is obtained by performing privacy protection processing based on the second information, the second information is at least part of the third information of the media content, and the fourth information is information in the third information of the media content that has not been subjected to privacy protection processing; The display module is configured to display the fourth information in response to the operation on the media asset.
26. The device according to claim 25, characterized in that The display module is configured to display the first information in response to the operation on the media asset.
27. The device according to claim 25 or 26, characterized in that The first information includes information obtained by encrypting the second information using a first key, The display module is used for displaying second information obtained by decrypting the first information using the first key in response to the operation on the media asset when the electronic device holds the first key.
28. An electronic device, characterized in that: include: a memory and a processor, the memory being coupled to the processor; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the metadata generation method as described in any one of claims 1 to 15.
29. An electronic device, characterized in that: include: a memory and a processor, the memory being coupled to the processor; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the method for displaying media assets as claimed in any one of claims 16 to 20.
30. A chip, characterized in that: It includes one or more interface circuits and one or more processors; the one or more processors receive or send data through the one or more interface circuits, and when the one or more processors execute computer instructions, the electronic device executes the method as described in any one of claims 1 to claim 20.
31. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program runs on a computer or a processor, the computer or the processor executes the method according to any one of claims 1 to 20.
32. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are executed by a computer or a processor, the steps of the method according to any one of claims 1 to 20 are performed.
Citation Information
Patent Citations
Cipher information secure storage method and cipher manager based on SIM card information
CN106330819A
Picture processing method and related device
CN111143586A
Method of securing image data and electronic device adapted to the same
US20160140350A1
Techniques for multimedia metadata security
US9268964B1