Digital human protection method and device, network equipment, storage medium and program product

By embedding watermark information in digital human information and generating verification information, the problem of difficulty in protecting copyright of digital humans is solved, effective verification and tampering judgment of digital human information is realized, and copyright security of digital human technology is ensured.

CN118965314APending Publication Date: 2024-11-15CHINA MOBILE COMM LTD RES INST +1
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411039253.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

The existing technology cannot effectively realize the copyright protection of digital people, resulting in copyright disputes, difficulty in confirming rights, and difficulty in protecting rights in the Internet, affecting the economic interests and enthusiasm of AI manufacturers for technological research and development.

Method used

Watermark information is embedded in the process of generating and editing digital person information, verification information is generated based on copyright protection information, and written into metadata to realize verification and tampering judgment of digital person information.

Benefits of technology

By embedding watermark information and verification information, we ensure independent tampering and judgment of digital human information and copyright protection, effectively prevent content tampering, and ensure the copyright security of digital human technology.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118965314A_ABST
    Figure CN118965314A_ABST
Patent Text Reader

Abstract

The invention provides a digital human protection method and device, network equipment, a storage medium and a program product, and is applied to the technical field of digital human. The method comprises the following steps of: embedding watermark information into digital human information in a process of generating and / or editing the digital human information; the watermark information is generated according to copyright protection information of the digital human information; and writing verification information calculated according to the watermark information into metadata of the digital human information. By adopting the method, in the digital human information generating and / or editing process, the watermark information is embedded into the generated or edited digital human information, the digital human information carrying the watermark information is obtained, in addition, the verification information calculated according to the watermark information is written into the metadata of the digital human information, and the verification information is written into the metadata of the digital human information. Therefore, a verification party of the digital human information can use the watermark information and the verification information to verify the digital human information, independent tampering judgment of the digital human information is realized, and effective protection of the copyright of the digital human is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of digital human technology, and in particular to a digital human protection method, device, network equipment, storage medium and program product. Background Art

[0002] Digital humans can be applied to online and offline scenarios, such as live broadcasting, shopping guides, video customer service, business consulting, employee training, etc. Any text and voice content displayed on the screen can be given a vivid character image. For enterprises, digital humans can help enterprises reduce service and content production costs, improve marketing efficiency, and bring better experience to users. The current text dialogue and voice dialogue robot scenarios can be replaced by digital humans in the future.

[0003] As digital human technology develops, major AI manufacturers do not have a good copyright management and protection method for digital human images, especially for 3D digital humans. At present, many AI manufacturers' clients generate broadcast services, such as news broadcast videos generated based on text, anti-fraud propaganda broadcasts, etc., and the videos generated by digital humans may be posted on the Internet. However, due to the difficulty of Internet supervision and information dissemination, it is also possible to modify the content of video broadcasts through Deepfake technology, resulting in multimodal digital humans facing copyright disputes, difficulty in confirming rights, and difficulty in protecting rights after being disseminated on the Internet. While causing economic losses to AI manufacturers, it also hits the enthusiasm for the research and development of multimodal digital human technology. Summary of the invention

[0004] The purpose of the technical solution of this application is to provide a digital human protection method, device, network equipment, storage medium and program product, which are used to solve the problem that the existing technology cannot effectively realize the copyright protection of digital humans.

[0005] One embodiment of the present application provides a digital human protection method, wherein the method comprises:

[0006] During the generation and / or editing process of the digital human information, embedding watermark information in the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0007] The verification information calculated according to the watermark information is written into the metadata of the digital human information.

[0008] Optionally, in the digital human protection method, the digital human information includes a digital human model and / or digital human media content.

[0009] Optionally, in the digital human protection method, the copyright protection information includes one or more of the following:

[0010] An author who generates and / or edits the digital human information;

[0011] Copyright information of the digital human information;

[0012] Generate and / or edit the operation information of the digital human information;

[0013] Media copyright information of the digital human information.

[0014] Optionally, in the digital human protection method, the watermark information includes one or more of a timestamp, a random serial number, copyright, author and operation information.

[0015] Optionally, in the digital human protection method, when the digital human information is a digital human model, embedding watermark information in the digital human information includes one or more of the following:

[0016] Embedding watermark information in the digital human information by modifying part of the coordinate data and / or the topological structure in the digital human model;

[0017] By modifying the pixel values ​​of the texture of the digital human model, watermark information is embedded in the digital human information;

[0018] By adopting a watermark embedding network method, watermark information is embedded in the digital human information.

[0019] Optionally, in the digital human protection method, when the digital human information is digital human media content, embedding watermark information in the digital human information includes one or more of the following:

[0020] Embedding watermark information in the digital human media content by numerically adjusting content elements of the digital human media content in the spatial domain and / or the frequency domain;

[0021] Different information in the watermark information is respectively embedded in a plurality of consecutive frames of the digital human media content.

[0022] Optionally, the digital human protection method, wherein, in the process of generating and / or editing the digital human information, embedding watermark information in the digital human information, comprises:

[0023] In the process of generating and / or editing the digital human information, a plurality of sets of watermark information are sequentially embedded in the digital human information;

[0024] The step of writing the verification information calculated according to the watermark information into the metadata of the digital human information includes:

[0025] According to the order of the multiple groups of watermark information embedded in the digital human information, the verification information calculated according to the corresponding watermark information is sequentially written into the metadata of the digital human information.

[0026] Optionally, the digital human protection method further comprises:

[0027] The watermark information is calculated by one or more of a hash function, a signature method and a summary method to generate verification information corresponding to the watermark information.

[0028] Optionally, in the digital human protection method, the verification information includes one or more of a verification algorithm, a random serial number and a verification value.

[0029] One embodiment of the present application further provides a digital human protection method, wherein the method comprises:

[0030] After obtaining the digital human information and the metadata of the digital human information, obtaining the watermark information in the digital human information, and obtaining the first verification information in the metadata; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0031] Calculate corresponding second verification information according to the watermark information;

[0032] The first verification information is compared with the second verification information to verify the digital human information.

[0033] Optionally, in the digital human protection method, the digital human information includes a digital human model and / or digital human media content.

[0034] Optionally, in the digital human protection method, the copyright protection information includes one or more of the following:

[0035] An author who generates and / or edits the digital human information;

[0036] Copyright information of the digital human information;

[0037] Generate and / or edit the operation information of the digital human information;

[0038] Media copyright information of the digital human information.

[0039] Optionally, in the digital human protection method, the watermark information includes one or more of a timestamp, a random serial number, copyright, author and operation information.

[0040] Optionally, in the digital human protection method, the first verification information includes one or more of a verification algorithm, a random sequence number and a verification value;

[0041] The step of calculating the corresponding second verification information according to the watermark information includes:

[0042] Calculate the watermark information according to the verification algorithm in the first verification information to determine the corresponding second verification information;

[0043] Comparing the first verification information with the second verification information includes:

[0044] Comparing the second verification information with the verification value in the first verification information;

[0045] When the second verification information is consistent with the verification value, it is determined that the verification of the digital human information is passed.

[0046] Optionally, in the digital human protection method, the verification algorithm includes one or more of a hash function, a signature method and a summary method.

[0047] One embodiment of the present application further provides a network device, comprising a processor, configured to:

[0048] During the generation and / or editing process of the digital human information, embedding watermark information in the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0049] The verification information calculated according to the watermark information is written into the metadata of the digital human information.

[0050] One embodiment of the present application further provides a network device, comprising a processor, configured to:

[0051] After obtaining the digital human information and the metadata of the digital human information, obtaining the watermark information in the digital human information, and obtaining the first verification information in the metadata; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0052] Calculate corresponding second verification information according to the watermark information;

[0053] The first verification information is compared with the second verification information to verify the digital human information.

[0054] One embodiment of the present application further provides a digital human protection device, wherein the device comprises:

[0055] A first processing module, configured to embed watermark information into the digital human information during the generation and / or editing process of the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0056] The second processing module is used to write the verification information calculated according to the watermark information into the metadata of the digital human information.

[0057] One embodiment of the present application further provides a digital human protection device, wherein the device comprises:

[0058] An information acquisition module, configured to acquire watermark information in the digital human information and first verification information in the metadata after acquiring the digital human information and the metadata of the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0059] A calculation module, used to calculate corresponding second verification information according to the watermark information;

[0060] A comparison module is used to compare the first verification information with the second verification information to verify the digital human information.

[0061] One embodiment of the present application further provides a network device, which includes a processor, a memory, and a program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the digital human protection method as described in any one of the above items.

[0062] One embodiment of the present application further provides a readable storage medium, wherein a program is stored on the readable storage medium, and when the program is executed by a processor, the steps in the digital human protection method as described in any one of the above items are implemented.

[0063] One embodiment of the present application further provides a computer program product, which includes computer instructions, and when the computer instructions are executed by a processor, the steps in the digital human protection method as described in any of the above items are implemented.

[0064] At least one of the above technical solutions of the present application has the following beneficial effects:

[0065] The digital human protection method described in the embodiment of the present application embeds watermark information in the generated or edited digital human information during the process of generating and / or editing digital human information. The watermark information is generated based on the copyright protection information of the digital human information, thereby obtaining digital human information carrying the watermark information. In addition, the verification information calculated based on the watermark information is written into the metadata of the digital human information, so that the verifier of the digital human information can use the watermark information and the verification information to verify the digital human information, thereby realizing independent tampering judgment on the digital human information and ensuring effective protection of the digital human copyright. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1This is a flowchart of a digital human protection method according to one embodiment of the present application;

[0067] Figure 2 A schematic diagram of a process for implementing the method of the embodiment of the present application;

[0068] Figure 3 A schematic diagram of a second embodiment of the method according to the embodiment of the present application;

[0069] Figure 4 This is a flowchart of a digital human protection method according to another embodiment of the present application;

[0070] Figure 5 This is a schematic diagram of the structure of a network device according to one embodiment of the present application;

[0071] Figure 6 This is a schematic diagram of the structure of a network device according to another embodiment of the present application;

[0072] Figure 7 This is a schematic diagram of the structure of a digital human protection device according to one embodiment of the present application;

[0073] Figure 8 This is a schematic diagram of the structure of a digital human protection device according to another embodiment of the present application. DETAILED DESCRIPTION

[0074] In order to make the technical problems, technical solutions and advantages to be solved by the present application clearer, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0075] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first" and "second" are generally of the same type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally represents that the objects associated with each other are in an "or" relationship.

[0076] In order to solve the problem that the existing technology cannot effectively realize the copyright protection of digital humans, the embodiment of the present application provides a digital human protection method, which effectively protects the digital human information by embedding watermark information in the digital human information during the generation and / or editing process of the digital human information, and enables the verifier of the digital human information to verify the digital human information using the watermark information, thereby realizing independent tampering judgment of the digital human information and ensuring effective protection of the digital human copyright.

[0077] One embodiment of the present application provides a digital human protection method, such as Figure 1 As shown, the method includes:

[0078] S110, in the process of generating and / or editing the digital human information, embedding watermark information in the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0079] S120, writing the verification information calculated according to the watermark information into the metadata of the digital human information.

[0080] The digital human protection method described in the embodiment of the present application can, optionally, be applied to a processing device used for generating or editing digital human information.

[0081] By adopting the digital human protection method described in the embodiment of the present application, watermark information is embedded in the generated or edited digital human information during the process of generating and / or editing digital human information. The watermark information is generated based on the copyright protection information of the digital human information, thereby obtaining digital human information carrying the watermark information. In addition, the verification information calculated based on the watermark information is written into the metadata of the digital human information, so that the verifier of the digital human information can use the watermark information and the verification information to verify the digital human information, thereby realizing independent tampering judgment on the digital human information and ensuring effective protection of the digital human copyright.

[0082] In the embodiment of the present application, optionally, the digital human information mentioned includes a digital human model and / or digital human media content.

[0083] By adopting this implementation, during the generation and / or editing process of the digital human model and / or digital human media content, watermark information can be embedded in the digital human model or the digital human media content, thereby achieving effective protection of the digital human model and the digital human media content.

[0084] In the embodiments of the present application, the digital human model mentioned is a module or model used to create a digital human, or a created digital human model; the digital human media content mentioned is a media or medium used to carry or transmit a digital human, or a media or medium used to carry or transmit 2D or 3D content including a digital human, such as a picture or video; optionally, the digital human in the present application can be a 3D digital human, a flat digital human, or other different digital human forms.

[0085] In one implementation manner, optionally, the copyright protection information includes one or more of the following:

[0086] An author who generates and / or edits the digital human information;

[0087] Copyright information of the digital human information;

[0088] Generate and / or edit the operation information of the digital human information;

[0089] Media copyright information of the digital human information.

[0090] In one embodiment, optionally, the watermark information includes one or more of a timestamp, a random serial number, a copyright, an author, and an operation information.

[0091] The following describes the implementation of the digital human protection method described in the embodiment of the present application in combination with specific implementation methods.

[0092] Implementation Method 1

[0093] In the first embodiment, the digital human information includes a digital human model. During the generation and / or editing process of the digital human model, watermark information is embedded in the digital human model. Figure 2 As shown, the implementation specifically includes the following steps:

[0094] S201, during the process of generating and / or editing the digital human model, encapsulating the copyright protection information of the digital human model as watermark information.

[0095] In one implementation mode, optionally, during the generation and / or editing process of the digital human model, the copyright information of the digital human model is encapsulated as watermark information; optionally, the copyright information includes the model copyright and / or the model author, etc.;

[0096] Optionally, during the generation and / or editing process of the digital human model, operation information on the generation and / or editing link is encapsulated as watermark information; optionally, the operation information includes one or more of a model editing operation, a model rendering operation, operator information, and an operation time;

[0097] Optionally, during the generation process of the digital human model, the media copyright information of the digital human model is encapsulated as watermark information; optionally, the media copyright information includes media copyright and / or media author, etc.

[0098] The watermark information encapsulated based on the above information may include one or more of a timestamp, a random serial number, copyright, author, and operation information. The timestamp is used to record the generation time of the watermark information, and the random serial number is a serial number randomly generated based on the watermark information.

[0099] S202, embedding watermark information into the digital human model, or in other words, embedding watermark information into the digital human information;

[0100] In the embodiment of the present application, optionally, embedding watermark information in the digital human information includes one or more of the following:

[0101] Embedding watermark information in the digital human information by modifying part of the coordinate data and / or the topological structure in the digital human model;

[0102] By modifying the pixel values ​​of the texture of the digital human model, watermark information is embedded in the digital human information;

[0103] By adopting a watermark embedding network method, watermark information is embedded in the digital human information.

[0104] In one embodiment, optionally, according to the watermark information to be embedded, the watermark information is embedded in the digital human model by modifying the coordinate data, topological structure and / or map pixel value of the digital human model in the spatial domain; in another embodiment, optionally, according to the watermark information to be embedded, the watermark information is spatially transformed in the frequency domain to form a watermark embedding network method, and the watermark information is embedded in the digital human model. For example, one spatial domain embedding method is to replace the binary code of the watermark information, that is, 0 or 1, with the lowest bit of the digital human map pixel value (for example, the watermark information is 0, 1, 1, the map pixel values ​​are 79, 60, 32, and the binary expressions corresponding to the map pixel values ​​are 1001111, 111100, 100000. Therefore, the corresponding lowest bits are 1, 0, 0, which are replaced by 0, 1, 1 with the watermark information. The corresponding modified binary expressions of the map pixel values ​​are 1001110, 111101, 100001, that is, the map pixel values ​​are 78, 61, 33. When extracting the watermark, the lowest bit is read out, that is, the watermark information is 0, 1, 1).

[0105] In one implementation mode, optionally, when the embedded watermark information is multiple groups, during the generation and / or editing process of the digital human model, each group of watermark information is sequentially embedded in the digital human model.

[0106] S203, calculating verification information of the watermark information embedded in the digital human model;

[0107] In one embodiment, the watermark information is optionally calculated by one or more of a hash function, a signature method, and a summary method to generate verification information corresponding to the watermark information. For example, the method of generating verification using a hash function, if the watermark information is "this digital person was generated on January 1, 2024", a 256-bit hash algorithm is used for calculation. First, the string is converted into a character array, and an initial hash value is selected, such as hash=0. For each character in the array, its ASCII value is added to the hash value; then, the hash value is modulo a fixed number (such as a prime number 31) to maintain the size of the hash value. Through the above calculation, the hash value, that is, the verification value, is: "ff030191c557a5c160b348f4bda027f03eaf0079be24d1188b8d3a1c6b88b816". Optionally, the hash function includes one or more of SHA256 and RIPEMD. According to the watermark information, the hash is calculated by using the hash function SHA256 and / or RIPEMD to generate verification information corresponding to the watermark information.

[0108] Optionally, when there are multiple groups of watermark information embedded in the digital human model, verification information corresponding to each group of watermark information is calculated in sequence according to the order of the multiple groups of watermark information embedded in the digital human model.

[0109] Optionally, the verification information includes one or more of a verification algorithm, a random sequence number and a verification value.

[0110] S204, writing the verification information calculated according to the watermark information into the metadata of the digital human model.

[0111] In one implementation mode, optionally, according to requirements of different encapsulation file formats of metadata, the verification information may be written into one or more items of the file header and / or file attributes of the metadata.

[0112] Optionally, the file format of the metadata may include one or more of obj, fbx, pcd, ply, and xyz.

[0113] Optionally, the format of the verification information written in the metadata may be: {verification algorithm, random sequence number, verification value}.

[0114] In one implementation mode, optionally, when there are multiple groups of watermark information embedded in the digital human model, the verification information corresponding to each group of watermark information is written into the metadata of the digital human model in sequence according to the order of the multiple groups of watermark information embedded in the digital human model.

[0115] Implementation Method 2

[0116] In the second embodiment, the digital human information includes digital human media content. In the process of generating and / or editing the digital human media content, watermark information is embedded in the digital human media content. Figure 3 As shown, the implementation specifically includes the following steps:

[0117] S301: In the process of generating and / or editing digital human media content, the copyright protection information of the digital human media content is encapsulated as watermark information.

[0118] In one implementation mode, optionally, during the generation and / or editing process of the digital human media content, the copyright information of the digital human media content is encapsulated as watermark information; optionally, the copyright information includes the copyright of the digital human media content and / or the author of the digital human media content, etc.;

[0119] Optionally, in the process of generating and / or editing the digital human media content, the operation information on the generating and / or editing link is encapsulated as watermark information; Optionally, the operation information includes one or more of the editing operation of the digital human media content, the model rendering operation, the operator information and the operation time;

[0120] Optionally, during the generation process of the digital human media content, the media copyright information of the digital human media content is encapsulated as watermark information; optionally, the media copyright information includes media copyright and / or media author, etc.

[0121] The watermark information encapsulated based on the above information may include one or more of a timestamp, a random serial number, copyright, author, and operation information. The timestamp is used to record the generation time of the watermark information, and the random serial number is a serial number randomly generated based on the watermark information.

[0122] In another implementation, optionally, during the generation and / or editing process of the digital human media content, the copyright protection information of the digital human model may also be encapsulated as watermark information.

[0123] That is, in the process of generating and / or editing the digital human media content, one or more of the copyright information of the digital human model, the operation information of generating and / or editing the digital human model (including one or more of the model editing operation, model rendering operation, operator information and operation time), the media copyright information of the digital human model, etc., are encapsulated as watermark information.

[0124] S302, embedding watermark information into the digital human media content, or in other words, embedding watermark information into the digital human media content;

[0125] In the embodiment of the present application, optionally, embedding watermark information in the digital human information includes one or more of the following:

[0126] By numerically adjusting the content elements of the digital human media content in the spatial domain and / or frequency domain, watermark information is embedded in the digital human media content; the spatial domain refers to embedding the watermark information in the temporal and spatial expressions of the digital human media content. The frequency domain refers to first transforming the two-dimensional spatial expression of the digital human media content into a frequency domain expression by DCT or other transformations, and then embedding the watermark information in the frequency domain expression.

[0127] Different information in the watermark information is respectively embedded in a plurality of consecutive frames of the digital human media content.

[0128] In one implementation mode, optionally, when the embedded watermark information is multiple groups, each group of watermark information is sequentially embedded in the digital human media content during the generation and / or editing process of the digital human media content.

[0129] S303, calculating verification information of the watermark information embedded in the digital human media content;

[0130] In one implementation mode, optionally, the watermark information is calculated by one or more of a hash function, a signature method and a summary method to generate verification information corresponding to the watermark information.

[0131] Optionally, the hash function includes one or more of SHA256 and RIPEMD. According to the watermark information, the hash is calculated by using the hash function SHA256 and / or RIPEMD to generate verification information corresponding to the watermark information.

[0132] Optionally, when there are multiple groups of watermark information embedded in the digital human media content, the verification information corresponding to each group of watermark information is calculated in sequence according to the order of the multiple groups of watermark information embedded in the digital human media content.

[0133] Optionally, the verification information includes one or more of a verification algorithm, a random sequence number and a verification value.

[0134] S304, writing the verification information calculated according to the watermark information into the metadata of the digital human media content.

[0135] In one implementation mode, optionally, according to requirements of different encapsulation file formats of metadata, the verification information may be written into one or more items of the file header and / or file attributes of the metadata.

[0136] Optionally, the file format of the metadata of the digital human media content may include one or more of mp4, flv, avi and ts.

[0137] Optionally, the format of the verification information written in the metadata may be: {verification algorithm, random sequence number, verification value}.

[0138] In one implementation mode, optionally, when there are multiple groups of watermark information embedded in the digital human media content, the verification information corresponding to each group of watermark information is written into the metadata of the digital human media content in sequence according to the order of the multiple groups of watermark information embedded in the digital human media content.

[0139] In the embodiments of the present application, the above examples are respectively used to illustrate the embedding of watermark information in the digital human model during the generation and / or editing process of the digital human model, and the embedding of watermark information in the digital human media content during the generation and / or editing process of the digital human media content. It should be noted that in the entire transmission process from the generation of the digital human model to the digital human media content, in the generation and / or editing of the digital human model and in the generation and / or editing of the digital human media content, watermark information can be embedded respectively. For specific implementation methods, please refer to the detailed description in the above-mentioned Implementation Methods 1 and 2, and will not be repeated here.

[0140] It should be noted that, in the embodiment of the present application, the step of embedding watermark information into digital human information can be performed simultaneously with the step of calculating the verification value based on the watermark information, or can be performed in steps.

[0141] By adopting the digital human protection method described in the embodiment of the present application, by embedding watermark information in the digital human model and / or digital human media content during the generation and / or editing process of the digital human model and / or digital human media content, effective protection of the digital human model and / or digital human media content can be achieved; in addition, by embedding watermark information in the digital human model and / or digital human media content, it is possible to be independent of the blockchain system and to determine whether the digital human has been tampered with in the absence of other auxiliary systems, such as when there is no network connection.

[0142] On the other hand, the embodiment of the present application also provides a digital human protection method, such as Figure 4 As shown, the method includes:

[0143] S410, after obtaining digital human information and metadata of the digital human information, obtaining watermark information in the digital human information and obtaining first verification information in the metadata; wherein the watermark information is generated according to copyright protection information of the digital human information;

[0144] S420, calculating corresponding second verification information according to the watermark information;

[0145] S430: Compare the first verification information with the second verification information to verify the digital human information.

[0146] In the digital human protection method described in the embodiment of the present application, in this implementation, optionally, an extraction device applied to digital human information is capable of obtaining watermark information in the digital human information and first verification information in the corresponding metadata, calculating corresponding second verification information based on the watermark information, and verifying the digital human information by comparing the first verification information with the second verification information. Therefore, this implementation is adopted to embed watermark information in the generated or edited digital human information, and also write the verification information calculated based on the watermark information into the metadata of the digital human information, so that the verification party of the digital human information can use the watermark information and verification information to verify the digital human information, realize independent tampering judgment of the digital human information, and ensure effective protection of the digital human copyright.

[0147] In the embodiment of the present application, optionally, the digital human information includes a digital human model and / or digital human media content.

[0148] In an embodiment of the present application, optionally, the first verification information in the process of extracting the digital human information is the same verification information as the verification information in the process of generating and / or editing the digital human information. During the extraction process, in order to facilitate the distinction from the second verification information, the verification information is described as the first verification information.

[0149] It should be noted that when extracting digital human information using the method described in the embodiment of the present application, the digital human information can be obtained and the watermark information can be extracted based on the usual method of extracting digital human information and combined with the method of embedding watermark information. This part is not the research focus of the present application and will not be described in detail here.

[0150] In one implementation manner, optionally, the copyright protection information includes one or more of the following:

[0151] An author who generates and / or edits the digital human information;

[0152] Copyright information of the digital human information;

[0153] Generate and / or edit the operation information of the digital human information;

[0154] Media copyright information of the digital human information.

[0155] In one embodiment, optionally, in the case where the digital human information is a digital human model, the copyright protection information includes one or more of the copyright information of the digital human model, operation information for generating and / or editing the digital human model (including one or more of model editing operation, model rendering operation, operator information and operation time), media copyright information of the digital human model, etc.

[0156] In one embodiment, optionally, when the digital human information is digital human media content, the copyright protection information includes one or more of the copyright information of the digital human media content, operation information on the digital human media content generation and / or editing link (including one or more of the editing operation of the digital human media content, model rendering operation, operator information and operation time), media copyright information of the digital human media content, etc.

[0157] In one implementation manner, optionally, the watermark information includes one or more of a timestamp, a random serial number, a copyright, an author, and operation information.

[0158] In one implementation manner, optionally, the first verification information includes one or more of a verification algorithm, a random sequence number, and a verification value;

[0159] The step of calculating the corresponding second verification information according to the watermark information includes:

[0160] Calculate the watermark information according to the verification algorithm in the first verification information to determine the corresponding second verification information;

[0161] Comparing the first verification information with the second verification information includes:

[0162] Comparing the second verification information with the verification value in the first verification information;

[0163] When the second verification information is consistent with the verification value, it is determined that the verification of the digital human information is passed.

[0164] Optionally, the verification algorithm includes one or more of a hash function, a signature method and a summary method.

[0165] It should be noted that, in the embodiment of the present application, the steps of obtaining the first verification information in the metadata and calculating the corresponding second verification information according to the watermark information can be performed simultaneously or in steps.

[0166] One embodiment of the present application also provides a network device, such as Figure 5 As shown, the network device 500 includes a processor 510, which is used to:

[0167] During the generation and / or editing process of the digital human information, embedding watermark information in the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0168] The verification information calculated according to the watermark information is written into the metadata of the digital human information.

[0169] Optionally, in the network device, the digital human information includes a digital human model and / or digital human media content.

[0170] Optionally, in the network device, the copyright protection information includes one or more of the following:

[0171] An author who generates and / or edits the digital human information;

[0172] Copyright information of the digital human information;

[0173] Generate and / or edit the operation information of the digital human information;

[0174] Media copyright information of the digital human information.

[0175] Optionally, in the network device, the watermark information includes one or more of a timestamp, a random serial number, a copyright, an author and operation information.

[0176] Optionally, in the network device, when the digital human information is a digital human model, the processor 510 embeds watermark information in the digital human information, including one or more of the following:

[0177] Embedding watermark information in the digital human information by modifying part of the coordinate data and / or the topological structure in the digital human model;

[0178] By modifying the pixel values ​​of the texture of the digital human model, watermark information is embedded in the digital human information;

[0179] By adopting a watermark embedding network method, watermark information is embedded in the digital human information.

[0180] Optionally, in the network device, when the digital human information is digital human media content, the processor 510 embeds watermark information in the digital human information, including one or more of the following:

[0181] Embedding watermark information in the digital human media content by numerically adjusting content elements of the digital human media content in the spatial domain and / or the frequency domain;

[0182] Different information in the watermark information is respectively embedded in a plurality of consecutive frames of the digital human media content.

[0183] Optionally, in the network device, the processor 510 embeds watermark information in the digital human information during the generation and / or editing process of the digital human information, including:

[0184] In the process of generating and / or editing the digital human information, a plurality of sets of watermark information are sequentially embedded in the digital human information;

[0185] The processor 510 writes the verification information calculated according to the watermark information into the metadata of the digital human information, including:

[0186] According to the order of the multiple groups of watermark information embedded in the digital human information, the verification information calculated according to the corresponding watermark information is sequentially written into the metadata of the digital human information.

[0187] Optionally, in the network device, the processor 510 is further configured to:

[0188] The watermark information is calculated by one or more of a hash function, a signature method and a summary method to generate verification information corresponding to the watermark information.

[0189] Optionally, in the network device, the verification information includes one or more of a verification algorithm, a random sequence number and a verification value.

[0190] One embodiment of the present application also provides a network device, such as Figure 6 As shown, the network device 600 includes a processor 610, which is used to:

[0191] After obtaining the digital human information and the metadata of the digital human information, obtaining the watermark information in the digital human information, and obtaining the first verification information in the metadata; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0192] Calculate corresponding second verification information according to the watermark information;

[0193] The first verification information is compared with the second verification information to verify the digital human information.

[0194] Optionally, in the network device, the digital human information includes a digital human model and / or digital human media content.

[0195] Optionally, in the network device, the copyright protection information includes one or more of the following:

[0196] An author who generates and / or edits the digital human information;

[0197] Copyright information of the digital human information;

[0198] Generate and / or edit the operation information of the digital human information;

[0199] Media copyright information of the digital human information.

[0200] Optionally, in the network device, the watermark information includes one or more of a timestamp, a random serial number, a copyright, an author and operation information.

[0201] Optionally, the network device, wherein the first verification information includes one or more of a verification algorithm, a random sequence number and a verification value;

[0202] The processor 610 calculates corresponding second verification information according to the watermark information, including:

[0203] Calculate the watermark information according to the verification algorithm in the first verification information to determine the corresponding second verification information;

[0204] The processor 610 compares the first verification information with the second verification information, including:

[0205] Comparing the second verification information with the verification value in the first verification information;

[0206] When the second verification information is consistent with the verification value, it is determined that the verification of the digital human information is passed.

[0207] Optionally, in the network device, the verification algorithm includes one or more of a hash function, a signature method and a summary method.

[0208] One embodiment of the present application also provides a digital human protection device, such as Figure 7 As shown, the device comprises:

[0209] The first processing module 710 is used to embed watermark information in the digital human information during the generation and / or editing process of the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0210] The second processing module 720 is used to write the verification information calculated according to the watermark information into the metadata of the digital human information.

[0211] Optionally, in the digital human protection device, the digital human information includes a digital human model and / or digital human media content.

[0212] Optionally, in the digital human protection device, the copyright protection information includes one or more of the following:

[0213] An author who generates and / or edits the digital human information;

[0214] Copyright information of the digital human information;

[0215] Generate and / or edit the operation information of the digital human information;

[0216] Media copyright information of the digital human information.

[0217] Optionally, in the digital human protection device, the watermark information includes one or more of a timestamp, a random serial number, a copyright, an author and operation information.

[0218] Optionally, in the digital human protection device, when the digital human information is a digital human model, the first processing module 710 embeds watermark information in the digital human information, including one or more of the following:

[0219] Embedding watermark information in the digital human information by modifying part of the coordinate data and / or the topological structure in the digital human model;

[0220] By modifying the pixel values ​​of the texture of the digital human model, watermark information is embedded in the digital human information;

[0221] By adopting a watermark embedding network method, watermark information is embedded in the digital human information.

[0222] Optionally, in the digital human protection device, when the digital human information is digital human media content, the first processing module 710 embeds watermark information in the digital human information, including one or more of the following:

[0223] Embedding watermark information in the digital human media content by numerically adjusting content elements of the digital human media content in the spatial domain and / or the frequency domain;

[0224] Different information in the watermark information is respectively embedded in a plurality of consecutive frames of the digital human media content.

[0225] Optionally, in the digital human protection device, the first processing module 710 embeds watermark information in the digital human information during the generation and / or editing process of the digital human information, including:

[0226] In the process of generating and / or editing the digital human information, a plurality of sets of watermark information are sequentially embedded in the digital human information;

[0227] The second processing module 720 writes the verification information calculated according to the watermark information into the metadata of the digital human information, including:

[0228] According to the order of the multiple groups of watermark information embedded in the digital human information, the verification information calculated according to the corresponding watermark information is sequentially written into the metadata of the digital human information.

[0229] Optionally, in the digital human protection device, the second processing module 720 is further used for:

[0230] The watermark information is calculated by one or more of a hash function, a signature method and a summary method to generate verification information corresponding to the watermark information.

[0231] Optionally, in the digital human protection device, the verification information includes one or more of a verification algorithm, a random serial number and a verification value.

[0232] One embodiment of the present application also provides a digital human protection device, such as Figure 8 As shown, the device comprises:

[0233] The information acquisition module 810 is used to acquire the watermark information in the digital human information and the metadata of the digital human information after acquiring the digital human information and the first verification information in the metadata; wherein the watermark information is generated according to the copyright protection information of the digital human information;

[0234] A calculation module 820, configured to calculate corresponding second verification information according to the watermark information;

[0235] The comparison module 830 is used to compare the first verification information with the second verification information to verify the digital human information.

[0236] Optionally, in the digital human protection device, the digital human information includes a digital human model and / or digital human media content.

[0237] Optionally, in the digital human protection device, the copyright protection information includes one or more of the following:

[0238] An author who generates and / or edits the digital human information;

[0239] Copyright information of the digital human information;

[0240] Generate and / or edit the operation information of the digital human information;

[0241] Media copyright information of the digital human information.

[0242] Optionally, in the digital human protection device, the watermark information includes one or more of a timestamp, a random serial number, a copyright, an author and operation information.

[0243] Optionally, in the digital human protection device, the first verification information includes one or more of a verification algorithm, a random sequence number and a verification value;

[0244] The calculation module 820 calculates the corresponding second verification information according to the watermark information, including:

[0245] Calculate the watermark information according to the verification algorithm in the first verification information to determine the corresponding second verification information;

[0246] Comparing the first verification information with the second verification information includes:

[0247] Comparing the second verification information with the verification value in the first verification information;

[0248] When the second verification information is consistent with the verification value, it is determined that the verification of the digital human information is passed.

[0249] Optionally, in the digital human protection device, the verification algorithm includes one or more of a hash function, a signature method and a summary method.

[0250] One embodiment of the present application further provides a network device, which includes a processor, a memory, and a program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the digital human protection method as described in any one of the above items.

[0251] Among them, the specific implementation method of executing the digital human protection method by the program running on the processor of the network device can refer to the detailed description of the digital human protection method applied to the network device mentioned above, and will not be repeated here.

[0252] In addition, a specific embodiment of the present application further provides a readable storage medium on which a computer program is stored, wherein when the program is executed by a processor, the steps in the digital human protection method as described in any one of the above items are implemented.

[0253] Specifically, the readable storage medium is applied to the above-mentioned network device. When applied to the network device, the execution steps in the corresponding digital human protection method are as described in detail above and will not be repeated here.

[0254] Another embodiment of the present invention further provides a computer program product, which includes computer instructions, and when the computer instructions are executed by a processor, the steps in the digital human protection method as described in any one of the above are implemented.

[0255] Optionally, the embodiments of the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0256] The computer program product described in the embodiment of the present invention includes computer instructions that implement the various processes of the method embodiment shown above when executed by a processor, and can achieve the same technical effect. To avoid repetition, they are not described here.

[0257] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0258] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0259] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the sending and receiving methods described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0260] The above is a preferred embodiment of the present application. It should be pointed out that for ordinary personnel in this technical field, several improvements and modifications can be made without departing from the principles described in the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A digital human protection method, characterized in that: The method comprises: During the generation and / or editing process of the digital human information, embedding watermark information in the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information; The verification information calculated according to the watermark information is written into the metadata of the digital human information.

2. The digital human protection method according to claim 1, characterized in that: The digital human information includes a digital human model and / or digital human media content.

3. The digital human protection method according to claim 1 or 2, characterized in that: The copyright protection information includes one or more of the following: An author who generates and / or edits the digital human information; Copyright information of the digital human information; Generate and / or edit the operation information of the digital human information; Media copyright information of the digital human information.

4. The digital human protection method according to claim 1 or 2, characterized in that: The watermark information includes one or more of a timestamp, a random sequence number, copyright, an author and operation information.

5. The digital human protection method according to claim 1, characterized in that: When the digital human information is a digital human model, embedding watermark information in the digital human information includes one or more of the following: Embedding watermark information in the digital human information by modifying part of the coordinate data and / or the topological structure in the digital human model; By modifying the pixel values ​​of the texture of the digital human model, watermark information is embedded in the digital human information; By adopting a watermark embedding network method, watermark information is embedded in the digital human information.

6. The digital human protection method according to claim 1, characterized in that: When the digital human information is digital human media content, embedding watermark information in the digital human information includes one or more of the following: Embedding watermark information in the digital human media content by numerically adjusting content elements of the digital human media content in the spatial domain and / or the frequency domain; Different information in the watermark information is respectively embedded in a plurality of consecutive frames of the digital human media content.

7. The digital human protection method according to claim 1, characterized in that: In the process of generating and / or editing digital human information, embedding watermark information in the digital human information includes: In the process of generating and / or editing the digital human information, a plurality of sets of watermark information are sequentially embedded in the digital human information; The step of writing the verification information calculated according to the watermark information into the metadata of the digital human information includes: According to the order of the multiple groups of watermark information embedded in the digital human information, the verification information calculated according to the corresponding watermark information is sequentially written into the metadata of the digital human information.

8. The digital human protection method according to claim 1, characterized in that: The method further comprises: The watermark information is calculated by one or more of a hash function, a signature method and a summary method to generate verification information corresponding to the watermark information.

9. The digital human protection method according to claim 1, characterized in that: The verification information includes one or more of a verification algorithm, a random sequence number and a verification value.

10. A digital human protection method, characterized in that: The method comprises: After obtaining the digital human information and the metadata of the digital human information, obtaining the watermark information in the digital human information, and obtaining the first verification information in the metadata; wherein the watermark information is generated according to the copyright protection information of the digital human information; Calculate corresponding second verification information according to the watermark information; The first verification information is compared with the second verification information to verify the digital human information.

11. The digital human protection method according to claim 10, characterized in that: The digital human information includes a digital human model and / or digital human media content.

12. The digital human protection method according to claim 10 or 11, characterized in that: The copyright protection information includes one or more of the following: An author who generates and / or edits the digital human information; Copyright information of the digital human information; Generate and / or edit the operation information of the digital human information; Media copyright information of the digital human information.

13. The digital human protection method according to claim 10 or 11, characterized in that: The watermark information includes one or more of a timestamp, a random sequence number, copyright, an author and operation information.

14. The digital human protection method according to claim 10, characterized in that: The first verification information includes one or more of a verification algorithm, a random sequence number, and a verification value; The step of calculating the corresponding second verification information according to the watermark information includes: Calculate the watermark information according to the verification algorithm in the first verification information to determine the corresponding second verification information; Comparing the first verification information with the second verification information includes: Comparing the second verification information with the verification value in the first verification information; When the second verification information is consistent with the verification value, it is determined that the verification of the digital human information is passed.

15. The digital human protection method according to claim 14, characterized in that: The verification algorithm includes one or more of a hash function, a signature method and a digest method.

16. A network device, characterized in that: Includes processors for: During the generation and / or editing process of the digital human information, embedding watermark information in the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information; The verification information calculated according to the watermark information is written into the metadata of the digital human information.

17. A network device, characterized in that: Includes processors for: After obtaining the digital human information and the metadata of the digital human information, obtaining the watermark information in the digital human information, and obtaining the first verification information in the metadata; wherein the watermark information is generated according to the copyright protection information of the digital human information; Calculate corresponding second verification information according to the watermark information; The first verification information is compared with the second verification information to verify the digital human information.

18. A digital human protection device, characterized in that: The device comprises: A first processing module, used for embedding watermark information in the digital human information during the generation and / or editing process of the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information; The second processing module is used to write the verification information calculated according to the watermark information into the metadata of the digital human information.

19. A digital human protection device, characterized in that: The device comprises: An information acquisition module, configured to acquire watermark information in the digital human information and first verification information in the metadata after acquiring the digital human information and the metadata of the digital human information; wherein the watermark information is generated according to the copyright protection information of the digital human information; A calculation module, used to calculate corresponding second verification information according to the watermark information; A comparison module is used to compare the first verification information with the second verification information to verify the digital human information.

20. A network device, characterized in that: The method comprises a processor, a memory and a program stored in the memory and executable on the processor, wherein when the program is executed by the processor, the method for protecting a digital human as claimed in any one of claims 1 to 15 is implemented.

21. A readable storage medium, characterized in that: The readable storage medium stores a program, and when the program is executed by the processor, the steps in the digital human protection method as described in any one of claims 1 to 15 are implemented.

22. A computer program product, characterized in that It comprises computer instructions, which, when executed by a processor, implement the steps in the digital human protection method as claimed in any one of claims 1 to 15.

Citation Information

Cited By

  • Digital human anti-counterfeiting method and device and electronic equipment

    CN119646779A

  • Resetting method and device for AI generation content, storage medium and program product

    CN119783067A