Multi-modal content processing method, device, system and equipment generated by artificial intelligence

Abstract

The invention relates to the field of computer technologies, large model technologies, large language model technologies and artificial intelligence technologies, in particular to a multi-modal content processing method, device, system and equipment generated by artificial intelligence, and the method comprises the steps that a content management platform obtains first media content of at least one modal and a generation mode of the first media content, the first media content comprises uploaded media content and / or locally generated media content; the generation mode is used for representing whether the first media content is generated by artificial intelligence. And the content management platform sends the first media content and the generation mode to a signature service platform. And the signature service platform performs digital signature on the first media content and the generation mode to obtain first signature information. And the content management platform obtains the first signature information returned by the signature service platform, and adds the first signature information to the first media content based on the mode of the first media content to obtain the second media content. The problem of verification of the artificial intelligence generation content can be solved.

Description

Technical Field

[0001] The present disclosure relates to the fields of computer technology, large model technology, large language model technology, and artificial intelligence technology, and particularly relates to a method, apparatus, system, and device for processing multi-modal content generated by artificial intelligence. Background Art

[0002] With the development of Artificial Intelligence (AI), applications related to Artificial Intelligence Generative Content (AIGC) have flourished. Among them, the types of content generated by artificial intelligence are diverse. For example, text, images, videos, audio, design materials, etc. Moreover, with the development of technology, the types and scope of content generated by artificial intelligence are still expanding. Therefore, there is an urgent need for a method to verify content generated by artificial intelligence. Summary of the Invention

[0003] In view of this, the present disclosure provides a method, apparatus, system, device, medium, and program product for processing multi-modal content generated by artificial intelligence to solve the problem of verifying content generated by artificial intelligence.

[0004] In a first aspect, the present disclosure provides a method for processing multi-modal content generated by artificial intelligence, which is applicable to a content management platform. The method includes: Obtaining at least one modality of first media content and the generation method of the first media content, where the first media content includes uploaded media content and / or locally generated media content; the generation method is used to represent whether the first media content is generated by artificial intelligence; Sending the first media content and the generation method to a signature service platform, where the signature service platform is used to digitally sign the first media content and the generation method to obtain first signature information; Obtaining the first signature information returned by the signature service platform; Based on the modality of the first media content, adding the first signature information to the first media content to obtain second media content.

[0005] In a second aspect, the present disclosure provides a method for processing multi-modal content generated by artificial intelligence, which is applicable to a signature service platform. The method includes: Obtaining at least one modality of first media content and the generation method of the first media content sent by a content management platform, where the first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to represent whether the first media content is generated by artificial intelligence; Digitally sign the first media content and the generation method to obtain first signature information; Feed back the first signature information to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

[0006] In a third aspect, the present disclosure provides an artificial intelligence-generated multimodal content processing device applicable to a content management platform, and the device includes: A first acquisition module, configured to acquire first media content of at least one modality and the generation method of the first media content, where the first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence; A first sending module, configured to send the first media content and the generation method to a signature service platform, where the signature service platform is used to digitally sign the first media content and the generation method to obtain first signature information; A second acquisition module, configured to acquire the first signature information returned by the signature service platform; A first processing module, configured to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

[0007] In a fourth aspect, the present disclosure provides an artificial intelligence-generated multimodal content processing device applicable to a signature service platform, and the device includes: A first receiving module, configured to acquire first media content of at least one modality and the generation method of the first media content sent by a content management platform, where the first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to characterize whether the first media content is generated by artificial intelligence; A first signature module, configured to digitally sign the first media content and the generation method to obtain first signature information; A first feedback module, configured to feed back the first signature information to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

[0008] In a fifth aspect, the present disclosure provides an artificial intelligence-generated multimodal content processing system, and the system includes: A content management platform, which is used to execute the artificial intelligence-generated multimodal content processing method in the first aspect above; A signature service platform, which is communicatively connected to the content management platform and is used to execute the artificial intelligence-generated multimodal content processing method in the second aspect above.

[0009] In a sixth aspect, the present disclosure provides an electronic device, including: a memory and a processor, which are communicatively connected to each other. The memory stores computer instructions, and the processor executes the computer instructions to execute the artificial intelligence-generated multimodal content processing method in the first aspect above, or execute the artificial intelligence-generated multimodal content processing method in the second aspect above.

[0010] In a seventh aspect, the present disclosure provides a computer-readable storage medium, on which computer instructions are stored, and the computer instructions are used to cause a computer to execute the artificial intelligence-generated multimodal content processing method in the first aspect above, or execute the artificial intelligence-generated multimodal content processing method in the second aspect above.

[0011] In an eighth aspect, the present disclosure provides a computer program product, including computer instructions, and the computer instructions are used to cause a computer to execute the artificial intelligence-generated multimodal content processing method in the first aspect above, or execute the artificial intelligence-generated multimodal content processing method in the second aspect above.

[0012] In the artificial intelligence-generated multimodal content processing method provided by the embodiments of the present disclosure, the content management platform sends the first media content and the generation method of the first media content to the signature service platform, so that the signature service platform performs digital signature on the first media content and the generation method, and adds the first signature information returned by the signature service platform to the first media content to obtain the second media content. Therefore, subsequently, the generation method of the second media content can be verified through the first signature information in the second media content, so as to facilitate verifying whether the second media content is artificial intelligence-generated content. At the same time, since the data structures of media contents of different modalities are different, adding the first signature information to the first media content based on the modality of the first media content can not only avoid the influence of adding the first signature information on the use of the media content, but also facilitate accurately and quickly extracting the first signature information in the second media content when verifying the second media content subsequently, so as to effectively verify the generation method of the second media content. Moreover, there are differences in the security of the information storage locations of media contents of different modalities. Adding the first signature information based on the modality can also enhance the security of the first signature information to a certain extent and reduce the risk of the first signature information being maliciously modified or removed.

[0013] Regarding the beneficial effects of the artificial intelligence-generated multimodal content processing device, system, electronic device, storage medium, and program product, they correspond to the beneficial effects of the artificial intelligence-generated multimodal content processing method, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the specific embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present disclosure. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0015] Figure 1 is an interaction diagram of a method for processing artificial intelligence-generated multimodal content according to an embodiment of the present disclosure; Figure 2 is a flowchart of a first method for processing artificial intelligence-generated multimodal content according to an embodiment of the present disclosure; Figure 3 is a flowchart of a second method for processing artificial intelligence-generated multimodal content according to an embodiment of the present disclosure; Figure 4 is a flowchart of a third method for processing artificial intelligence-generated multimodal content according to an embodiment of the present disclosure; Figure 5 is an interaction diagram of another method for processing artificial intelligence-generated multimodal content according to an embodiment of the present disclosure; Figure 6 is a timing interaction diagram of media content uploading according to an embodiment of the present disclosure; Figure 7 is a timing interaction diagram of media content generation according to an embodiment of the present disclosure; Figure 8 is a flowchart of a fourth method for processing artificial intelligence-generated multimodal content according to an embodiment of the present disclosure; Figure 9 is a timing interaction diagram of media content access according to an embodiment of the present disclosure; Figure 10 is a flowchart of a fifth method for processing artificial intelligence-generated multimodal content according to an embodiment of the present disclosure; Figure 11 is a timing interaction diagram of media content verification according to an embodiment of the present disclosure; Figure 12 is a structural block diagram of an artificial intelligence-generated multimodal content processing device according to an embodiment of the present disclosure; Figure 13It is a block diagram of another artificial intelligence-generated multimodal content processing device according to an embodiment of the present disclosure; Figure 14 It is a block diagram of an artificial intelligence-generated multimodal content processing system according to an embodiment of the present disclosure; Figure 15 It is a block diagram of another artificial intelligence-generated multimodal content processing system according to an embodiment of the present disclosure; Figure 16 It is a block diagram of a signature service platform according to an embodiment of the present disclosure; Figure 17 It is a block diagram of an electronic device according to an embodiment of the present disclosure. Detailed implementation manners

[0016] To make the objectives, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Apparently, the described embodiments are some but not all of the embodiments of the present disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of the present disclosure without creative efforts shall fall within the protection scope of the present disclosure.

[0017] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, usage scopes, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0018] For example, when receiving a user's active request, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0019] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving a user's active request may be, for example, in the form of a pop-up window, and the prompt message may be presented in text in the pop-up window. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0020] It can be understood that the above process of notifying and obtaining the user's authorization is only illustrative and does not limit the implementation manner of the present disclosure, and other manners that meet relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0021] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of data) should comply with the requirements of corresponding laws, regulations and related provisions.

[0022] With the development of Artificial Intelligence (AI), applications related to Artificial Intelligence Generative Content (AIGC) have flourished. Among them, there is a wide variety of Artificial Intelligence Generative Content. Currently, some common Artificial Intelligence Generative Content includes text, images, videos, audio, and design materials, etc.

[0023] Text: Text is the most basic Artificial Intelligence Generative Content. Artificial Intelligence can have real-time conversations with users through text and generate text, poems, stories, and even computer code in different styles.

[0024] Images: Various types of pictures can be generated through text or pictures. The generated images can assist users in painting design and diverging imagination. Among them, the tools for generating images can be roughly divided into two categories: image self-generation tools and image editing tools.

[0025] Videos: A video with coherent plot can be generated through text description. For example, advertising videos, movie trailers, teaching videos, music videos, etc. It can also be used as a video editing tool.

[0026] Audio: Realistic sound effects can be generated. For example, voice cloning, speech synthesis, music generation, sound effects, generating specific sounds from text, etc.

[0027] Design materials: Artificial Intelligence can be used to assist in completing special effects design, character design, original art design, game animation, 3D models, map editors, etc. for games.

[0028] With the development of technology, the types and scope of Artificial Intelligence Generative Content are still expanding. Therefore, there is an urgent need for a method to verify Artificial Intelligence Generative Content.

[0029] In view of this, according to an embodiment of the present disclosure, an embodiment of a method for processing multi-modal content generated by artificial intelligence is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. And although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0030] In this embodiment, a first method for processing multi-modal content generated by artificial intelligence is provided, which can be used in a content management platform. Among them, the content management platform provides a content upload service and a content generation service. Users can directly upload media content through the content management platform or use artificial intelligence technologies such as generation models to generate multi-modal media content. For example, Figure 1 As shown, the content management platform can also be connected to a content dissemination platform. Users can upload media content through the content dissemination platform, and then the content dissemination platform sends the uploaded media content to the content management platform for management. Or, users input the prompt information of the media content to be generated through the content dissemination platform, and the content dissemination platform sends the prompt information to the content management platform to generate media content. Or, the content dissemination platform generates media content according to the prompt information and then uploads the media content to the content management platform for management. In addition, the content dissemination platform can also download and view media content from the content management platform. At the same time, the content management platform is also communicatively connected to a signature service platform. The content management platform can send the managed media content and related data (such as the generation method of the media content, access information, etc.) to the signature service platform, and the signature service platform digitally signs and archives the data sent by the content management platform.

[0031] Figure 2 FIG. is a schematic flowchart of a first method for processing multi-modal content generated by artificial intelligence according to an embodiment of the present disclosure. As shown in Figure 2 shown, the process of the method for processing multi-modal content generated by artificial intelligence provided in this embodiment includes the following steps: Step S201, obtain first media content of at least one modality and the generation method of the first media content. The first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0032] Specifically, the content management platform is configured with a content upload service and a content recognition service. Users or the content dissemination platform can upload media content to the content management platform through the content upload service. Then, the content recognition service identifies the generation method of the uploaded media content, mainly identifying the media content that conforms to artificial intelligence generation. Among them, the generation methods mainly include artificial intelligence generation, suspected artificial intelligence generation, and non-artificial intelligence generation, so as to determine whether the first media content is generated by artificial intelligence.

[0033] Specifically, the content management platform is also configured with a content generation service, which is used to generate media content in at least one modality through artificial intelligence technology. Users or content dissemination platforms can send prompt information for generating media content to the content management platform. The content management platform uses the content generation service to generate media content locally and records the generation method of the media content as being generated by artificial intelligence.

[0034] Optionally, the first media content includes at least one modality of media content such as text, images, videos, audio, and design materials. In addition, it can also include other modalities of media content, which are not limited here.

[0035] Step S202: Send the first media content and the generation method to the signature service platform, which is used to digitally sign the first media content and the generation method to obtain the first signature information.

[0036] Specifically, the content management platform is configured with a Software Development Kit (SDK). The content management platform calls the software development kit to send the first media content and the generation method to the signature service platform.

[0037] Specifically, the signature service platform is configured with a data signature service and an evidence storage service based on cloud computing. The signature service platform uses the data signature service to digitally sign the first media content and the generation method to obtain the first signature information. And it uses the evidence storage service to store the first signature information for subsequent authenticity verification of the media content to be checked by users or content dissemination platforms through the evidence storage service, that is, to verify whether the media content is generated by artificial intelligence.

[0038] Step S203: Obtain the first signature information returned by the signature service platform.

[0039] Specifically, after the signature service platform completes the storage of the first signature information, it returns the first signature information to the content management platform.

[0040] Step S204: Based on the modality of the first media content, add the first signature information to the first media content to obtain the second media content.

[0041] Specifically, the content management platform receives the first signature information returned by the signature service platform through the software development kit. The software development kit adds the first signature information to the first media content based on the modality of the first media content to obtain the second media content.

[0042] Specifically, the software development kit adds the first signature information to the metadata of the first media content based on the modality of the first media content to obtain the second media content. The first signature information is used to verify the generation method of the second media content.

[0043] In the multimodal content processing method provided in this embodiment, the content management platform sends the first media content and the generation method of the first media content to the signature service platform, so that the signature service platform performs digital signature on the first media content and the generation method, and adds the first signature information returned by the signature service platform to the first media content to obtain the second media content. Therefore, subsequently, the generation method of the second media content can be verified through the first signature information in the second media content, so as to facilitate verifying whether the second media content is AI-generated content. At the same time, since the data structures of media content in different modalities are different, adding the first signature information to the first media content based on the modality of the first media content can not only avoid the addition of the first signature information affecting the use of the media content, but also facilitate accurately and quickly extracting the first signature information in the second media content when verifying the second media content subsequently, so as to effectively verify the generation method of the second media content. Moreover, there are differences in the security of the information storage locations of media content in different modalities. Adding the first signature information based on the modality can also enhance the security of the first signature information to a certain extent and reduce the risk of the first signature information being maliciously modified or removed.

[0044] In some optional implementation manners, the above step S201 includes: Step a1, in response to a content upload request, provide a content upload service to the requester of the content upload request.

[0045] Specifically, the content management platform includes one or more business platforms related to media content. For example, it includes a creation platform, a publishing platform, a download platform, a verification platform, etc. of media content.

[0046] The content upload request in the above step a1 can be initiated by the client of the content management platform (i.e., the client of the business platform), or by the client of a third-party content dissemination platform. The client remotely invokes the content upload service of the content management platform to upload media content.

[0047] Furthermore, the content management platform is configured with an information review service, and the above-mentioned content upload request carries the user's identity information, such as an account number, etc. When receiving the content upload request, the content management platform calls the information review service to authenticate the user's identity information. If the identity authentication is successful, the first login information is generated and fed back to the requester of the content upload request. The requester of the content upload request sends the first login information and the first media content to be uploaded (such as audio, video, picture, document, etc.) to the content management platform.

[0048] Optionally, the content upload service includes at least one mode of upload service. For example, a video upload service, a picture upload service, and an audio upload service. Therefore, targeted upload services can be deployed according to the upload requirements of media content of different modes to improve the security and efficiency of data upload.

[0049] Step a2: receiving first media content of at least one mode uploaded through a content upload service.

[0050] Specifically, the content management platform is further configured with a content management service, and the content management service receives the first login information sent by the requester of the content upload request and the uploaded first media content.

[0051] Step a3: calling a content identification service to identify the generation method of the first media content, and obtaining the generation method of the first media content.

[0052] Specifically, the content management service sends the first media content to the content recognition service, and the content recognition service identifies the generation method of the first media content and feeds back the identified first media content to the content management service.

[0053] The multimodal content processing method provided in this embodiment deploys the content upload service and the content identification service separately in the content management platform, so that the uploading of the first media content and the identification of the generation method of the first media content can be performed separately, preventing the competition of computing resources, thereby ensuring the efficiency of content uploading and the efficiency of generation method identification. At the same time, since the content upload service is usually exposed to the public network, isolating the content upload service from the content identification service can also reduce the risk of content identification data being exposed to a certain extent and improve data security.

[0054] In some other optional implementations, the above step S201 includes: Step b1: In response to a content generation request, obtaining prompt information for generating media content.

[0055] Specifically, the content generation request can be initiated by the client of the content management platform (i.e., the client of the business platform) in response to the prompt information input by the user, or can be initiated by the client of the third-party content dissemination platform in response to the prompt information input by the user.

[0056] Furthermore, before initiating the content generation request, the requester of the content generation request will first initiate a login request based on the user's identity information (such as an account, etc.). When the server of the content management platform receives the login request, it parses the login request to obtain the user's identity information and performs identity authentication on the identity information. If the identity authentication passes, the second login information is generated and fed back. The requester initiates the content generation request based on the second login information and the prompt information, and sends the content generation request to the content management platform.

[0057] Step b2, call the content generation service to process the prompt information, generate the first media content of at least one modality, and record the generation method of the first media content.

[0058] Specifically, the content generation service deploys artificial intelligence technologies, such as a generation model, etc. The content generation service uses artificial intelligence technologies to process the prompt information to obtain the first media content, and records the generation method of the first media content as being generated by artificial intelligence.

[0059] Optionally, the content upload service includes generation services of at least one modality. For example, video generation service, picture generation service, audio generation service, special effect generation service. Therefore, targeted generation services can be deployed according to the generation requirements of media content of different modalities, improving the generation quality of media content.

[0060] Furthermore, the prompt information includes the generation conditions and modality of the media content to be generated. The content management service in the content management platform calls the generation service corresponding to this modality to process the prompt information and generate the first media content.

[0061] The multi-modal content processing method provided in this embodiment separately deploys the content generation service in the content management platform for content generation requirements. Therefore, the security and reliability of content generation can be guaranteed.

[0062] In some alternative embodiments, the above step S204 includes: Step c1, obtain the preset location information, and the preset location information includes the addition locations corresponding to different modalities.

[0063] Specifically, the addition location of each modality is the metadata area in the media content of this modality for recording attribute information.

[0064] Step c2: Determine the target addition position based on the preset position information and the modality of the first media content.

[0065] For example, if the preset position information includes a first position corresponding to audio and a second position corresponding to video, then, when the first media content is audio data, determine that the target addition position of the first signature information in the first media content is the first position according to the preset position information.

[0066] Step c3: Add the first signature information at the target addition position of the first media content to obtain the second media content.

[0067] Specifically, the target addition position is the metadata area in the first media content for recording attribute information. Add a metadata block separately in this metadata area to add the first signature information to obtain the second media content.

[0068] The multimodal content processing method provided in this embodiment pre-configures the addition positions corresponding to each modality to obtain the preset position information. Then, in the subsequent process, according to the preset position information and the modality of the first media content to be managed, quickly determine the target addition position in the first media content for adding the first signature information. At the same time, it is also convenient to accurately and quickly extract the first signature information in the second media content when verifying the second media content later.

[0069] In some alternative embodiments, as Figure 3 shown, the multimodal content processing method for AI-generated content applicable to the content management platform in the present disclosure further includes: Step S301: Respond to an access request for the second media content and obtain access information.

[0070] Optionally, the access information includes the information of the requester of the access request.

[0071] Specifically, when a user views or downloads the second media content through the client of the content management platform or the client of the content dissemination platform, a login request will be initiated based on the user's identity information (such as an account, etc.). When the server of the content management platform receives the login request, it parses the login request to obtain the user's identity information and performs identity authentication on the identity information. If the identity authentication is passed, the third login information will be generated and fed back. Then, the client (i.e., the requestor of the access request) generates an access request based on the information of the media content to be accessed, the third login information, and the information of the affiliated platform, and sends the access request to the server of the content management platform. Among them, if the client belongs to the content dissemination platform, the information of the affiliated platform is the platform information of the content dissemination platform. If the client belongs to the content management platform, the information of the affiliated platform is the platform information of the affiliated business platform. The requestor information of the above access request includes at least one of the third login information and the information of the affiliated platform.

[0072] Step S302: Send the second media content and the access information to the signature service platform, and the signature service platform is also used to digitally sign the second media content and the access information to obtain the second signature information, and the second signature information is used to determine the dissemination status of the second media content.

[0073] Specifically, the content management platform calls the software development kit to send the second media content and the access information to the signature service platform.

[0074] Step S303: Obtain the second signature information returned by the signature service platform.

[0075] Specifically, the signature service platform uses the data signature service to digitally sign the second media content and the access information to obtain the second signature information. And uses the evidence preservation service to preserve the second signature information, so as to determine the dissemination status of the second media content through the evidence preservation service subsequently.

[0076] Step S304: Add the second signature information to the second media content based on the modality of the second media content, and feed back the second media content with the second signature information added to the requestor of the access request.

[0077] Specifically, the software development kit in the content management platform receives the second signature information returned by the signature service platform, and the software development kit adds the second signature information to the second media content based on the modality of the second media content to obtain the second media content with the second signature information added.

[0078] Furthermore, based on the preset position information and the modality of the second media content, determine the addition position of the second signature information; add the second signature information to the second media content based on the addition position of the second signature information to obtain the second media content with the second signature information added.

[0079] In the multimodal content processing method provided in this embodiment, the content management platform sends the second media content to be accessed and access information to the signature service platform for digital signature, adds the second signature information returned by the signature service platform to the second media content, and then feeds back the second media content with the second signature information added to the requester of the access request. Therefore, the dissemination of the second media content can be traced using the second signature information.

[0080] In this embodiment, a third artificial intelligence-generated multimodal content processing method is provided, which can be used in the signature service platform, such as Figure 4 shown, the signature service platform adopts cloud computing services, and the signature service platform is used to provide data signature services and evidence storage services to the content management platform. Figure 4 is a schematic flowchart of the third artificial intelligence-generated multimodal content processing method according to an embodiment of the present disclosure, such as Figure 4 shown, this process includes the following steps: Step S401, obtain at least one modality of the first media content sent by the content management platform and the generation method of the first media content. The first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to characterize whether the first media content is generated by artificial intelligence. For the relevant content of the above step S201, reference can be made, and details will not be elaborated here.

[0081] Step S402, perform digital signature on the first media content and the generation method to obtain the first signature information.

[0082] Specifically, the signature service platform performs a hash operation on the first media content and the generation method using the data signature service to obtain a first operation result, and performs digital signature on the first operation result based on the digital certificate of the first media content to obtain a first signature result. Further, the signature service platform is also configured with a trusted time stamp service, and the signature service platform uses the trusted time stamp service to add a time stamp to the first signature result to obtain the first signature information. Then, the evidence storage service is used to store the first signature information.

[0083] Step S403, feed back the first signature information to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain the second media content. For the relevant content of the above step S204, reference can be made, and details will not be elaborated here.

[0084] In the multimodal content processing method provided in this embodiment, the signature service platform performs digital signature on the first media content and the generation method sent by the content management platform. The content management platform is unaware of the digital signature process, which can, to a certain extent, prevent information used for digital signature (such as keys, digital certificates, etc.) from being leaked and ensure the reliability of the first signature information. Then, the content management platform adds the first signature information returned by the signature service platform to the first media content to obtain the second media content. Therefore, subsequently, the generation method of the second media content can be verified through the first signature information in the second media content, so as to verify whether the second media content is an AI-generated content.

[0085] As one specific embodiment, as Figure 5 shown, the overall process of the AI-generated multimodal content processing method of the present disclosure is as follows: The user logs in to the content management platform through the client of the content management platform or a third-party content dissemination platform. The content management platform uses the information review service to authenticate the user and the content dissemination platform. If the authentication is passed, content management services are allowed to be provided to the user or the content dissemination platform. The user or the content dissemination platform can upload the first media content through the content upload service, or generate the first media content through the content generation service. If the first media content is uploaded through the content upload service, the content management service in the content management platform sends the first media content to the content recognition service, and the content recognition service identifies the generation method of the first media content. If the first media content is generated through the content generation service, the generation method of the first media content is recorded as AI-generated. The content management service sends the first media content and its generation method to the data signature service of the signature service platform. The data signature service performs a hash operation on the first media content of different modalities and the generation method to obtain a first operation result, and uses a digital certificate to perform digital signature on the first operation result to obtain a first signature result. Then, the data signature service sends the first signature result to the trusted time stamp service. The trusted time stamp service is responsible for providing a tamper-proof trusted time stamp for the digital certificate, or a commercial trusted time stamp, to add a time stamp to the first signature result to obtain the first signature information. The data signature service sends the first signature information to the evidence storage service. The evidence storage service is responsible for local storage of the first signature information and reporting it to the authentication platform to provide public query or authentication capabilities.

[0086] In some alternative embodiments, the first media content is obtained by the content management platform providing a content upload service to the requester of the content upload request in response to the content upload request; and / or, the first media content is obtained by the content management platform obtaining prompt information in response to the content generation request and invoking the content generation service to process the prompt information. Among them, the method of obtaining the first media content from the content upload request can refer to the above steps a1 and a2. The method of obtaining the first media content from the content generation request can refer to the above steps b1 and b2, which will not be elaborated here.

[0087] Further, the above step S402 includes: Step d1, obtaining the regional information of the request sending area of the first media content, where the request sending area includes the sending area of the content upload request and / or the sending area of the content generation request.

[0088] It can be understood that if the first media content is obtained from the content upload request, the request sending area is the sending area of the content upload request. If the first media content is obtained from the content generation request, the request sending area is the sending area of the content generation request.

[0089] Step d2, determining the certificate source based on the regional information.

[0090] Specifically, pre-configure the certificate sources of different regions to obtain preset source information. Then, based on the regional information and the preset source information, determine the certificate source of the first media content.

[0091] For example, if the content upload request is initiated in Region 1, then use the certificate source of Region 1 as the certificate source for the first media content during the digital signature process.

[0092] Optionally, the certificate source includes at least one of a Certificate Authority (CA) and a Public Key Infrastructure (PKI) system, or other certificate sources that can provide certificates for digital signatures.

[0093] Step d3, obtaining a digital certificate from the certificate source.

[0094] Specifically, obtain the first login information of the requester of the content upload request, or obtain the second login information of the requester of the content generation request. Obtain the digital certificate from the certificate source based on the first login information or the second login information.

[0095] Step d4, performing a digital signature on the first media content and the generation method based on the digital certificate to obtain the first signature information.

[0096] Specifically, perform a hash operation on the first media content and its generation method to obtain a first operation result. Based on the digital certificate, perform a digital signature on the first operation result to obtain a first signature result. Add a time stamp to the first signature result to obtain a first signature message.

[0097] The multi-modal content processing method provided in this embodiment first determines the certificate source based on the regional information of the request sending area of the first media content, and then obtains the digital certificate from the certificate source to perform a digital signature on the first media content and its generation method. Therefore, it can ensure that the digital certificate meets the regional requirements, ensure the validity and credibility of the digital certificate, and at the same time, it can also improve the acquisition efficiency of the digital certificate.

[0098] As one specific embodiment, as Figure 6 shown, the main process of uploading media content by the artificial intelligence-generated multi-modal content processing method of the present disclosure includes: the user logs in to the content management platform through the client of the content management platform or the content dissemination platform, and the information review service authenticates the user's identity to generate a first login message. If the identity authentication is passed, the information review service feeds back the first login message to the client. The client sends the first login message and the first media content to the content management service. The content management service sends the received first media content to the content recognition service. The content recognition service recognizes the generation method of the first media content to obtain the generation method of the first media content, and feeds back the generation method of the first media content to the content management service. The content management service sends the first media content and its generation method to the data signature service. The data signature service performs a hash operation on the first media content and its generation method to obtain a first operation result, and performs a digital signature on the first operation result based on the digital certificate to obtain a first signature result. The data signature service sends the first signature result to the trusted time stamp service. The trusted time stamp service adds a time stamp to the first signature result to obtain a first signature message, and feeds back the first signature message to the data signature service. The data signature service sends the first signature message to the evidence storage service. The evidence storage service stores the received first signature message and feeds back the completion of evidence storage to the data signature service. After the evidence storage is completed, the data signature service feeds back the first signature message to the content management service. The content management service adds the first signature message to the first media content and feeds back the successful upload to the client. At this time, the first media content is in an available state.

[0099] As one specific embodiment, as Figure 7As shown in the figure, the main process of the AI - generated multimodal content processing method of the present disclosure for generating media content includes: The user logs in to the content management platform through the client of the content management platform or the content dissemination platform. The information review service authenticates the user's identity and generates second login information. If the identity authentication is passed, the information review service feeds back the second login information to the client. The client sends the second login information and the prompt information for generating media content to the content management service. The content management service calls the content generation service to process the prompt information, generates the first media content, and obtains the generation method of the first media content through the content recognition service. The content management service sends the first media content and the generation method to the data signature service. The data signature service performs a hash operation on the first media content and its generation method to obtain a first operation result, and digitally signs the first operation result based on a digital certificate to obtain a first signature result. The data signature service sends the first signature result to the trusted time - stamp service. The trusted time - stamp service adds a time - stamp to the first signature result to obtain a first signature message, and feeds back the first signature message to the data signature service. The data signature service sends the first signature message to the archiving service. The archiving service archives the received first signature message and feeds back the completion of archiving to the data signature service. After the archiving is completed, the data signature service feeds back the first signature message to the content management service. The content management service adds the first signature message to the first media content and feeds back the successful generation of the content to the client. At this time, the first media content is in an available state.

[0100] In some optional embodiments, as Figure 8 shown, the AI - generated multimodal content processing method of the present disclosure for the signature service platform further includes: Step S801: Obtain the second media content and access information sent by the content management platform. The access information is obtained by the content management platform in response to an access request for the second media content. Refer to the above steps S301 and S302, and details will not be elaborated here.

[0101] Step S802: Digitally sign the second media content and the access information to obtain a second signature message, which is used to determine the dissemination situation of the second media content.

[0102] Specifically, the signature service platform uses the data signature service to perform a hash operation on the second media content and the access information to obtain a second operation result, and digitally signs the second operation result based on the digital certificate corresponding to the second media content to obtain a second signature result. Further, the signature service platform uses the trusted time - stamp service to add a time - stamp to the second signature result to obtain a second signature message. Then, the archiving service archives the second signature message.

[0103] Further, the digital certificate of the second media content is obtained in the following manner: obtaining the regional information of the sending area of the access request; determining the certificate source corresponding to the second media content based on the regional information of the access request; and obtaining the digital certificate from the certificate source corresponding to the second media content.

[0104] In addition, the digital certificate adopted by the first signature information corresponding to the second media content can also be directly used to digitally sign the second media content and the access information to obtain the second signature information.

[0105] Step S803: Return the second signature information to the content management platform; wherein, the content management platform is further configured to add the second signature information to the second media content based on the modality of the second media content, and feedback the second media content with the second signature information added to the requester corresponding to the access request. Reference can be made to the relevant content of step S304 above, and details will not be elaborated here.

[0106] In the multi-modal content processing method provided in this embodiment, the signature service platform digitally signs the second media content to be accessed and the access information, and feeds back the second signature information obtained by the digital signature to the content management platform, so that the content management platform adds the second signature information to the second media content and then feeds it back to the requester of the access request. Therefore, the dissemination of the second media content can be traced using the second signature information.

[0107] As one specific embodiment, such as Figure 9As shown in the figure, the main process of the artificial intelligence-generated multimodal content processing method of the present disclosure for accessing media content includes: The user logs in to the content management platform through the client of the content management platform or the content dissemination platform. The information review service authenticates the user's identity and generates third login information. If the identity authentication is passed, the information review service feeds back the third login information to the client. The client generates access information based on the third login information and the information of the affiliated platform, and generates an access request based on the access information and the information of the second media content to be accessed. Then, the access request is sent to the content management service. The content management service obtains the second media content, and sends the second media content and the access information to the data signature service. The data signature service performs a hash operation on the second media content and the access information to obtain a second operation result, and digitally signs the second operation result based on the digital certificate corresponding to the second media content to obtain a second signature result. The data signature service sends the second signature result to the trusted time stamp service. The trusted time stamp service adds a time stamp to the second signature result to obtain second signature information. The trusted time stamp service feeds back the second signature information to the data signature service. The data signature service sends the second signature information to the evidence storage service. The evidence storage service stores the second signature information, and then feeds back to the data signature service that the storage is completed. The data signature service feeds back the second signature information to the content management service. The content management service adds the second signature information to the second media content, and feeds back the second media content with the second signature information added to the client.

[0108] In some alternative embodiments, as Figure 10 shown, the artificial intelligence-generated multimodal content processing method of the present disclosure for the signature service platform further includes: Step S1001, in response to a verification request for the target media content, obtain the target media content and extract the signature information in the target media content.

[0109] Among them, the target media content is the first media content, the second media content or other media content.

[0110] Specifically, the signature service platform provides a public authentication interface and an authentication page for users, content dissemination platforms, and third-party platforms to upload the target media content to be verified to the evidence storage service.

[0111] Furthermore, the verification request may carry the identification information of the target media content. If the target media content is the second media content, the evidence storage service can obtain the addition position of the first signature information or the second signature information according to the identification information, and extract the signature information in the target media content according to the addition position. Alternatively, the evidence storage service obtains the preset position information, determines the addition position of the signature information according to the preset position information and the modality of the target media content, and extracts the signature information in the target media content according to the addition position.

[0112] Step S1002: Based on the signature information in the target media content and the locally stored signature information, verify the target media content to obtain a verification result. The locally stored signature information includes the first signature information.

[0113] Optionally, the signature information locally stored by the signature service platform further includes the second signature information.

[0114] Specifically, based on the matching situation between the target media content and the locally stored media content (such as the first media content), determine the adapted first signature information from the locally stored signature information. Based on the signature information in the target media content and the adapted first signature information, verify the target media content to obtain a verification result. Among them, if the target media content is successfully verified, the verification result includes the generation method of the target media content. In addition, if the target media content has been accessed, the verification result also includes the access information of the target media content. If the target media content fails to be verified, the verification result includes the information indicating the failure of the target media content verification.

[0115] Step S1003: Feed back the verification result to the requester of the verification request.

[0116] Specifically, the requester of the verification request can determine the generation method of the target media content according to the verification result. For example, artificial intelligence generation, suspected artificial intelligence generation, non-artificial intelligence generation, etc. In addition, if the verification result also includes the access information, the propagation situation of the target media content can also be traced according to the access information.

[0117] In the multimodal content processing method provided in this embodiment, the signature service platform locally stores the first signature information generated based on the first media content and its generation method. Therefore, when the signature service platform receives the target media content that needs to be verified, it can verify the target media content through the locally stored signature information and the signature information in the target media content to determine the generation method of the target media content, and then can distinguish whether the target media content is generated by artificial intelligence.

[0118] As one specific embodiment, as Figure 11 shown, the main process of the multimodal content processing method for artificial intelligence-generated content in this disclosure to check the media content includes: The content dissemination platform, the content management platform or other platforms send the target media content to be verified to the evidence storage service of the signature service platform. The evidence storage service verifies the target media content based on the signature information in the target media content and the locally stored signature information, and obtains and feeds back the verification result.

[0119] As a specific application example, the content management platform includes one or more business platforms, and at the same time, is also connected to a third-party content dissemination platform. Users can upload or generate first media content through the client of the business platform or the client of the content dissemination platform. The content management platform and the signature service platform execute the multi-modal content processing method generated by artificial intelligence of the present disclosure to add first signature information to the first media content to obtain second media content. When other users download and view the second media content through the client of the business platform or the client of the content dissemination platform, the content management platform and the signature service platform execute the multi-modal content processing method generated by artificial intelligence of the present disclosure to further add second signature information to the second media content. If other users need to check a certain media content, the media content to be checked is sent to the signature service platform. The signature service platform uses the multi-modal content processing method generated by artificial intelligence of the present disclosure to verify the media content to be checked and feedback the verification result, so that users can determine whether the media content to be checked is generated by artificial intelligence and the dissemination situation of the media content according to the verification result.

[0120] In this embodiment, a multi-modal content processing device generated by artificial intelligence is also provided. This device is used to implement the above embodiments and preferred implementation manners, and those that have been described will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0121] This embodiment provides a multi-modal content processing device generated by artificial intelligence, which is applicable to a content management platform, such as Figure 12 shown, including: A first acquisition module 1201, configured to acquire first media content of at least one modality and the generation method of the first media content. The first media content includes uploaded media content and / or locally generated media content; the generation method is used to represent whether the first media content is generated by artificial intelligence; A first sending module 1202, configured to send the first media content and the generation method to a signature service platform, and the signature service platform is configured to perform digital signature on the first media content and the generation method to obtain first signature information; A second acquisition module 1203, configured to acquire the first signature information returned by the signature service platform; A first processing module 1204, configured to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

[0122] In some optional implementation manners, the first acquisition module 1201 includes: A first response unit, configured to provide a content upload service to the requester of the content upload request in response to the content upload request; A content receiving unit, configured to receive at least one modality of first media content uploaded through the content upload service; A content recognition unit, configured to call a content recognition service to recognize the generation method of the first media content, and obtain the generation method of the first media content.

[0123] In some optional embodiments, the first acquisition module 1201 includes: A second response unit, configured to obtain prompt information for generating media content in response to the content generation request; A content generation unit, configured to call a content generation service to process the prompt information, generate at least one modality of first media content, and record the generation method of the first media content.

[0124] In some optional embodiments, the first processing module 1204 includes: A location information acquisition unit, configured to acquire preset location information, where the preset location information includes the addition locations corresponding to different modalities; A first processing unit, configured to determine a target addition location based on the preset location information and the modality of the first media content; A second processing unit, configured to add first signature information to the target addition location of the first media content to obtain second media content.

[0125] In some optional embodiments, the multi-modal content processing device generated by artificial intelligence of the present disclosure further includes: A third acquisition module, configured to acquire access information in response to an access request for the second media content; A second sending module, configured to send the second media content and the access information to a signature service platform, where the signature service platform is further configured to perform digital signature on the second media content and the access information to obtain second signature information, and the second signature information is used to determine the dissemination situation of the second media content; A fourth acquisition module, configured to acquire the second signature information returned by the signature service platform; A second processing module, configured to add the second signature information to the second media content based on the modality of the second media content, and feedback the second media content with the second signature information added to the requester of the access request.

[0126] The further function descriptions of the above-mentioned respective modules and units are the same as those in the corresponding embodiments above, and will not be repeated here.

[0127] The multi-modal content processing device generated by artificial intelligence in this embodiment is presented in the form of functional units. Here, the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and a memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.

[0128] In this embodiment, another multi-modal content processing device generated by artificial intelligence is also provided. This device is used to implement the above embodiments and preferred implementation manners, and those that have been described will not be repeated. As used hereinafter, the term "module" can be a combination of software and / or hardware that can achieve a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0129] This embodiment provides another multi-modal content processing device generated by artificial intelligence, which is applicable to a signature service platform, such as Figure 13 shown, including: A first receiving module 1301, configured to obtain at least one modality of first media content sent by a content management platform and the generation method of the first media content. The first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to represent whether the first media content is generated by artificial intelligence; A first signature module 1302, configured to perform a digital signature on the first media content and the generation method to obtain first signature information; A first feedback module 1303, configured to feedback the first signature information to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

[0130] In some optional implementation manners, the first media content is obtained by the content management platform providing a content upload service to the requester of the content upload request in response to the content upload request; and / or, the first media content is obtained by the content management platform obtaining prompt information in response to the content generation request and invoking the content generation service to process the prompt information. The first signature module 1302 includes: A region information acquisition unit, configured to acquire the region information of the request sending region of the first media content, and the request sending region includes the sending region of the content upload request and / or the sending region of the content generation request; A source determination unit, configured to determine the certificate source based on the region information; A certificate acquisition unit, configured to acquire a digital certificate from the certificate source; A digital signature unit for digitally signing the first media content and the generation method based on a digital certificate to obtain first signature information.

[0131] In some optional embodiments, the multi-modal content processing device generated by artificial intelligence according to the present disclosure further includes: A second receiving module for obtaining the second media content and access information sent by the content management platform, where the access information is obtained by the content management platform in response to an access request for the second media content; A second signature module for digitally signing the second media content and the access information to obtain second signature information, where the second signature information is used to determine the dissemination situation of the second media content; A second feedback module for returning the second signature information to the content management platform; wherein, the content management platform is further configured to add the second signature information to the second media content based on the modality of the second media content, and feedback the second media content with the second signature information added to the requester corresponding to the access request.

[0132] In some optional embodiments, the multi-modal content processing device generated by artificial intelligence according to the present disclosure further includes: A third receiving module for obtaining the target media content and extracting the signature information in the target media content in response to a verification request for the target media content; A data verification module for verifying the target media content based on the signature information in the target media content and the locally stored signature information to obtain a verification result, where the locally stored signature information includes the first signature information; A third feedback module for feeding back the verification result to the requester of the verification request.

[0133] The further function descriptions of the above-mentioned various modules and units are the same as those in the corresponding embodiments above, and will not be repeated here.

[0134] The multi-modal content processing device generated by artificial intelligence in this embodiment is presented in the form of functional units. Here, the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and a memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.

[0135] The present disclosure embodiment also provides an artificial intelligence generated multi-modal content processing system, as Figure 14As shown, the system includes a content management platform and a signature service platform. The content management platform is used to execute any of the above-described artificial intelligence-generated multimodal content processing methods applicable to the content management platform. The signature service platform is communicatively connected to the content management platform, and the signature service platform is used to execute any of the above-described artificial intelligence-generated multimodal content processing methods applicable to the signature service platform.

[0136] Specifically, the content management platform is configured with a content upload service and a content recognition service. The client of the content management platform or the content dissemination platform can call the content upload service through a remote marking port and upload the first media content to the content management platform in a load balancing manner. The content recognition service identifies the generation method of the first media content. Optionally, as Figure 15 shown, the content upload service includes at least one of a video upload service, a picture upload service, and an audio upload service.

[0137] Specifically, the content management platform is further configured with a content generation service. The client of the content management platform or the content dissemination platform can upload the prompt information for generating media content to the content management platform through a remote marking port in a load balancing manner. The content generation service processes the prompt information to obtain the first media content and records the generation method of the first media content. Optionally, as Figure 15 shown, the content generation service includes at least one of a video generation service, a picture generation service, an audio generation service, and a special effect generation service.

[0138] Specifically, the content management platform is further configured with a content risk control service, which is used to perform risk control on the first media content uploaded by the content upload service and the first media content generated by the content generation service.

[0139] Furthermore, the content management platform is further configured with a content management service, which is used to perform collaborative management on the content upload service, the content generation service, the content recognition service, etc. For detailed content, please refer to the relevant content of the above artificial intelligence-generated multimodal content processing method, and no more details will be elaborated here.

[0140] Optionally, the content management platform further includes one or more business platforms related to media content. For example, Business Platform 1, Business Platform 2, and Business Platform 3. Each business platform is configured with a content upload service and a content generation service, and a software development kit is deployed for data communication between the software development kit and the signature service platform.

[0141] Specifically, as Figure 16 shown, the signature service platform includes a platform control plane and a data plane.

[0142] Optionally, the platform control plane includes an access approval service, a fusion certificate management service, a permissions management service, a usage management service, a trusted time stamp service, a fusion audit service, and an evidence storage service. Among them, the access approval service is used to approve the business platforms accessing the signature service platform. The permissions management service is used to authenticate external access permissions. The fusion certificate management service is connected to the certificate authority center and the public key infrastructure system for managing digital certificates. The usage management service is used to manage the usage of digital signatures. The trusted time stamp service is used to provide a tamper-proof trusted time stamp for digital certificates or a commercial trusted time stamp. The fusion audit service and the evidence storage service are connected to the blockchain, the audit system, and the authentication platform for auditing and storing signature information.

[0143] Optionally, the data plane is connected to the business platform to obtain information related to digital signatures. For example, business information (such as login information), platform information, etc. The data plane includes a cloud signature server and a hardware computing power cluster. Among them, the cloud signature server pulls digital certificates and trusted time stamps from the platform control plane. The fusion certificate management service issues the private key to the hardware computing power cluster, and the cloud signature server schedules the hardware computing power cluster to digitally sign the data sent by the content management platform to provide a data signature service.

[0144] Embodiments of the present disclosure also provide an electronic device. Please refer to Figure 17 , Figure 17 is a structural block diagram of an electronic device provided by an optional embodiment of the present disclosure. As shown in Figure 17 , the electronic device includes one or more processors 1701, a memory 1702, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. Each component communicates with each other using different buses and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed within the electronic device, including instructions stored in the memory or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (such as a server array, a set of blade servers, or a multi-processor system). Figure 17 In

[0145] The processor 1701 can be a central processing unit, a network processor, or a combination thereof. Among them, the processor 1701 can further include a hardware chip. The above-mentioned hardware chip can be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The above-mentioned programmable logic device can be a complex programmable logic device, a field-programmable gate array, a generic array logic, or any combination thereof.

[0146] Among them, the memory 1702 stores instructions executable by at least one processor 1701, so that at least one processor 1701 executes the method shown in the above embodiments.

[0147] The memory 1702 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the electronic device, etc. In addition, the memory 1702 can include a high-speed random access memory, and can also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 1702 can optionally include a memory remotely set relative to the processor 1701, and these remote memories can be connected to the electronic device through a network. Examples of the above-mentioned network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0148] The memory 1702 can include a volatile memory, such as a random access memory; the memory can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid-state drive; the memory 1702 can also include a combination of the above types of memories.

[0149] The electronic device further includes a communication interface 1703 for the electronic device to communicate with other devices or communication networks.

[0150] Embodiments of the present disclosure also provide a computer-readable storage medium. The methods according to the embodiments of the present disclosure can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented as computer code that is originally stored in a remote storage medium or a non-transitory machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the methods described herein can be processed by such software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, the processor, or the hardware, the artificial intelligence-generated multimodal content processing method shown in the above embodiments is implemented.

[0151] A part of the present disclosure can be applied as a computer program product, for example, computer program instructions. When executed by a computer, through the operation of the computer, the methods and / or technical solutions according to the present disclosure can be invoked or provided. Those skilled in the art should be able to understand that the forms in which computer program instructions exist in a computer-readable medium include, but are not limited to, source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Herein, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible to the computer.

[0152] Although the embodiments of the present disclosure have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present disclosure, and such modifications and variations all fall within the scope defined by the appended claims.

Claims

1. An artificial intelligence-generated multimodal content processing method, characterized in that, Applicable to a content management platform, the method includes: Obtain first media content of at least one modality and the generation method of the first media content, where the first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence; Send the first media content and the generation method to a signature service platform, where the signature service platform is used to digitally sign the first media content and the generation method to obtain first signature information; Obtain the first signature information returned by the signature service platform; Based on the modality of the first media content, add the first signature information to the first media content to obtain second media content.

2. The method according to claim 1, wherein The obtaining of the first media content of at least one modality and the generation method of the first media content includes: In response to a content upload request, provide a content upload service to the requester of the content upload request; Receive the first media content of at least one modality uploaded through the content upload service; Invoke a content recognition service to identify the generation method of the first media content to obtain the generation method of the first media content.

3. The method according to claim 1, characterized in that, The obtaining of the first media content of at least one modality and the generation method of the first media content includes: In response to a content generation request, obtain prompt information for generating media content; Invoke a content generation service to process the prompt information, generate the first media content of at least one modality, and record the generation method of the first media content.

4. The method according to claim 1, wherein The adding of the first signature information to the first media content based on the modality of the first media content to obtain second media content includes: Obtain preset location information, where the preset location information includes adding positions corresponding to different modalities; Based on the preset location information and the modality of the first media content, determine a target adding position; Add the first signature information at the target adding position of the first media content to obtain the second media content.

5. The method according to claim 1, characterized in that The method further includes: In response to an access request for the second media content, obtain access information; Send the second media content and the access information to the signature service platform, where the signature service platform is further used to digitally sign the second media content and the access information to obtain second signature information, and the second signature information is used to determine the dissemination situation of the second media content; Obtain the second signature information returned by the signature service platform; Based on the modality of the second media content, add the second signature information to the second media content, and feed back the second media content after adding the second signature information to the requester of the access request.

6. An artificial intelligence-generated multimodal content processing method, characterized in that, Applicable to a signature service platform, the method includes: Obtain the first media content of at least one modality sent by the content management platform and the generation method of the first media content. The first media content includes the media content uploaded to the content management platform and / or the media content generated by the content management platform; the generation method is used to characterize whether the first media content is generated by artificial intelligence; Perform a digital signature on the first media content and the generation method to obtain first signature information; Feed back the first signature information to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

7. The method according to claim 6, wherein The first media content is obtained by the content management platform providing a content upload service to the requester of the content upload request in response to the content upload request; and / or, the first media content is obtained by the content management platform obtaining prompt information in response to the content generation request and invoking the content generation service to process the prompt information; The performing a digital signature on the first media content and the generation method to obtain first signature information includes: Obtain the regional information of the request sending area of the first media content, and the request sending area includes the sending area of the content upload request and / or the sending area of the content generation request; Determine the certificate source based on the regional information; Obtain a digital certificate from the certificate source; Perform a digital signature on the first media content and the generation method based on the digital certificate to obtain the first signature information.

8. The method according to claim 6, wherein The method further includes: Obtain the second media content sent by the content management platform and the access information, and the access information is obtained by the content management platform in response to an access request for the second media content; Perform a digital signature on the second media content and the access information to obtain second signature information; Return the second signature information to the content management platform; wherein, the content management platform is further used to add the second signature information to the second media content based on the modality of the second media content and feed back the second media content after adding the second signature information to the requester corresponding to the access request.

9. The method according to claim 6, wherein The method further includes: In response to a verification request for the target media content, obtain the target media content and extract the signature information in the target media content; Based on the signature information in the target media content and the locally stored signature information, perform a verification on the target media content to obtain a verification result, and the locally stored signature information includes the first signature information; Feed back the verification result to the requester of the verification request.

10. An artificial intelligence-generated multimodal content processing device, characterized in that, Applicable to a content management platform, the device includes: A first acquisition module, configured to acquire the first media content of at least one modality and the generation method of the first media content. The first media content includes the uploaded media content and / or the locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence; A first sending module, configured to send the first media content and the generation method to a signature service platform, where the signature service platform is configured to perform digital signature on the first media content and the generation method to obtain first signature information; A second obtaining module, configured to obtain the first signature information returned by the signature service platform; A first processing module, configured to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

11. An artificial intelligence-generated multimodal content processing device, characterized in that, Applicable to a signature service platform, the apparatus includes: A first receiving module, configured to obtain at least one modality of first media content and the generation method of the first media content sent by a content management platform, where the first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to represent whether the first media content is generated by artificial intelligence; A first signature module, configured to perform digital signature on the first media content and the generation method to obtain first signature information; A first feedback module, configured to feedback the first signature information to the content management platform; wherein, the content management platform is configured to add the first signature information to the first media content based on the modality of the first media content to obtain second media content.

12. An artificial intelligence-generated multimodal content processing system, characterized in that, The system includes: A content management platform, configured to execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 1 to 5; A signature service platform, communicatively connected to the content management platform, where the signature service platform is configured to execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 6 to 9.

13. An electronic device, characterized in that, Including: A memory and a processor, communicatively connected to each other between the memory and the processor, where computer instructions are stored in the memory, and the processor executes the computer instructions to execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 1 to 5, or execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 6 to 9.

14. A computer-readable storage medium, characterized in that, Computer instructions are stored on the computer-readable storage medium, and the computer instructions are used to cause a computer to execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 1 to 5, or execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 6 to 9.

15. A computer program product, characterized in that, Including computer instructions, the computer instructions are used to cause a computer to execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 1 to 5, or execute the method for processing multi-modal content generated by artificial intelligence according to any one of claims 6 to 9.

Images