Methods, apparatus, systems and equipment for processing multimodal content generated by artificial intelligence

Abstract

This disclosure relates to the fields of computer technology, large-scale model technology, large language model technology, and artificial intelligence technology, specifically to a method, apparatus, system, and device for processing multimodal content generated by artificial intelligence. The method includes: a content management platform acquiring first media content of at least one modality and its generation method; the first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content was generated by artificial intelligence. The content management platform sends the first media content and the generation method to a signature service platform. The signature service platform digitally signs the first media content and the generation method to obtain first signature information. The content management platform obtains the first signature information returned by the signature service platform and, based on the modality of the first media content, adds the first signature information to the first media content to obtain second media content. This disclosure can solve the verification problem of artificial intelligence-generated content.

Description

Technical Field

[0001] This disclosure relates to the fields of computer technology, large model technology, large language model technology, and artificial intelligence technology, specifically to methods, apparatus, systems, and equipment for processing multimodal content generated by artificial intelligence. Background Technology

[0002] With the development of Artificial Intelligence (AI), applications related to AI-generated content (AIGC) are booming. AIGC encompasses a wide variety of content, including text, images, videos, audio, and design materials, and its types and scope continue to expand with technological advancements. Therefore, a method for validating AI-generated content is urgently needed. Summary of the Invention

[0003] In view of this, this disclosure provides a method, apparatus, system, device, medium, and program product for processing multimodal content generated by artificial intelligence, in order to solve the problem of verifying artificial intelligence-generated content.

[0004] In a first aspect, this disclosure provides a method for processing multimodal content generated by artificial intelligence, applicable to content management platforms, the method comprising:

[0005] The first media content in at least one modality and the generation method of the first media content are obtained, wherein the first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0006] The first media content and the generation method are sent to the signature service platform, which is used to digitally sign the first media content and the generation method to obtain the first signature information.

[0007] Obtain the first signature information returned by the signature service platform;

[0008] Based on the modality of the first media content, the first signature information is added to the first media content to obtain the second media content.

[0009] Secondly, this disclosure provides a method for processing multimodal content generated by artificial intelligence, applicable to signature service platforms, the method comprising:

[0010] The method acquires at least one modality of first media content sent by a content management platform and the generation method of the first media content, wherein the first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0011] Digitally sign the first media content and the generation method to obtain first signature information;

[0012] The first signature information is fed back to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain the second media content.

[0013] Thirdly, this disclosure provides an artificial intelligence-generated multimodal content processing apparatus, suitable for content management platforms, the apparatus comprising:

[0014] The first acquisition module is used to acquire at least one modality of first media content and the generation method of the first media content, wherein the first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0015] The first sending module is used to send the first media content and the generation method to the signature service platform, and the signature service platform is used to digitally sign the first media content and the generation method to obtain the first signature information.

[0016] The second acquisition module is used to acquire the first signature information returned by the signature service platform;

[0017] The first processing module is used to add the first signature information to the first media content based on the modality of the first media content, so as to obtain the second media content.

[0018] Fourthly, this disclosure provides an artificial intelligence-generated multimodal content processing apparatus, suitable for signature service platforms, the apparatus comprising:

[0019] The first receiving module is configured to acquire at least one modality of first media content sent by the content management platform and the generation method of the first media content. The first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform. The generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0020] The first signature module is used to digitally sign the first media content and the generation method to obtain first signature information;

[0021] The first feedback module is used to feed back the first signature information to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain the second media content.

[0022] Fifthly, this disclosure provides an artificial intelligence-generated multimodal content processing system, the system comprising:

[0023] A content management platform is used to execute the artificial intelligence-generated multimodal content processing method described in the first aspect above;

[0024] A signature service platform, which is communicatively connected to the content management platform, is used to execute the artificial intelligence-generated multimodal content processing method described in the second aspect above.

[0025] In a sixth aspect, this disclosure provides an electronic device, including: a memory and a processor, which are communicatively connected to each other. The memory stores computer instructions, and the processor executes the computer instructions to perform the artificial intelligence-generated multimodal content processing method of the first aspect or the artificial intelligence-generated multimodal content processing method of the second aspect.

[0026] In a seventh aspect, this disclosure provides a computer-readable storage medium storing computer instructions, which are used to cause a computer to perform the artificial intelligence-generated multimodal content processing method of the first aspect or the artificial intelligence-generated multimodal content processing method of the second aspect.

[0027] Eighthly, this disclosure provides a computer program product, including computer instructions for causing a computer to execute the artificial intelligence-generated multimodal content processing method of the first aspect above, or to execute the artificial intelligence-generated multimodal content processing method of the second aspect above.

[0028] The AI-generated multimodal content processing method provided in this disclosure involves a content management platform sending first media content and its generation method to a signature service platform. The signature service platform digitally signs the first media content and its generation method, and adds the first signature information returned by the platform to the first media content, resulting in second media content. Therefore, the generation method of the second media content can be verified using the first signature information, thus confirming whether the second media content is AI-generated. Furthermore, since the data structures of different modal media content differ, adding the first signature information to the first media content based on its modality not only avoids any impact on the use of the media content but also facilitates accurate and rapid extraction of the first signature information from the second media content during subsequent verification, effectively verifying its generation method. Moreover, the information storage locations of different modal media content differ in security; adding the first signature information based on its modality can enhance the security of the first signature information to some extent, reducing the risk of malicious modification or removal.

[0029] The beneficial effects of AI-generated multimodal content processing devices, systems, electronic devices, storage media, and program products correspond to the beneficial effects of AI-generated multimodal content processing methods, and will not be elaborated further here. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the specific embodiments of this disclosure or the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0031] Figure 1 This is an interactive schematic diagram of an artificial intelligence-generated multimodal content processing method according to an embodiment of the present disclosure;

[0032] Figure 2 This is a flowchart illustrating a first method for processing multimodal content generated by artificial intelligence according to an embodiment of the present disclosure;

[0033] Figure 3 This is a flowchart illustrating a second method for processing multimodal content generated by artificial intelligence according to an embodiment of the present disclosure;

[0034] Figure 4 This is a flowchart illustrating a third method for processing multimodal content generated by artificial intelligence according to an embodiment of this disclosure;

[0035] Figure 5 This is an interactive schematic diagram of another artificial intelligence-generated multimodal content processing method according to an embodiment of the present disclosure;

[0036] Figure 6 This is a schematic diagram of the timing interaction of media content uploading according to an embodiment of the present disclosure;

[0037] Figure 7 This is a schematic diagram of the timing interaction of media content generation according to an embodiment of the present disclosure;

[0038] Figure 8 This is a flowchart illustrating a fourth method for processing multimodal content generated by artificial intelligence according to an embodiment of this disclosure;

[0039] Figure 9 This is a schematic diagram of the timing interaction of media content access according to an embodiment of the present disclosure;

[0040] Figure 10 This is a flowchart illustrating a fifth method for processing multimodal content generated by artificial intelligence according to an embodiment of this disclosure;

[0041] Figure 11 This is a schematic diagram of the timing interaction of media content verification according to an embodiment of the present disclosure;

[0042] Figure 12 This is a structural block diagram of an artificial intelligence-generated multimodal content processing apparatus according to an embodiment of the present disclosure;

[0043] Figure 13 This is a structural block diagram of another artificial intelligence-generated multimodal content processing apparatus according to an embodiment of the present disclosure;

[0044] Figure 14 This is a structural block diagram of an artificial intelligence-generated multimodal content processing system according to an embodiment of the present disclosure;

[0045] Figure 15 This is a structural block diagram of another AI-generated multimodal content processing system according to an embodiment of the present disclosure;

[0046] Figure 16 This is a structural block diagram of a signature service platform according to an embodiment of the present disclosure;

[0047] Figure 17 This is a structural block diagram of an electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0048] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0049] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0050] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0051] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0052] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0053] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0054] With the development of Artificial Intelligence (AI), applications related to Artificial Intelligence Generative Content (AIGC) are booming. AIGC encompasses a wide variety of content. Currently, some common AIGC formats include text, images, videos, audio, and design materials.

[0055] Text: The most basic form of AI-generated content. AI can engage in real-time dialogue with users through text and generate text, poems, stories, and even computer code in different styles.

[0056] Images: Various types of images can be generated from text or pictures, and the generated images can assist users in drawing, design, and unleashing their imagination. Tools for generating images can be broadly divided into two categories: image self-generation tools and image editing tools.

[0057] Video: It can generate a coherent video based on text descriptions, such as commercials, movie trailers, instructional videos, music videos, etc. It can also be used as a video editing tool.

[0058] Audio: It can generate realistic sound effects, such as voice cloning, speech synthesis, music generation, sound effects, and text-to-speech generation.

[0059] Design resources: Artificial intelligence can be used to help complete game special effects design, character design, concept art design, game animation, 3D models, map editors, etc.

[0060] With the development of technology, the types and scope of AI-generated content are constantly expanding. Therefore, there is an urgent need for a method to verify AI-generated content.

[0061] In view of the above, according to the embodiments of this disclosure, an embodiment of a method for processing multimodal content generated by artificial intelligence is provided. It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowcharts, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0062] This embodiment provides a first method for processing multimodal content generated by artificial intelligence, which can be used in a content management platform. The content management platform provides content upload and content generation services, allowing users to directly upload media content or generate multimodal media content using artificial intelligence technologies such as generative models. Figure 1As shown, the content management platform can also connect to content distribution platforms. Users can upload media content through the content distribution platform, which then sends the uploaded content to the content management platform for management. Alternatively, users can input prompts for the media content to be generated through the content distribution platform, which then sends these prompts to the content management platform to generate the media content. Or, the content distribution platform can generate media content based on the prompts and then upload it to the content management platform for management. Furthermore, the content distribution platform can also download and view media content from the content management platform. Simultaneously, the content management platform also communicates with a signature service platform. The content management platform can send the managed media content and related data (such as the media content generation method and access information) to the signature service platform, which then digitally signs and stores the data sent by the content management platform.

[0063] Figure 2 This is a flowchart illustrating a first method for processing multimodal content generated by artificial intelligence according to an embodiment of this disclosure, as shown below. Figure 2 As shown, the process of the AI-generated multimodal content processing method provided in this embodiment includes the following steps:

[0064] Step S201: Obtain at least one modality of first media content and the generation method of the first media content. The first media content includes uploaded media content and / or locally generated media content. The generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0065] Specifically, the content management platform is equipped with content upload and content recognition services. Users or content distribution platforms can upload media content to the content management platform through the content upload service. Then, the content recognition service identifies the generation method of the uploaded media content, mainly identifying media content that conforms to artificial intelligence generation. The generation method mainly includes artificial intelligence generation, suspected artificial intelligence generation, and non-artificial intelligence generation, to determine whether the initial media content was generated by artificial intelligence.

[0066] Specifically, the content management platform is also equipped with a content generation service, which is used to generate media content in at least one modality through artificial intelligence technology. Users or content distribution platforms can send prompts for generating media content to the content management platform. The content management platform uses the content generation service to generate media content locally and records that the media content is generated by artificial intelligence.

[0067] Optionally, the first media content includes media content in at least one modality selected from text, images, video, audio, and design materials. In addition, it may include media content in other modalities, without limitation.

[0068] Step S202: The first media content and its generation method are sent to the signature service platform. The signature service platform is used to digitally sign the first media content and its generation method to obtain the first signature information.

[0069] Specifically, the content management platform is equipped with a software development kit (SDK). The content management platform calls the software development kit to send the primary media content and its generation method to the signature service platform.

[0070] Specifically, the signature service platform is equipped with cloud-based data signature and evidence storage services. The platform uses the data signature service to digitally sign the first media content and its generation method, obtaining the first signature information. It then uses the evidence storage service to store this first signature information, enabling subsequent verification of the authenticity of media content by users or content distribution platforms, i.e., verifying whether the media content was generated by artificial intelligence.

[0071] Step S203: Obtain the first signature information returned by the signature service platform.

[0072] Specifically, after the signature service platform completes the notarization of the first signature information, it returns the first signature information to the content management platform.

[0073] Step S204: Based on the modality of the first media content, add the first signature information to the first media content to obtain the second media content.

[0074] Specifically, the content management platform receives the first signature information returned by the signature service platform through a software development kit (SDK). Based on the modality of the first media content, the SSD adds the first signature information to the first media content to obtain the second media content.

[0075] Specifically, the software development kit adds the first signature information to the metadata of the first media content based on the modality of the first media content, thereby obtaining the second media content. The first signature information is used to verify the generation method of the second media content.

[0076] The multimodal content processing method provided in this embodiment involves a content management platform sending first media content and its generation method to a signature service platform. The signature service platform then digitally signs the first media content and its generation method, and adds the first signature information returned by the platform to the first media content, resulting in second media content. Therefore, the generation method of the second media content can be verified using the first signature information, facilitating the determination of whether the second media content is AI-generated. Furthermore, since the data structures of different modal media content differ, adding the first signature information to the first media content based on its modality not only avoids any impact on the use of the media content but also facilitates accurate and rapid extraction of the first signature information from the second media content during subsequent verification, effectively verifying its generation method. Moreover, the information storage locations of different modal media content differ in security; adding the first signature information based on its modality can enhance the security of the first signature information to some extent, reducing the risk of malicious modification or removal.

[0077] In some optional implementations, step S201 above includes:

[0078] Step a1: In response to the content upload request, provide the content upload service to the requester of the content upload request.

[0079] Specifically, a content management platform includes one or more business platforms related to media content, such as media content creation platforms, publishing platforms, download platforms, and verification platforms.

[0080] The content upload request in step a1 above can be initiated by the client of the content management platform (i.e., the client of the business platform) or by the client of a third-party content distribution platform. The client remotely calls the content upload service of the content management platform to upload media content.

[0081] Furthermore, the content management platform is equipped with an information verification service. The content upload request carries the user's identity information, such as their account. When the content management platform receives a content upload request, it invokes the information verification service to authenticate the user's identity. If the authentication is successful, it generates initial login information and sends it back to the requester of the content upload request. The requester then sends the initial login information and the initial media content to be uploaded (such as audio, video, images, documents, etc.) to the content management platform.

[0082] Optionally, the content upload service includes at least one modal upload service. For example, video upload service, image upload service, and audio upload service. Therefore, targeted upload services can be deployed to meet the upload needs of different modalities of media content, improving data upload security and efficiency.

[0083] Step a2: Receive first media content in at least one modality uploaded via the content upload service.

[0084] Specifically, the content management platform is also equipped with a content management service, which receives the first login information sent by the requester of the content upload request and the first media content uploaded.

[0085] Step a3: Call the content recognition service to identify the generation method of the first media content and obtain the generation method of the first media content.

[0086] Specifically, the content management service sends the first media content to the content recognition service, which identifies the generation method of the first media content and feeds back the identified first media content to the content management service.

[0087] The multimodal content processing method provided in this embodiment deploys content upload and content recognition services separately within the content management platform. This allows for the separate execution of uploading the first media content and identifying its generation method, preventing resource contention and ensuring both upload efficiency and generation method recognition efficiency. Furthermore, since content upload services are typically exposed to the public internet, isolating them from the content recognition service reduces the risk of content recognition data exposure and improves data security.

[0088] In some alternative embodiments, step S201 includes:

[0089] Step b1: In response to the content generation request, obtain prompt information for generating media content.

[0090] Specifically, a content generation request can be initiated by the client of the content management platform (i.e., the client of the business platform) in response to a prompt message entered by the user, or it can be initiated by the client of a third-party content distribution platform in response to a prompt message entered by the user.

[0091] Furthermore, before initiating the content generation request, the requester first initiates a login request based on the user's identity information (such as account information). When the content management platform's server receives the login request, it parses the request to obtain the user's identity information and performs identity authentication. If the authentication is successful, it generates and sends back second login information. The requester then initiates the content generation request based on the second login information and the prompt message, and sends the content generation request to the content management platform.

[0092] Step b2: Call the content generation service to process the prompt information, generate first media content in at least one modality, and record the generation method of the first media content.

[0093] Specifically, the content generation service is equipped with artificial intelligence technology, such as generation models. The content generation service uses artificial intelligence technology to process the prompt information, obtain the first media content, and record the generation method of the first media content as artificial intelligence generation.

[0094] Optionally, the content upload service includes at least one modality of generation service. For example, video generation service, image generation service, audio generation service, and special effects generation service. Therefore, it is possible to deploy targeted generation services to meet the generation needs of different modalities of media content, thereby improving the quality of generated media content.

[0095] Furthermore, the prompt information includes the generation conditions and modality of the media content to be generated. The content management service in the content management platform calls the generation service corresponding to this modality to process the prompt information and generate the first media content.

[0096] The multimodal content processing method provided in this embodiment deploys a separate content generation service in the content management platform to meet content generation needs, thus ensuring the security and reliability of content generation.

[0097] In some optional implementations, step S204 above includes:

[0098] Step c1: Obtain preset position information, which includes the addition position corresponding to different modalities.

[0099] Specifically, each modality is added to the metadata area in the media content of that modality, which is used to record attribute information.

[0100] Step c2: Determine the target addition location based on the preset location information and the modality of the first media content.

[0101] For example, if the preset location information includes a first location corresponding to audio and a second location corresponding to video, then when the first media content is audio data, the target location for adding the first signature information in the first media content is determined to be the first location based on the preset location information.

[0102] Step c3: Add the first signature information to the target location of the first media content to obtain the second media content.

[0103] Specifically, the target addition location is the metadata area in the first media content used to record attribute information. A separate metadata block is added to this metadata area to add the first signature information, thus obtaining the second media content.

[0104] The multimodal content processing method provided in this embodiment pre-configures the addition positions corresponding to each modality to obtain preset position information. Then, in the subsequent process, based on the preset position information and the modality of the first media content to be managed, the target addition position for adding the first signature information in the first media content is quickly determined. At the same time, it also facilitates the accurate and rapid extraction of the first signature information in the second media content when the second media content is subsequently checked.

[0105] In some alternative implementations, such as Figure 3 As shown, the AI-generated multimodal content processing method applicable to content management platforms also includes:

[0106] Step S301: In response to the access request for the second media content, obtain access information.

[0107] Optionally, the access information includes the requester's information regarding the access request.

[0108] Specifically, when a user views or downloads secondary media content through the client of the content management platform or the client of the content distribution platform, a login request is first initiated based on the user's identity information (such as account information). Upon receiving the login request, the server of the content management platform parses the request to obtain the user's identity information and performs identity authentication. If the authentication is successful, third-party login information is generated and returned. Then, the client (i.e., the requester of the access request) generates an access request based on the information of the media content to be accessed, the third-party login information, and the platform information, and sends the access request to the server of the content management platform. Wherein, if the client belongs to the content distribution platform, the platform information is the platform information of the content distribution platform. If the client belongs to the content management platform, the platform information is the platform information of the business platform to which it belongs. The requester information of the aforementioned access request includes at least one of the third-party login information and the platform information.

[0109] In step S302, the second media content and access information are sent to the signature service platform. The signature service platform is also used to digitally sign the second media content and access information to obtain second signature information. The second signature information is used to determine the dissemination status of the second media content.

[0110] Specifically, the content management platform calls the software development kit to send the secondary media content and access information to the signature service platform.

[0111] Step S303: Obtain the second signature information returned by the signature service platform.

[0112] Specifically, the signature service platform uses a data signature service to digitally sign the secondary media content and access information, obtaining secondary signature information. It then uses a notarization service to store this secondary signature information, facilitating subsequent verification of the dissemination of the secondary media content.

[0113] Step S304: Based on the modality of the second media content, add the second signature information to the second media content, and send the second media content with the added second signature information back to the requester of the access request.

[0114] Specifically, the software development kit in the content management platform receives the second signature information returned by the signature service platform. Based on the modality of the second media content, the software development kit adds the second signature information to the second media content to obtain the second media content with the added second signature information.

[0115] Furthermore, based on the preset location information and the modality of the second media content, the position for adding the second signature information is determined; based on the position for adding the second signature information, the second signature information is added to the second media content to obtain the second media content after adding the second signature information.

[0116] The multimodal content processing method provided in this embodiment involves a content management platform sending the desired second media content and access information to a signature service platform for digital signature processing. The platform then adds the second signature information returned by the signature service platform to the second media content and finally sends the second media content with the added second signature information back to the requesting party. Therefore, the dissemination of the second media content can be traced using the second signature information.

[0117] This embodiment provides a third method for processing multimodal content generated by artificial intelligence, which can be used in signature service platforms, such as... Figure 4 As shown, the signature service platform uses cloud computing services and is used to provide data signature and evidence storage services to the content management platform. Figure 4 This is a flowchart illustrating a third method for processing multimodal content generated by artificial intelligence according to an embodiment of this disclosure, as shown below. Figure 4 As shown, the process includes the following steps:

[0118] Step S401: Obtain at least one modality of first media content sent by the content management platform, as well as the generation method of the first media content. The first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to characterize whether the first media content is generated by artificial intelligence. See the relevant content of step S201 above, which will not be elaborated further here.

[0119] Step S402: Digitally sign the first media content and its generation method to obtain the first signature information.

[0120] Specifically, the signature service platform uses a data signature service to perform a hash operation on the first media content and its generation method to obtain a first calculation result. Then, based on the digital certificate of the first media content, it digitally signs the first calculation result to obtain a first signature result. Furthermore, the signature service platform is also configured with a trusted timestamp service. The platform uses this trusted timestamp service to add a timestamp to the first signature result to obtain the first signature information. Finally, it uses a notarization service to notarize the first signature information.

[0121] Step S403 involves sending the first signature information to the content management platform. The content management platform then adds the first signature information to the first media content based on its modality, thus obtaining the second media content. See step S204 above for further details.

[0122] The multimodal content processing method provided in this embodiment involves a signature service platform digitally signing the first media content and its generation method sent by the content management platform. The content management platform is unaware of the digital signing process, which to a certain extent prevents the leakage of information used for digital signing (such as keys, digital certificates, etc.) and ensures the reliability of the first signature information. Then, the content management platform adds the first signature information returned by the signature service platform to the first media content to obtain the second media content. Therefore, the generation method of the second media content can be verified through the first signature information in the second media content to confirm whether the second media content is artificial intelligence-generated content.

[0123] As one specific embodiment, such as Figure 5As shown, the overall process of the AI-generated multimodal content processing method disclosed herein is as follows: Users log in to the content management platform through a client of the content management platform or a third-party content distribution platform. The content management platform uses an information verification service to authenticate the user and the content distribution platform. If the authentication is successful, content management services are provided to the user or the content distribution platform. Users or the content distribution platform can upload first media content through a content upload service, or generate first media content through a content generation service. If the first media content is uploaded using the content upload service, the content management service in the content management platform sends the first media content to a content recognition service, which identifies the generation method of the first media content. If the first media content is generated using the content generation service, the generation method of the first media content is recorded as AI-generated. The content management service sends the first media content and its generation method to the data signature service of the signature service platform. The data signature service performs hash operations on the first media content and generation method for different modalities, obtains a first operation result, and digitally signs the first operation result using a digital certificate to obtain a first signature result. Then, the data signature service sends the first signature result to a trusted timestamp service. The trusted timestamp service provides tamper-proof trusted timestamps for digital certificates, or commercially trusted timestamps, to add a timestamp to the first signature result, thus obtaining the first signature information. The data signature service sends the first signature information to the evidence storage service. The evidence storage service is responsible for locally storing the first signature information and reporting it to the authentication platform to provide publicly searchable or authenticated capabilities.

[0124] In some optional implementations, the first media content is obtained by the content management platform in response to a content upload request by providing a content upload service to the requester; and / or, the first media content is obtained by the content management platform in response to a content generation request by obtaining prompt information and calling the content generation service to process the prompt information. The method of obtaining the first media content from a content upload request can be found in steps a1 and a2 above. The method of obtaining the first media content from a content generation request can be found in steps b1 and b2 above, and will not be elaborated further here.

[0125] Further, step S402 above includes:

[0126] Step d1: Obtain the region information of the request sending region for the first media content. The request sending region includes the sending region for the content upload request and / or the sending region for the content generation request.

[0127] Understandably, if the first media content is obtained through a content upload request, then the request sending area is the same as the content upload request sending area. If the first media content is obtained through a content generation request, then the request sending area is the same as the content generation request sending area.

[0128] Step d2: Determine the certificate source based on the regional information.

[0129] Specifically, different regional certificate sources are pre-configured to obtain preset source information. Then, based on the regional information and the preset source information, the certificate source of the first media content is determined.

[0130] For example, if the content upload request is initiated in region 1, then the certificate source of region 1 will be used as the certificate source for the first media content in the digital signature process.

[0131] Optionally, the certificate source includes at least one of the Certificate Authority (CA) and Public Key Infrastructure (PKI) systems, or other sources that can provide certificates for digital signatures.

[0132] Step d3: Obtain the digital certificate from the certificate source.

[0133] Specifically, obtain the first login information of the party requesting the content upload request, or the second login information of the party requesting the content generation request. Obtain the digital certificate from the certificate source based on either the first or second login information.

[0134] Step d4: Digitally sign the first media content and its generation method based on the digital certificate to obtain the first signature information.

[0135] Specifically, a hash operation is performed on the first media content and its generation method to obtain a first operation result. A digital signature is then performed on the first operation result based on a digital certificate to obtain a first signature result. Finally, a timestamp is added to the first signature result to obtain the first signature information.

[0136] The multimodal content processing method provided in this embodiment first determines the certificate source based on the regional information of the request sending region of the first media content, and then obtains the digital certificate from the certificate source to digitally sign the first media content and its generation method. Therefore, it can ensure that the digital certificate meets regional requirements, ensure the validity and trustworthiness of the digital certificate, and also improve the efficiency of obtaining the digital certificate.

[0137] As one specific embodiment, such as Figure 6As shown, the main process of uploading media content using the AI-generated multimodal content processing method disclosed herein includes: A user logs into the content management platform through a client of the content management platform or content distribution platform. An information verification service authenticates the user's identity and generates initial login information. If the authentication is successful, the information verification service sends the initial login information back to the client. The client sends the initial login information and the initial media content to the content management service. The content management service sends the received initial media content to a content recognition service. The content recognition service identifies the generation method of the initial media content, obtains the generation method of the initial media content, and sends the generation method of the initial media content back to the content management service. The content management service sends the initial media content and the generation method to a data signature service. The data signature service performs a hash operation on the initial media content and its generation method, obtains a first operation result, and digitally signs the first operation result based on a digital certificate, obtaining a first signature result. The data signature service sends the first signature result to a trusted timestamp service. The trusted timestamp service adds a timestamp to the first signature result, obtains the first signature information, and sends the first signature information back to the data signature service. The data signature service sends the first signature information to a notarization service. The notarization service notifies the received first signature information and reports the notarization completion to the data signature service. After notarization, the data signature service sends the first signature information to the content management service. The content management service adds the first signature information to the first media content and reports successful upload to the client; at this point, the first media content is ready for use.

[0138] As one specific embodiment, such as Figure 7As shown, the main process of generating media content using the AI-generated multimodal content processing method disclosed herein includes: A user logs into the content management platform through a client of the content management platform or content distribution platform. An information verification service authenticates the user and generates second login information. If the authentication is successful, the information verification service sends the second login information back to the client. The client sends the second login information and a prompt message for generating media content to the content management service. The content management service calls the content generation service to process the prompt message, generates first media content, and obtains the generation method of the first media content through a content recognition service. The content management service sends the first media content and its generation method to a data signature service. The data signature service performs a hash operation on the first media content and its generation method to obtain a first operation result, and digitally signs the first operation result based on a digital certificate to obtain a first signature result. The data signature service sends the first signature result to a trusted timestamp service. The trusted timestamp service adds a timestamp to the first signature result to obtain first signature information, and sends the first signature information back to the data signature service. The data signature service sends the first signature information to a notarization service. The notarization service notifies the received first signature information and reports the notarization completion to the data signature service. After notarization, the data signature service sends the first signature information to the content management service. The content management service adds the first signature information to the first media content and reports successful content generation to the client; at this point, the first media content is ready for use.

[0139] In some alternative implementations, such as Figure 8 As shown, the AI-generated multimodal content processing method for a signature service platform disclosed herein also includes:

[0140] Step S801: Obtain the second media content and access information sent by the content management platform. The access information is obtained by the content management platform in response to the access request for the second media content. See steps S301 and S302 above, which will not be elaborated further here.

[0141] Step S802: Digitally sign the second media content and access information to obtain second signature information. The second signature information is used to determine the dissemination status of the second media content.

[0142] Specifically, the signature service platform uses a data signature service to perform a hash operation on the second media content and access information to obtain a second calculation result. Then, based on the digital certificate corresponding to the second media content, it digitally signs the second calculation result to obtain a second signature result. Further, the signature service platform uses a trusted timestamp service to add a timestamp to the second signature result to obtain second signature information. Finally, it uses a notarization service to notarize the second signature information.

[0143] Furthermore, the digital certificate for the second media content is obtained by: obtaining the region information of the region where the access request was sent; determining the certificate source corresponding to the second media content based on the region information of the access request; and obtaining the digital certificate from the certificate source corresponding to the second media content.

[0144] Alternatively, the digital certificate used by the first signature information corresponding to the second media content can be directly used to digitally sign the second media content and access information to obtain the second signature information.

[0145] Step S803: The second signature information is returned to the content management platform. The content management platform further adds the second signature information to the second media content based on its modality, and then sends the second media content with the added second signature information back to the requesting party corresponding to the access request. See step S304 above for details, which will not be elaborated upon here.

[0146] The multimodal content processing method provided in this embodiment involves a signature service platform digitally signing the second media content to be accessed and the access information, and then feeding back the second signature information to the content management platform. The content management platform then adds the second signature information to the second media content and sends it back to the requesting party. Therefore, the dissemination of the second media content can be traced using the second signature information.

[0147] As one specific embodiment, such as Figure 9As shown, the main process of accessing media content using the AI-generated multimodal content processing method disclosed herein includes: A user logs into the content management platform through a client of the content management platform or content distribution platform. An information verification service authenticates the user and generates third-party login information. If authentication is successful, the information verification service sends the third-party login information back to the client. The client generates access information based on the third-party login information and the platform information, and generates an access request based on the access information and the information of the second media content to be accessed. The access request is then sent to the content management service. The content management service obtains the second media content and sends it along with the access information to a data signature service. The data signature service performs a hash operation on the second media content and the access information to obtain a second operation result, and digitally signs the second operation result based on the digital certificate corresponding to the second media content to obtain a second signature result. The data signature service sends the second signature result to a trusted timestamp service. The trusted timestamp service adds a timestamp to the second signature result to obtain second signature information. The trusted timestamp service sends the second signature information back to the data signature service. The data signature service sends the second signature information to a notarization service. The notarization service notifies the second signature information and then reports the notarization completion to the data signature service. The data signature service then sends the second signature information to the content management service. The content management service adds the second signature information to the second media content and sends the updated second media content back to the client.

[0148] In some alternative implementations, such as Figure 10 As shown, the AI-generated multimodal content processing method for a signature service platform disclosed herein also includes:

[0149] Step S1001: In response to the verification request for the target media content, obtain the target media content and extract the signature information from the target media content.

[0150] The target media content includes primary media content, secondary media content, or other media content.

[0151] Specifically, the signature service platform provides a public authentication interface and authentication page, allowing users, content distribution platforms, and third-party platforms to upload target media content that needs verification to the evidence storage service.

[0152] Furthermore, the verification request may carry identification information of the target media content. If the target media content is a second media content, the evidence preservation service can obtain the addition position of the first signature information or the second signature information based on the identification information, and extract the signature information from the target media content based on the addition position. Alternatively, the evidence preservation service can obtain preset position information, determine the addition position of the signature information based on the preset position information and the modality of the target media content, and extract the signature information from the target media content based on the addition position.

[0153] Step S1002: Based on the signature information in the target media content and the signature information stored locally, the target media content is verified to obtain the verification result. The signature information stored locally includes the first signature information.

[0154] Optionally, the signature information stored locally on the signature service platform may also include second signature information.

[0155] Specifically, based on the matching between the target media content and locally stored media content (such as the first media content), a matching first signature is determined from the locally stored signature information. The target media content is then verified based on the signature information in the target media content and the matching first signature, yielding a verification result. If the target media content verification is successful, the verification result includes the generation method of the target media content. Furthermore, if the target media content has been accessed, the verification result also includes access information for the target media content. If the target media content verification fails, the verification result includes information indicating that the target media content verification failed.

[0156] Step S1003: The verification result is fed back to the requester of the verification request.

[0157] Specifically, the requester of the verification request can determine the generation method of the target media content based on the verification results, such as AI-generated, suspected AI-generated, or non-AI-generated. Furthermore, if the verification results also include access information, the source of the target media content can be traced based on this information to determine its dissemination.

[0158] The multimodal content processing method provided in this embodiment has a signature service platform that locally stores first signature information generated based on the first media content and its generation method. Therefore, when the signature service platform receives target media content that needs to be verified, it can verify the target media content by using the locally stored signature information and the signature information in the target media content to determine the generation method of the target media content, and thus be able to distinguish whether the target media content is generated by artificial intelligence.

[0159] As one specific embodiment, such as Figure 11As shown, the main process of the AI-generated multimodal content processing method disclosed herein for verifying media content includes: the content distribution platform, content management platform, or other platform sending the target media content to be verified to the notarization service of the signature service platform. The notarization service verifies the target media content based on the signature information in the target media content and the locally stored signature information, and obtains and returns the verification result.

[0160] As a specific application example, the content management platform includes one or more business platforms and also interfaces with third-party content distribution platforms. Users can upload or generate first media content through the client of the business platform or the client of the content distribution platform. The content management platform and the signature service platform execute the AI-generated multimodal content processing method disclosed herein to add first signature information to the first media content, resulting in second media content. If other users download or view the second media content through the client of the business platform or the client of the content distribution platform, the content management platform and the signature service platform further add second signature information to the second media content using the AI-generated multimodal content processing method disclosed herein. If other users need to verify a certain media content, they send the media content to be verified to the signature service platform. The signature service platform uses the AI-generated multimodal content processing method disclosed herein to verify the media content to be verified and provides feedback on the verification result, so that users can determine whether the verified media content was generated by AI and the dissemination status of the media content based on the verification result.

[0161] This embodiment also provides an artificial intelligence-generated multimodal content processing apparatus, which is used to implement the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0162] This embodiment provides an artificial intelligence-generated multimodal content processing device, suitable for content management platforms, such as... Figure 12 As shown, it includes:

[0163] The first acquisition module 1201 is used to acquire at least one modality of first media content and the generation method of the first media content. The first media content includes uploaded media content and / or locally generated media content. The generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0164] The first sending module 1202 is used to send the first media content and the generation method to the signature service platform, and the signature service platform is used to digitally sign the first media content and the generation method to obtain the first signature information.

[0165] The second acquisition module 1203 is used to acquire the first signature information returned by the signature service platform;

[0166] The first processing module 1204 is used to add the first signature information to the first media content based on the modality of the first media content to obtain the second media content.

[0167] In some optional implementations, the first acquisition module 1201 includes:

[0168] The first response unit is used to respond to a content upload request and provide content upload service to the requester of the content upload request;

[0169] A content receiving unit is used to receive first media content in at least one modality uploaded through a content uploading service;

[0170] The content recognition unit is used to call the content recognition service to identify the generation method of the first media content and obtain the generation method of the first media content.

[0171] In some optional implementations, the first acquisition module 1201 includes:

[0172] The second response unit is used to respond to the content generation request and obtain prompt information for generating media content;

[0173] The content generation unit is used to call the content generation service to process the prompt information, generate first media content in at least one modality, and record the generation method of the first media content.

[0174] In some alternative implementations, the first processing module 1204 includes:

[0175] The location information acquisition unit is used to acquire preset location information, which includes the addition position corresponding to different modes.

[0176] The first processing unit is used to determine the target addition location based on preset location information and the modality of the first media content;

[0177] The second processing unit is used to add the first signature information to the target location of the first media content to obtain the second media content.

[0178] In some optional embodiments, the AI-generated multimodal content processing apparatus of this disclosure further includes:

[0179] The third acquisition module is used to acquire access information in response to access requests for the second media content;

[0180] The second sending module is used to send the second media content and access information to the signature service platform. The signature service platform is also used to digitally sign the second media content and access information to obtain the second signature information. The second signature information is used to determine the dissemination status of the second media content.

[0181] The fourth acquisition module is used to obtain the second signature information returned by the signature service platform;

[0182] The second processing module is used to add the second signature information to the second media content based on the modality of the second media content, and to send the second media content with the added second signature information back to the requester of the access request.

[0183] Further functional descriptions of the above modules and units are the same as those in the corresponding embodiments described above, and will not be repeated here.

[0184] In this embodiment, the AI-generated multimodal content processing device is presented in the form of a functional unit. Here, a unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.

[0185] This embodiment also provides another artificial intelligence-generated multimodal content processing apparatus, which is used to implement the above embodiments and preferred embodiments, and will not be repeated as already described. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0186] This embodiment provides another artificial intelligence-generated multimodal content processing device, suitable for signature service platforms, such as... Figure 13 As shown, it includes:

[0187] The first receiving module 1301 is used to acquire at least one modality of first media content sent by the content management platform and the generation method of the first media content. The first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform. The generation method is used to characterize whether the first media content is generated by artificial intelligence.

[0188] The first signature module 1302 is used to digitally sign the first media content and its generation method to obtain the first signature information;

[0189] The first feedback module 1303 is used to feed back the first signature information to the content management platform; wherein, the content management platform is used to add the first signature information to the first media content based on the modality of the first media content to obtain the second media content.

[0190] In some optional implementations, the first media content is obtained by the content management platform in response to a content upload request by providing a content upload service to the requester; and / or, the first media content is obtained by the content management platform in response to a content generation request by obtaining prompt information and calling a content generation service to process the prompt information. The first signature module 1302 includes:

[0191] The area information acquisition unit is used to acquire area information of the request sending area of ​​the first media content, including the sending area of ​​the content upload request and / or the sending area of ​​the content generation request;

[0192] Source determination unit, used to determine the source of a certificate based on regional information;

[0193] The certificate acquisition unit is used to obtain digital certificates from the certificate source.

[0194] The digital signature unit is used to digitally sign the first media content and its generation method based on a digital certificate to obtain the first signature information.

[0195] In some optional embodiments, the AI-generated multimodal content processing apparatus of this disclosure further includes:

[0196] The second receiving module is used to obtain the second media content and access information sent by the content management platform. The access information is obtained by the content management platform in response to the access request for the second media content.

[0197] The second signature module is used to digitally sign the second media content and access information to obtain the second signature information, which is used to determine the dissemination of the second media content.

[0198] The second feedback module is used to return the second signature information to the content management platform; the content management platform is also used to add the second signature information to the second media content based on the modality of the second media content, and to feed back the second media content with the added second signature information to the requester corresponding to the access request.

[0199] In some optional embodiments, the AI-generated multimodal content processing apparatus of this disclosure further includes:

[0200] The third receiving module is used to respond to a verification request for the target media content, obtain the target media content, and extract the signature information from the target media content.

[0201] The data verification module is used to verify the target media content based on the signature information in the target media content and the signature information stored locally, and obtain the verification result. The signature information stored locally includes the first signature information.

[0202] The third feedback module is used to send the verification result back to the requester of the verification request.

[0203] Further functional descriptions of the above modules and units are the same as those in the corresponding embodiments described above, and will not be repeated here.

[0204] In this embodiment, the AI-generated multimodal content processing device is presented in the form of a functional unit. Here, a unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.

[0205] This disclosure also provides an artificial intelligence-generated multimodal content processing system, such as... Figure 14 As shown, the system includes a content management platform and a signature service platform. The content management platform is used to execute the AI-generated multimodal content processing method applicable to any of the above-described embodiments of the content management platform. The signature service platform is communicatively connected to the content management platform and is used to execute the AI-generated multimodal content processing method applicable to any of the above-described embodiments of the signature service platform.

[0206] Specifically, the content management platform is configured with a content upload service and a content recognition service. Clients of the content management platform or content distribution platforms can call the content upload service through a remotely marked port, using load balancing to upload the primary media content to the content management platform. The content recognition service identifies the generation method of the primary media content. Optionally, such as... Figure 15 As shown, the content upload service includes at least one of the following: video upload service, image upload service, and audio upload service.

[0207] Specifically, the content management platform is also configured with a content generation service. Clients of the content management platform or content distribution platforms can remotely mark ports and upload prompts for generating media content to the content management platform using load balancing. The content generation service processes the prompts to obtain the first media content and records the generation method of the first media content. Optionally, such as... Figure 15As shown, the content generation service includes at least one of the following: video generation service, image generation service, audio generation service, and special effects generation service.

[0208] Specifically, the content management platform is also equipped with a content risk control service, which is used to control the risks of the first media content uploaded by the content upload service and the first media content generated by the content generation service.

[0209] Furthermore, the content management platform is also equipped with a content management service, which is used to coordinate the management of content upload services, content generation services, and content recognition services. For details, please refer to the relevant content on the multimodal content processing method generated by artificial intelligence mentioned above, which will not be elaborated further here.

[0210] Optionally, the content management platform may also include one or more business platforms related to media content, such as business platform 1, business platform 2, and business platform 3. Each business platform is configured with content upload services and content generation services, and is equipped with a software development kit (SDK). Data communication is conducted between the SSD and the signature service platform.

[0211] Specifically, such as Figure 16 As shown, the signature service platform includes a platform control plane and a data plane.

[0212] Optionally, the platform control plane includes access approval service, converged certificate management service, permission management service, usage management service, trusted timestamp service, converged audit service, and evidence storage service. The access approval service is used to approve business platforms accessing the signature service platform. The permission management service is used to authenticate external access permissions. The converged certificate management service interfaces with certificate authorities and public key infrastructure systems to manage digital certificates. The usage management service manages digital signature usage. The trusted timestamp service provides tamper-proof trusted timestamps for digital certificates, or commercially trusted timestamps. The converged audit service and evidence storage service interface with blockchain, audit systems, and authentication platforms to audit and store signature information.

[0213] Optionally, the data plane connects to the business platform to obtain information related to digital signatures, such as business information (e.g., login information) and platform information. The data plane includes a cloud signature server and a hardware computing power cluster. The cloud signature server retrieves digital certificates and trusted timestamps from the platform control plane. The converged certificate management service distributes private keys to the hardware computing power cluster, which is then used by the cloud signature server to schedule the hardware computing power cluster to digitally sign data sent from the content management platform, thus providing a data signing service.

[0214] This disclosure also provides an electronic device; please refer to [link to relevant documentation]. Figure 17 , Figure 17This is a structural block diagram of an electronic device provided in an optional embodiment of this disclosure, such as... Figure 17 As shown, the electronic device includes one or more processors 1701, a memory 1702, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The components communicate with each other via different buses and can be mounted on a common motherboard or otherwise installed as needed. The processors can process instructions executed within the electronic device, including instructions stored in or on memory to display graphical information of a GUI on external input / output devices (such as display devices coupled to the interfaces). In some alternative implementations, multiple processors and / or multiple buses can be used with multiple memories and multiple memory modules, if desired. Similarly, multiple electronic devices can be connected, each providing some of the necessary operations (e.g., as a server array, a group of blade servers, or a multiprocessor system). Figure 17 Take the 1701 processor as an example.

[0215] Processor 1701 may be a central processing unit, a network processor, or a combination thereof. Processor 1701 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The programmable logic device may be a complex programmable logic device (CAMP), a field-programmable gate array (FPGA), a general-purpose array logic (GDA), or any combination thereof.

[0216] The memory 1702 stores instructions executable by at least one processor 1701 to cause at least one processor 1701 to perform the method shown in the above embodiments.

[0217] Memory 1702 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the electronic device. Furthermore, memory 1702 may include high-speed random access memory and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, memory 1702 may optionally include memory remotely located relative to processor 1701, and this remote memory may be connected to the electronic device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0218] Memory 1702 may include volatile memory, such as random access memory; memory may also include non-volatile memory, such as flash memory, hard disk or solid-state drive; memory 1702 may also include combinations of the above types of memory.

[0219] The electronic device also includes a communication interface 1703 for communicating with other devices or communication networks.

[0220] This disclosure also provides a computer-readable storage medium in which the methods described in this disclosure can be implemented in hardware or firmware, or implemented as recordable on a storage medium, or implemented as computer code downloaded over a network and originally stored on a remote storage medium or a non-transitory machine-readable storage medium and subsequently stored on a local storage medium. Thus, the methods described herein can be processed by software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. The storage medium can be a magnetic disk, optical disk, read-only memory, random access memory, flash memory, hard disk, or solid-state drive, etc.; further, the storage medium can also include combinations of the above types of memory. It is understood that computers, processors, microprocessor controllers, or programmable hardware include storage components capable of storing or receiving software or computer code. When the software or computer code is accessed and executed by the computer, processor, or hardware, the artificial intelligence-generated multimodal content processing method shown in the above embodiments is implemented.

[0221] A portion of this disclosure can be applied to computer program products, such as computer program instructions, which, when executed by a computer, can invoke or provide methods and / or technical solutions according to this disclosure through the operation of the computer. Those skilled in the art will understand that the forms in which computer program instructions exist in a computer-readable medium include, but are not limited to, source files, executable files, and installation package files. Accordingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executing the instructions; the computer compiling the instructions and then executing the corresponding compiled program; the computer reading and executing the instructions; or the computer reading and installing the instructions and then executing the corresponding installed program. Here, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible to a computer.

[0222] Although embodiments of the present disclosure have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present disclosure, and such modifications and variations all fall within the scope defined by the appended claims.

Claims

1. A method for processing multimodal content generated by artificial intelligence, characterized in that, Applicable to content management platforms, the method includes: The first media content in at least one modality and the generation method of the first media content are obtained, wherein the first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence. The first media content and the generation method are sent to the signature service platform, which is used to digitally sign the first media content and the generation method to obtain the first signature information. Obtain the first signature information returned by the signature service platform; Obtain preset position information, which includes the addition positions corresponding to different modalities; Based on the preset location information and the modality of the first media content, the target addition location is determined; Add the first signature information to the target location of the first media content to obtain the second media content; The method further includes: In response to an access request for the second media content, access information is obtained; The second media content and the access information are sent to the signature service platform. The signature service platform is also used to digitally sign the second media content and the access information to obtain second signature information. The second signature information is used to determine the dissemination status of the second media content. Obtain the second signature information returned by the signature service platform; Based on the modality of the second media content, the second signature information is added to the second media content, and the second media content with the added second signature information is fed back to the requester of the access request.

2. The method according to claim 1, characterized in that, The acquisition of at least one modality of first media content and the method of generating the first media content include: In response to a content upload request, provide content upload service to the requester of the content upload request; Receive first media content in at least one modality uploaded through the content upload service; The content recognition service is invoked to identify the generation method of the first media content, thereby obtaining the generation method of the first media content.

3. The method according to claim 1, characterized in that, The acquisition of at least one modality of first media content and the method of generating the first media content include: In response to a content generation request, obtain prompts for generating media content; The content generation service is invoked to process the prompt information, generate first media content in at least one modality, and record the generation method of the first media content.

4. A method for processing multimodal content generated by artificial intelligence, characterized in that, Applicable to signature service platforms, the method includes: The method acquires at least one modality of first media content sent by a content management platform and the generation method of the first media content, wherein the first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform; the generation method is used to characterize whether the first media content is generated by artificial intelligence. Digitally sign the first media content and the generation method to obtain first signature information; The first signature information is fed back to the content management platform; wherein, the content management platform is used to obtain preset location information, and based on the preset location information and the modality of the first media content, determine the target addition position, and then add the first signature information at the target addition position of the first media content to obtain the second media content, wherein the preset location information includes addition positions corresponding to different modalities; The method further includes: The content management platform obtains the second media content and access information sent by the content management platform, wherein the access information is obtained by the content management platform in response to an access request for the second media content; The second media content and the access information are digitally signed to obtain second signature information, which is used to determine the dissemination status of the second media content; The second signature information is returned to the content management platform; wherein, the content management platform is further configured to add the second signature information to the second media content based on the modality of the second media content, and to feed back the second media content after adding the second signature information to the requester corresponding to the access request.

5. The method according to claim 4, characterized in that, The first media content is obtained by the content management platform in response to a content upload request by providing content upload service to the requester of the content upload request; and / or, the first media content is obtained by the content management platform in response to a content generation request by obtaining prompt information and calling the content generation service to process the prompt information; The step of digitally signing the first media content and the generation method to obtain the first signature information includes: Obtain the region information of the request sending region of the first media content, wherein the request sending region includes the sending region of the content upload request and / or the sending region of the content generation request; The certificate source is determined based on the aforementioned regional information; Obtain the digital certificate from the certificate's source; The first media content and the generation method are digitally signed based on the digital certificate to obtain the first signature information.

6. The method according to claim 4, characterized in that, The method further includes: In response to a verification request for target media content, the target media content is obtained and the signature information in the target media content is extracted; Based on the signature information in the target media content and the locally stored signature information, the target media content is verified to obtain a verification result. The locally stored signature information includes the first signature information. The verification result is then sent back to the party that requested the verification request.

7. A device for processing multimodal content generated by artificial intelligence, characterized in that, Suitable for content management platforms, the device includes: The first acquisition module is used to acquire at least one modality of first media content and the generation method of the first media content, wherein the first media content includes uploaded media content and / or locally generated media content; the generation method is used to characterize whether the first media content is generated by artificial intelligence. The first sending module is used to send the first media content and the generation method to the signature service platform, and the signature service platform is used to digitally sign the first media content and the generation method to obtain the first signature information. The second acquisition module is used to acquire the first signature information returned by the signature service platform; The first processing module is used to add the first signature information to the first media content based on the modality of the first media content to obtain the second media content; The first processing module includes: The location information acquisition unit is used to acquire preset location information, which includes the addition position corresponding to different modes. The first processing unit is used to determine the target addition location based on preset location information and the modality of the first media content; The second processing unit is used to add first signature information to the target addition position of the first media content to obtain the second media content; The AI-generated multimodal content processing device also includes: The third acquisition module is used to acquire access information in response to access requests for the second media content; The second sending module is used to send the second media content and access information to the signature service platform. The signature service platform is also used to digitally sign the second media content and access information to obtain the second signature information. The second signature information is used to determine the dissemination status of the second media content. The fourth acquisition module is used to obtain the second signature information returned by the signature service platform; The second processing module is used to add the second signature information to the second media content based on the modality of the second media content, and to send the second media content with the added second signature information back to the requester of the access request.

8. A device for processing multimodal content generated by artificial intelligence, characterized in that, Suitable for signature service platforms, the device includes: The first receiving module is configured to acquire at least one modality of first media content sent by the content management platform and the generation method of the first media content. The first media content includes media content uploaded to the content management platform and / or media content generated by the content management platform. The generation method is used to characterize whether the first media content is generated by artificial intelligence. The first signature module is used to digitally sign the first media content and the generation method to obtain first signature information; The first feedback module is used to feed back the first signature information to the content management platform; wherein, the content management platform is used to obtain preset location information, and based on the preset location information and the modality of the first media content, determine the target addition position, and then add the first signature information to the target addition position of the first media content to obtain the second media content, wherein the preset location information includes addition positions corresponding to different modalities; The AI-generated multimodal content processing device further includes: The second receiving module is used to obtain the second media content and access information sent by the content management platform. The access information is obtained by the content management platform in response to the access request for the second media content. The second signature module is used to digitally sign the second media content and access information to obtain the second signature information, which is used to determine the dissemination of the second media content. The second feedback module is used to return the second signature information to the content management platform; the content management platform is also used to add the second signature information to the second media content based on the modality of the second media content, and to feed back the second media content with the added second signature information to the requester corresponding to the access request.

9. A multimodal content processing system generated by artificial intelligence, characterized in that, The system includes: A content management platform, wherein the content management platform is used to execute the artificial intelligence-generated multimodal content processing method according to any one of claims 1 to 3; A signature service platform, which is communicatively connected to the content management platform, is used to execute the artificial intelligence-generated multimodal content processing method according to any one of claims 4 to 6.

10. An electronic device, characterized in that, include: The system includes a memory and a processor, which are communicatively connected to each other. The memory stores computer instructions, and the processor executes the computer instructions to perform the AI-generated multimodal content processing method according to any one of claims 1 to 3, or the AI-generated multimodal content processing method according to any one of claims 4 to 6.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing the computer to execute the AI-generated multimodal content processing method according to any one of claims 1 to 3, or to execute the AI-generated multimodal content processing method according to any one of claims 4 to 6.

12. A computer program product, characterized in that, The method includes computer instructions for causing a computer to execute the AI-generated multimodal content processing method according to any one of claims 1 to 3, or to execute the AI-generated multimodal content processing method according to any one of claims 4 to 6.

Images