Multimedia content generation method and device, electronic equipment and storage medium

Abstract

The invention relates to a multimedia content generation method and device, electronic equipment and a storage medium, and relates to the technical field of computers. The multimedia content generation method can comprise the steps of providing a visual element operation mode in response to a trigger request for generating first multimedia content based on multimedia reference content; and in response to the selection of the visual element operation mode, generating the first multimedia content based on the visual element operation mode and the multimedia reference content.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a method for generating multimedia content, an apparatus for generating multimedia content, an electronic device, a computer-readable storage medium, and a computer program product. Background Technology

[0002] With the rapid development of AI-generated technologies, text-to-image (hereinafter referred to as "text-to-image") and image-to-image (hereinafter referred to as "image-to-image") technologies have become important application areas. Currently, text-to-image and image-to-image technologies have been widely integrated into various applications to optimize user experience. Specifically, users can use generative models (such as adversarial networks, diffusion models, etc.) to transform input text and / or images into corresponding new images. Summary of the Invention

[0003] In view of this, embodiments of the present disclosure provide a method for generating multimedia content, an apparatus for generating multimedia content, an electronic device, a computer-readable storage medium, and a computer program product.

[0004] According to a first aspect of this disclosure, a method for generating multimedia content is provided, comprising: providing a visual element operation mode in response to a trigger request for generating first multimedia content based on multimedia reference content; and generating the first multimedia content based on the visual element operation mode and the multimedia reference content in response to the selection of the visual element operation mode.

[0005] According to a second aspect of this disclosure, a multimedia content generation apparatus is provided, comprising: a providing module configured to provide a visual element operation mode in response to a trigger request for generating first multimedia content based on multimedia reference content; and a multimedia content generation module configured to generate the first multimedia content based on the visual element operation mode and the multimedia reference content.

[0006] According to a third aspect of this disclosure, an electronic device is provided, comprising: at least one memory; and at least one processor coupled to said at least one memory, said at least one processor being configured to execute a generation method according to some embodiments of this disclosure based on instructions stored in said at least one memory.

[0007] According to a fourth aspect of this disclosure, a computer-readable storage medium is provided that stores computer instructions thereon, which, when executed by a processor, implement the generation method described in some embodiments of this disclosure.

[0008] According to a fifth aspect of this disclosure, a computer program product is provided that, when run on a computer, causes the computer to implement the generation method described in some embodiments of this disclosure.

[0009] Other features, aspects, and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0010] Embodiments of this disclosure are described below with reference to the accompanying drawings. It should be understood that the drawings described below are merely illustrative of some embodiments of this disclosure and are not intended to limit the scope of this disclosure. In the drawings:

[0011] Figure 1 A flowchart illustrating a method for generating multimedia content according to some embodiments of the present disclosure is shown.

[0012] Figure 2 A flowchart illustrating method steps for providing a visual element operation mode according to some embodiments of the present disclosure;

[0013] Figure 3 A flowchart illustrating method steps for generating first multimedia content according to some embodiments of the present disclosure is shown.

[0014] Figure 4 A flowchart illustrating method steps for generating first multimedia content according to some embodiments of the present disclosure is shown.

[0015] Figure 5 A flowchart illustrating a method for generating multimedia content according to other embodiments of the present disclosure is shown.

[0016] Figure 6 A flowchart illustrating a method for generating multimedia content according to some embodiments of the present disclosure is shown;

[0017] Figures 7 to 10 A schematic diagram showing a display interface according to some embodiments of the present disclosure is provided.

[0018] Figure 11 A block diagram illustrating an apparatus for generating multimedia content according to some embodiments of the present disclosure;

[0019] Figure 12 A block diagram of an electronic device according to some embodiments of the present disclosure is shown;

[0020] Figure 13 Block diagrams of electronic devices according to other embodiments of the present disclosure are shown.

[0021] It should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not necessarily drawn to actual scale. The same or similar reference numerals are used in the various drawings to denote the same or similar parts. Therefore, once an item is defined in one drawing, it may not be discussed further in subsequent drawings. Detailed Implementation

[0022] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. It should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0023] It should be understood that the various steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of components and steps set forth in these embodiments should be interpreted as merely exemplary and do not limit the scope of this disclosure.

[0024] As used in this disclosure, the term "comprising" and its variations are open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to". The term "based on" means "at least partially based on".

[0025] It should be noted that the concepts of "first," "second," etc., used in this disclosure are used only to distinguish different devices, modules, or units, and are not intended to define the order of functions performed by these devices, modules, or units or their interdependencies. Unless otherwise specified, the concepts of "first," "second," etc., are not intended to imply that the objects described herein must be in a given temporal, spatial, rank, or any other given order.

[0026] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0027] The user information and data involved in this disclosure (including but not limited to users' historical generated data) are all information and data authorized by users or fully authorized by all parties. The collection, use and processing of such information and data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0028] It should be understood that, in this disclosure, the corresponding controls may refer to human-computer interaction tools used in human-computer interfaces to implement input, output, or operation functions. For example, the corresponding controls may include labels, buttons, text boxes, sliders, menus, switches, etc. User triggering operations on the corresponding controls may include, for example, single-click, double-click, long-press, swipe, voice control, etc.

[0029] The embodiments of this disclosure are described in detail below with reference to the accompanying drawings; however, this disclosure is not limited to these specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Furthermore, in one or more embodiments, specific features, structures, or characteristics can be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.

[0030] With the rapid development of AI-generated technologies, text-to-image (hereinafter referred to as "text-to-image") and image-to-image (hereinafter referred to as "image-to-image") technologies have become important application areas. Currently, text-to-image and image-to-image technologies have been widely integrated into various applications to optimize user experience. Specifically, users can use generative models (such as adversarial networks, diffusion models, etc.) to transform input text and / or images into corresponding new images. While browsing an image, users may expect to generate new images based on that image to obtain a richer experience with greater creative freedom.

[0031] However, in the process of generating one multimedia content based on another multimedia content (such as images and / or videos) using generative models, the reliance on users to manually obtain the multimedia content and manually input the corresponding prompts results in inconvenience, low efficiency, and a decline in user experience.

[0032] Therefore, how to guide users to quickly generate the multimedia content they need in order to improve generation efficiency, ease of operation and enhance user experience is a technical problem that urgently needs to be solved by those skilled in the art.

[0033] It should be noted that the information presented in this section is intended to aid in understanding the background of this disclosure, and may contain content that is not known to those skilled in the art, and should not be regarded as a limitation on the prior art.

[0034] Based on this, this disclosure provides a method for generating multimedia content, an apparatus for generating multimedia content, an electronic device, a computer-readable storage medium, and a computer program product, thereby allowing for the provision of corresponding visual element operation methods for multimedia reference content, which helps to quickly guide the generation of multimedia content that meets user needs. Therefore, the multimedia content generation method of this disclosure can effectively overcome one or more of the defects mentioned above.

[0035] Figure 1 A flowchart illustrating a method for generating multimedia content according to some embodiments of the present disclosure is shown. Figure 1 As shown, the multimedia content generation method of this embodiment may include steps S101 to S102. The method of this embodiment can be executed by an electronic device, such as a computer and / or a terminal device. It should be understood that the method of this embodiment can be executed at least partially on the client side and also partially on the server side.

[0036] In step S101, in response to a trigger request to generate first multimedia content based on multimedia reference content, a visual element operation mode is provided; in step S102, in response to the selection of the visual element operation mode, the first multimedia content is generated based on the visual element operation and the multimedia reference content.

[0037] In the above embodiments, by providing users with selectable visual element operation methods based on multimedia reference content, users are guided to easily generate first multimedia content that meets their needs based on the visual element operation methods selected by the user and the multimedia reference content. This provides users with greater creative freedom, stimulates their creative enthusiasm, and enhances the user experience.

[0038] In this disclosure, the form and source of multimedia reference content are diverse. For example, multimedia reference content can be images or videos, meaning this disclosure does not limit the form of multimedia reference content. Furthermore, multimedia reference content can be stored in a corresponding multimedia reference content database, which can be stored on internal or external storage devices. In other words, multimedia reference content can be obtained from internal or external storage devices, meaning this disclosure does not limit how multimedia reference content is obtained.

[0039] In some embodiments, the multimedia reference content may be multimedia content presented on a social platform (or social software). For example, images, videos, etc., posted by users of social software on social platforms. Each multimedia reference content can be selected independently by the user to facilitate further browsing or to facilitate the user to generate another desired multimedia content based on the multimedia reference content.

[0040] It should be understood that this disclosure does not limit how the trigger request is generated. In some embodiments of this disclosure, the trigger request for generating first multimedia content based on multimedia reference content can be initiated, started, or generated in response to a related generation operation on the multimedia reference content. In some embodiments of this disclosure, in response to a user's selection operation on the multimedia reference content, operation controls for the multimedia reference content can be displayed, and the trigger request for generating first multimedia content based on the multimedia reference content can be initiated, started, or generated in response to a triggering operation on the operation control. For example, the trigger request can be initiated, started, or generated in response to an activation operation on the operation control, such as clicking, checking, or inputting an instruction.

[0041] The visual elements involved in this disclosure can constitute the basic visual components or visualization components presented or displayed in the corresponding multimedia content (such as the multimedia reference content, the first multimedia content, and the second multimedia content in this document), and may include, but are not limited to, one or more of the object elements, style elements, and text elements in the multimedia content. Object elements can involve various object types in the multimedia content, such as, but are not limited to, biological objects (such as people, animals, plants, etc.) and non-biological objects (such as buildings, vehicles, daily necessities, etc.). Style elements can involve various style types in the multimedia content, such as, but are not limited to, comic style, cartoon style, ink painting style, etc. Text elements can involve the text presented in the multimedia content, such as, but are not limited to, text content or fonts located in various positions in the multimedia content.

[0042] Figure 2 A flowchart illustrating method steps for providing visual element operation modes according to some embodiments of this disclosure is shown. Figure 2 As shown, the method steps for providing a visual element operation mode may include steps S1011 to S1012.

[0043] In step S1011, in response to a trigger request to generate first multimedia content based on multimedia reference content, the classification information of the multimedia reference content is obtained; in step S1012, the operation mode of the visual element is provided based on the classification information of the multimedia reference content.

[0044] It should be noted that the generation method of this embodiment is the same as... Figure 1 The related parts of the generation method introduced in this article can be found in the detailed content above, and will not be repeated here.

[0045] In the above embodiments, classification information based on multimedia reference content can provide corresponding visual element operation methods more accurately, effectively increasing the likelihood of hitting the operation method expected by the user.

[0046] In this disclosure, the classification information (also known as tagging information) of multimedia reference content can indicate one or more visual elements involved in the multimedia reference content. For example, the classification information can indicate one or more or all of the visual elements involved in the multimedia reference content, or the classification information can indicate the main visual element or primary visual element involved in the multimedia reference content.

[0047] In some embodiments of this disclosure, visual element manipulation methods may include at least one of manipulation methods for object elements, manipulation methods for style elements, and manipulation methods for text elements. Specifically, when the classification information of the multimedia reference content indicates that the multimedia reference content involves object elements, manipulation methods for object elements can be provided; when the classification information of the multimedia reference content indicates that the multimedia reference content involves style elements, manipulation methods for style elements can be provided; when the classification information of the multimedia reference content indicates that the multimedia reference content involves text elements, manipulation methods for text elements can be provided. It should be understood that when the classification information of the multimedia reference content indicates that the multimedia reference content involves multiple visual elements, multiple corresponding manipulation methods can be provided. For example, when the classification information of the multimedia reference content indicates that the multimedia reference content involves both object elements and text elements, manipulation methods for object elements and manipulation methods for text elements can be provided. As another example, when the classification information of the multimedia reference content indicates that the multimedia reference content involves multiple object elements, such as human figures and animal figures, manipulation methods for human figures and manipulation methods for animal figures can be provided.

[0048] In some embodiments of this disclosure, at least one visual element in the multimedia reference content can be determined in advance or offline to determine the classification information of the multimedia reference content. Specifically, at least one visual element in the multimedia reference content can be determined before providing a visual element operation method in response to a trigger request to generate first multimedia content based on the multimedia reference content. Then, the classification information of the multimedia reference content can be determined based on the determined at least one visual element according to a preset visual element priority. Thus, the corresponding visual element operation method can be provided by obtaining the classification information determined in advance or offline.

[0049] In some embodiments of this disclosure, at least one visual element in the multimedia reference content can be determined online to determine the classification information of the multimedia reference content. Specifically, in response to a trigger request to generate first multimedia content based on the multimedia reference content, at least one visual element in the multimedia reference content is determined. Then, the classification information of the multimedia reference content can be determined based on the determined at least one visual element according to a preset visual element priority. Thus, the classification information can be determined online in response to the trigger request to determine the operation mode of the visual elements to be provided online.

[0050] In this disclosure, the preset visual element priorities can be diverse. In some embodiments of this disclosure, the priority of object elements can be greater than the priority of style elements, and the priority of style elements can be greater than the priority of text elements. It should be understood that each visual element's sub-visual elements can also have corresponding preset sub-visual element priorities; for example, in object elements, the priority of people can be greater than the priority of animals or plants. Furthermore, the classification information of the multimedia reference content can be determined based on the corresponding preset visual element priorities and preset visual element sub-priorities, and corresponding visual element operation methods can be provided.

[0051] For example, if at least one visual element in the determined multimedia reference content is an object element, a style element, or a text element, the classification information determined based on a preset visual element priority can indicate only the object element. That is, the classification information can be determined based on the highest-priority visual element among the determined visual elements, thus providing only the operation method for the object element. Alternatively, the classification information determined based on the preset visual element priority can indicate both object elements and style elements, correspondingly providing both operation methods for the object element and operation methods for the style element, to offer more operation methods and further increase the likelihood of hitting the user's desired operation method. It should be understood that operation methods for object elements, style elements, and text elements can also be provided.

[0052] In this disclosure, the determination of at least one visual element in the multimedia reference content can be automatic, for example, by relying on one or more machine learning models. In some embodiments, the determination of at least one visual element in the multimedia reference content can be achieved using a large language model, a base model, or a parameter fine-tuning model. In some embodiments, the determination of at least one visual element in the multimedia reference content can also be directly achieved by an intelligent agent. Here, the intelligent agent can also be referred to as a robot, a digital human, or a virtual agent of a machine learning model. The intelligent agent can be implemented based on one or more machine learning models, such as a large language model or a base model.

[0053] In some embodiments, at least one visual element in the multimedia reference content can also be extracted. The extraction of the at least one visual element can be implemented with reference to the description above regarding the determination of the at least one visual element in the multimedia reference content, and will not be repeated here. Furthermore, the extracted visual element can be stored directly or processed (e.g., aggregated) in a corresponding storage device for subsequent retrieval.

[0054] Figure 3 A flowchart illustrating the steps of a method for generating first multimedia content according to some embodiments of the present disclosure is shown. Figure 3 As shown, generating the first multimedia content based on the visual element operation method and the multimedia reference content may include steps S1021 and S1022.

[0055] In step S1021, in response to the selection of the visual element operation mode, a prompt message is generated based on the visual element operation mode; in step S1022, the first multimedia content is generated based on the prompt message and the multimedia reference content.

[0056] It should be noted that the generation method of this embodiment is the same as... Figures 1 to 2 The related parts of the generation method introduced in this article can be found in the detailed content above, and will not be repeated here.

[0057] In the above embodiments, prompts for corresponding visual elements can be quickly generated according to the selected operation method, thereby simplifying, and sometimes even eliminating, the user's manual input of prompts, and improving the efficiency of multimedia content generation.

[0058] In this disclosure, the prompt information used to generate the first multimedia content can be understood as a comprehensive set of instructions, represented in text and / or multimedia content form, that can guide the multimedia content generation model to generate the first multimedia content.

[0059] In some embodiments, generating prompt information based on the selected visual element operation mode may include generating prompt information instructing the user to operate on a visual element in the multimedia reference content. This allows for the accurate and efficient generation of prompt information for the corresponding visual element based on the selected operation mode.

[0060] Specifically, in response to the selection of an operation mode for the visual element, generating a prompt message instructing the operation of the visual element in the multimedia reference content may include generating a prompt message instructing the adjustment of the object element in the multimedia reference content in response to the selection of an operation mode for an object element. For example, a prompt message instructing the replacement of a biological element in the multimedia reference content, such as "Replace the person in the image," may be generated. Thus, the multimedia content generation model can be guided to adjust the object elements of the multimedia reference content based on the prompt message to generate corresponding first multimedia content.

[0061] Additionally or alternatively, in response to the selection of the visual element operation mode, generating the prompt message instructing the operation of the visual element in the multimedia reference content may include generating the prompt message in response to the selection of the operation mode for a style element, instructing the migration of the style element in the multimedia reference content. For example, "to..." Figure 1 style migration to Figure 2 "or "put Figure 2 become Figure 1 "style", here Figure 1 Refers to multimedia reference content, here Figure 2 This refers to multimedia content that requires style transfer (such as the second multimedia content described below). Therefore, the multimedia content generation model can be guided to transfer the style elements of the multimedia reference content based on the aforementioned prompt information, thereby generating the corresponding first multimedia content.

[0062] Alternatively or additionally, in response to the selection of the visual element operation mode, generating the prompt message instructing the operation of the visual element in the multimedia reference content may include generating the prompt message in response to the selection of the operation mode for the text element, instructing the modification of the text element in the multimedia reference content. For example, "Modify text: A". Thus, the multimedia content generation model can be guided to modify the text element of the multimedia reference content based on the prompt message to generate the corresponding first multimedia content.

[0063] In some embodiments, the prompt information may include multiple sub-prompt information for multiple visual elements in the multimedia reference content. In a non-limiting embodiment, the multiple visual elements may include multiple text elements, wherein, in response to the selection of an operation mode for the text elements, the generated prompt information may include multiple sub-prompt information for multiple text elements in the multimedia reference content. For example, if the text elements in the multimedia reference content include text A1 and text A2, by extracting the text elements from the multimedia reference content, the generated prompt information may be, for example, "Modify text: A1, A2".

[0064] In some embodiments, the generated prompt information can be modified to make the generated first multimedia content more likely to meet the user's needs and improve the accuracy of the generated content. Specifically, after generating prompt information based on the visual element operation method, in response to a modification operation on the prompt information, the modified prompt information is obtained, and the first multimedia content is generated based on the modified prompt information and the multimedia reference content. For example, the generated prompt information is "Modify text: A1, A2", where text A1 and text A2 are text elements extracted from the multimedia reference content and located at corresponding positions (for example, text A1 is the text content of the main title of the multimedia reference content, and text A2 is the text content of the subtitle of the multimedia reference content). The modified prompt information can be, for example, "Modify text: B1, B2", to indicate that text A1 in the corresponding position in the multimedia reference content is modified to B1, and text A2 is modified to B2.

[0065] In this disclosure, the generation of prompts based on the visual element operation methods can be automated, for example, by relying on one or more machine learning models. In some embodiments, prompts can be generated based on the visual element operation methods using a large language model, a base model, or a parameter fine-tuning model. In some embodiments, the generation of prompts can be directly implemented by an intelligent agent. This intelligent agent can also be referred to as a robot, a digital human, or a virtual agent of a machine learning model. The intelligent agent can be implemented based on one or more machine learning models, such as a large language model or a base model.

[0066] In this disclosure, the generation of the first multimedia content based on the prompt information and the multimedia reference content can be automated, for example, by relying on one or more machine learning models. In some embodiments, the corresponding multimedia content can be generated based on the prompt information and the multimedia reference content using a generative model (e.g., adversarial networks, diffusion models, etc.). In some embodiments, the generation of the multimedia content based on the prompt information and the multimedia reference content can also be directly implemented by an intelligent agent. Here, the intelligent agent can also be referred to as a robot, a digital human, or a virtual agent of a machine learning model. The intelligent agent can be implemented based on one or more machine learning models, such as based on a large language model or a basic model.

[0067] Figure 4 A flowchart illustrating method steps for generating first multimedia content according to other embodiments of this disclosure is shown. Figure 4 As shown, generating the first multimedia content based on the visual element operation method and the multimedia reference content may include steps S1023 and S1024.

[0068] In step S1023, in response to the selection of the visual element operation mode, the second multimedia content is obtained; in step S1024, the first multimedia content is generated based on the visual element operation mode, the multimedia reference content, and the second multimedia content.

[0069] It should be noted that the generation method of this embodiment is the same as... Figures 1 to 3 The related parts of the generation method introduced in this article can be found in the detailed content above, and will not be repeated here.

[0070] In the above embodiments, based on the acquired second multimedia content, multimedia content that meets user needs can be generated more accurately, and different second multimedia content can generate corresponding different first multimedia content, which can further improve creative freedom and enhance user experience.

[0071] In this disclosure, the form and source of the second multimedia content are diverse. For example, the second multimedia content can be an image or a video, meaning this disclosure does not limit the form of the second multimedia content. Furthermore, the second multimedia content can be obtained from internal storage devices or external storage devices, meaning this disclosure does not limit how the second multimedia content is obtained.

[0072] In some embodiments, when an operation mode is selected for an object element, the object features of the object element can be considered when generating the corresponding first multimedia content to facilitate the generation of multimedia content that meets user expectations. Specifically, generating the first multimedia content based on the visual element operation mode, the multimedia reference content, and the second multimedia content may include: obtaining object features of a first object element for the multimedia reference content, and obtaining object features of a second object element for the second multimedia content; generating the first multimedia content based on the object features of the first object element, the object features of the second object element, the multimedia reference content, the second multimedia content, and the visual element operation mode. Thus, when generating the first multimedia content, the object features of the object elements in the multimedia reference content and the second multimedia content can be fully considered, allowing operations such as replacing corresponding object elements in the multimedia reference content with corresponding object elements in the second multimedia content to be performed based on the object features, thereby increasing the likelihood of generating first multimedia content that meets user expectations.

[0073] In this disclosure, the term "object features" should be broadly understood, and may include at least one of the following: quantity features, positional features, attribute features, and pose features of the object elements. A quantity feature is, for example, the number of object elements. In a non-limiting embodiment, based on the quantity features of the object elements in the multimedia reference content and the second multimedia content, a corresponding number of object elements in the multimedia reference content can be replaced with a corresponding number of object elements in the second multimedia content to generate the first multimedia content. A positional feature is, for example, the position of the object elements within the multimedia content. In a non-limiting embodiment, based on the positional features of the object elements in the multimedia reference content and the second multimedia content, an object element in the multimedia reference content at a corresponding position can be replaced with an object element in the second multimedia content at a corresponding position to generate the first multimedia content. An attribute feature is, for example, attributes such as gender or biological category (e.g., species, genus). In a non-limiting embodiment, based on the attribute features of the object elements in the multimedia reference content and the second multimedia content, an object element in the multimedia reference content with a corresponding attribute can be replaced with an object element in the second multimedia content with a corresponding attribute to generate the first multimedia content. Posture features, such as the posture of object elements in multimedia content (e.g., standing, sitting, lying down, squatting, etc.), can be used to generate the first multimedia content by replacing object elements in the multimedia reference content with object elements in the second multimedia content that are in the corresponding posture based on the posture features of object elements in the multimedia reference content and the second multimedia content.

[0074] Figure 5A flowchart illustrating a method for generating multimedia content according to some embodiments of the present disclosure is shown. Figure 5 As shown, the multimedia content generation method of this embodiment may include steps S501 to S505. The method of this embodiment can be executed by an electronic device, such as a computer and / or a terminal device. It should be understood that the method of this embodiment can be executed at least partially on the client side and also partially on the server side.

[0075] In step S501, in response to a trigger request to generate first multimedia content based on multimedia reference content, a visual element operation mode is provided; in step S502, in response to the selection of the visual element operation mode, the first multimedia content is generated based on the visual element operation and the multimedia reference content; in step S503, in response to the trigger request, an additional operation mode is also provided; in step S504, in response to the selection of the additional operation mode, input prompt information from the user is obtained; in step S505, the first multimedia content is generated based on the input prompt information and the multimedia reference content.

[0076] It should be noted that the generation method of this embodiment is the same as... Figures 1 to 4 The related parts of the generation method introduced in this article can be found in the detailed content above, and will not be repeated here.

[0077] In the above embodiments, in addition to providing corresponding visual element operation methods, additional operation methods can also be provided for users to choose from, thereby improving the flexibility of generating multimedia content. This allows users to input prompt information based on multimedia reference content to control the details of the multimedia content to be generated, thus enabling the generation of more personalized multimedia content.

[0078] In this disclosure, input prompts from the user may include, but are not limited to, information entered by the user through specific interactive areas (such as feature selection pop-ups, text input boxes, option selection areas, etc.). Generally, the user's most recent active input better reflects their current needs, and multimedia content generated from it is more likely to meet their expectations.

[0079] In some embodiments, in response to the selection of the additional operation mode, the multimedia reference content can also be provided. Thus, when the user selects to generate subsequent multimedia content based on the additional operation mode, the user does not need to perform additional operations such as downloading or importing the multimedia reference content, which can improve the efficiency of multimedia content generation.

[0080] In some embodiments, in response to the trigger request, other operation methods different from the visual element operation methods and additional operation methods described above can also be provided. Further, in response to the selection of the other operation method, initial prompt information can be provided, wherein the multimedia reference content is generated based on the initial prompt information. Further, in response to a modification operation on the initial prompt information, modified initial prompt information is obtained, and the first multimedia content is generated based on the modified initial prompt information. Thus, the user can modify the initial prompt information used to generate the multimedia reference content to generate multimedia content that meets the user's expectations, improving creative flexibility. Additionally, in some embodiments, the multimedia reference content can also be generated based on the initial multimedia content, that is, the multimedia reference content is generated based on the initial multimedia content and the initial prompt information. In this case, after obtaining the modified initial prompt information, the first multimedia content can be generated based on the initial multimedia content and the modified initial prompt information.

[0081] Figure 6 A flowchart illustrating a method for generating multimedia content according to some embodiments of the present disclosure is shown. Figure 6 As shown, the multimedia content generation method of this embodiment may include steps S601 to S604. The method of this embodiment can be executed by an electronic device, such as a computer and / or a terminal device. It should be understood that the method of this embodiment can be executed at least partially on the client side and also partially on the server side.

[0082] In step S601, in response to a trigger request to generate first multimedia content based on multimedia reference content, a visual element operation mode is provided; in step S602, in response to the selection of the visual element operation mode, the first multimedia content is generated based on the visual element operation and the multimedia reference content; in step S603, after generating the first multimedia content, the first multimedia content is displayed; in step S604, in response to an approval operation for the first multimedia content, the first multimedia content is used as newly added multimedia reference content.

[0083] It should be noted that the generation method of this embodiment is the same as... Figures 1 to 5 The related parts of the generation method introduced in this article can be found in the detailed content above, and will not be repeated here.

[0084] In this embodiment of the present disclosure, by approving the currently generated and displayed first multimedia content, the first multimedia content is used as newly added multimedia reference content. This enriches the multimedia reference content and facilitates the generation of other multimedia content based on the newly added multimedia reference content. For example, after a user publishes the currently generated and displayed first multimedia content, other users can use the published first multimedia content as a template to generate multimedia content that meets their expectations. Therefore, the multimedia reference content can better meet the latest user needs, allowing users to obtain a richer experience with greater creative freedom.

[0085] In some embodiments, in response to the approval operation for the first multimedia content, the first multimedia content can be saved as newly added multimedia reference content to the corresponding multimedia reference content database, thereby enriching the multimedia reference content database and facilitating subsequent retrieval.

[0086] In some embodiments, the approval operation for the first multimedia content can be understood as the user performing an affirmative action with a clear intention to approve it. These affirmative actions may include, but are not limited to, the user publishing, adopting, saving, sharing, or indicating confirmation of the first multimedia content.

[0087] Figures 7 to 10 A schematic diagram of a display interface 10 according to some embodiments of the present disclosure is shown. It should be understood that... Figures 7 to 10 The displayed page can be the same as or a different display page in display interface 10. For example, Figure 7 The displayed page may be the first display page or a multimedia reference content page. Figure 8 The displayed page may be a secondary display page or an operation mode display page. Figure 9 The displayed page may be a third display page or an input display page. Figure 10 The displayed page shown could be a fourth display page or a result display page. It should be noted that the settings for display interface 10 are merely exemplary and not restrictive.

[0088] like Figure 7As shown, multimedia reference content is displayed in the display interface 10. In the illustrated embodiment, an information description area 11 for the multimedia reference content can also be displayed. This information description area 11 may display, for example, initial prompts for generating the multimedia reference content, and may also display initial multimedia content for user reference. In the illustrated embodiment, operation controls 12 for the multimedia reference content can be displayed in the display interface 10. Users can trigger, for example, by clicking or long-pressing the corresponding operation control 12, to trigger a content generation request or trigger request for generating the first multimedia content for the multimedia reference content. In the illustrated embodiment, other operation controls for the multimedia reference content can also be displayed in the display interface 10. Triggering these other operation controls can also activate other functions, which will not be elaborated further here.

[0089] like Figure 8 As shown, in response to the content generation request or trigger request, the illustrated display interface 10 can be implemented. Specifically, in response to the content generation request or trigger request, an operation mode selection area 13 can be provided or displayed, wherein the operation mode selection area 13 can provide or display one or more selectable operation modes. In the illustrated embodiment, the operation mode selection area 13 can provide or display visual element operation mode 131, additional operation mode 132, and other operation modes 133. It should be understood that... Figure 8 The operation modes provided or displayed in the operation mode selection area 13 are merely illustrative. In some embodiments, the operation mode selection area 13 may provide or display more or fewer operation modes. For example, multiple visual element operation modes 131 may be provided or displayed simultaneously, such as operation modes for text elements, operation modes for object elements, and operation modes for style elements. In some embodiments, the selected operation mode can be highlighted or blackened, for example. It should be understood that the selected operation mode can be highlighted in any way that distinguishes it from other unselected operation modes. In the illustrated embodiment, the display interface 10 may also display at least a portion of multimedia reference content, wherein the at least a portion of the multimedia reference content may be transparent or semi-transparent.

[0090] like Figure 9As shown, the display interface 10 may display an attachment area 14. In the illustrated embodiment, in response to the selection of a visual element operation mode or an additional operation mode, multimedia reference content can be provided in the attachment area 14. Furthermore, users can also upload corresponding second multimedia content that needs to be replaced, adjusted, or modified in the attachment area 14, so that multimedia content meeting their needs can be generated subsequently based on the various multimedia contents in the attachment area. It should be understood that in some embodiments, in response to the selection of the other operation mode, the multimedia reference content may not be provided in the attachment area 14, and when the multimedia reference content is generated based on the initial multimedia content, in response to the selection of the other operation mode, the initial multimedia content can be provided in the attachment area 14. In the illustrated embodiment, the display interface 10 may also display a user input area 15. In some embodiments of this disclosure, in response to the selection of a visual element operation mode, prompt information generated based on the visual element operation mode can be displayed or provided in the user input area 15; or, in response to the selection of other operation modes, initial prompt information for generating the multimedia reference content can be displayed or provided in the user input area 15. Furthermore, users can modify the prompts provided or displayed in the user input area 15, or they can input various forms of generation requirements in the user input area 15 so that corresponding prompts can be provided to the generation model subsequently. It should be understood that in some embodiments of this disclosure, prompts may not be displayed. Figure 9 The display interface 10 shown, for example, responds to Figure 8 When the visual element operation mode 131 shown is selected, it can display, as shown in the image. Figure 10 The generated results are displayed on the interface shown. Alternatively, in response to... Figure 8 When the visual element operation mode 131 shown is selected, it can request to obtain the second multimedia content, and after obtaining the second multimedia content, display as shown. Figure 10 The output results are shown in the interface.

[0091] like Figure 10 As shown, the generation result display page in the display interface 10 can display the first multimedia content that has been generated. This first multimedia content can be generated by calling a generation model based on, for example, the multimedia content and corresponding prompt information 16. In the illustrated embodiment, the generation result display page can also display multimedia reference content. Alternatively, in some embodiments, the generation result display page can display second multimedia content from the user and / or initial multimedia content used to generate the multimedia reference content. In the illustrated embodiment, the prompt information 16 can be, for example, content displayed by the user at a specific time. Figure 9The prompts entered or modified in the user input area 15, or for example, prompts automatically generated based on the user's selected visual operation method. It should be understood that... Figure 10 The generation result display page in the display interface 10 shown can also display other content. For example, it can also display an approval operation control (not shown), which can be configured to perform approval operations such as saving and sharing of the generated first multimedia content.

[0092] Figure 11 A block diagram of a multimedia content generation apparatus 6 according to some embodiments of the present disclosure is shown. The generation apparatus 6 can be configured to perform any of the embodiments of the methods described above. Figure 11 As shown, the generation device 6 may include: a providing module 61, configured to provide a visual element operation mode in response to a trigger request to generate first multimedia content based on multimedia reference content; and a multimedia content generation module 62, configured to generate the first multimedia content based on the visual element operation mode and the multimedia reference content.

[0093] In some embodiments, the providing module 61 may be configured to: in response to a trigger request to generate first multimedia content based on multimedia reference content, obtain classification information of the multimedia reference content; and provide the visual element operation method based on the classification information of the multimedia reference content.

[0094] In some embodiments, the generating apparatus 6 may include a determining module 63. The determining module 63 may be configured to: determine at least one visual element in the multimedia reference content; and determine the classification information of the multimedia reference content based on the determined at least one visual element according to a preset visual element priority.

[0095] In some embodiments, the determining module 63 may be configured to determine at least one visual element in the multimedia reference content before the providing module 61 provides a visual element operation mode in response to a trigger request to generate first multimedia content based on multimedia reference content; and to determine the classification information of the multimedia reference content based on the determined at least one visual element according to a preset visual element priority.

[0096] In some embodiments, the generating device 6 may include a prompt information generation module 64, configured to generate prompt information based on the visual element operation mode in response to the selection of the visual element operation mode; the multimedia content generation module may be configured to generate the first multimedia content based on the prompt information and the multimedia reference content.

[0097] In some embodiments, the prompt information generation module 64 may be configured to generate the prompt information indicating to operate on the visual elements in the multimedia reference content in response to the selection of the visual element operation mode.

[0098] In some embodiments, the prompt message generation module 64 may be configured to perform at least one of the following: in response to the selection of an operation mode for an object element, generating the prompt message indicating adjustment of the object element in the multimedia reference content; in response to the selection of an operation mode for a style element, generating the prompt message indicating migration of the style element in the multimedia reference content; in response to the selection of an operation mode for a text element, generating the prompt message indicating modification of the text element in the multimedia reference content.

[0099] In some embodiments, the generation device 6 may include an acquisition module (not shown). The acquisition module may be configured to: after the prompt information generation module 64 generates prompt information based on the visual element operation method, acquire modified prompt information in response to a modification operation on the prompt information. The multimedia content generation module 62 may be configured to: generate the first multimedia content based on the modified prompt information and the multimedia reference content.

[0100] In some embodiments, the acquisition module can be configured to acquire second multimedia content in response to the selection of the visual element operation mode. The multimedia content generation module 62 can be configured to generate the first multimedia content based on the visual element operation mode, the multimedia reference content, and the second multimedia content.

[0101] In some embodiments, the acquisition module may be configured to: acquire object features of a first object element for the multimedia reference content, and acquire object features of a second object element for the second multimedia content. The multimedia content generation module 62 may be configured to: generate the first multimedia content based on the object features of the first object element, the object features of the second object element, the multimedia reference content, the second multimedia content, and the visual element operation mode.

[0102] In some embodiments, the providing module 61 may be configured to provide additional operation methods in response to the trigger request. The obtaining module may be configured to obtain input prompt information from the user in response to the selection of the additional operation method. The multimedia content generation module 62 may be configured to generate the first multimedia content based on the input prompt information and the multimedia reference content.

[0103] In some embodiments, the generating apparatus 6 may include a display module (not shown) configured to display the first multimedia content after it has been generated. The determining module 63 may be configured to, in response to an approval operation on the first multimedia content, use the first multimedia content as newly added multimedia reference content.

[0104] The multimedia content generation apparatus provided in this disclosure guides users by offering selectable visual element operation methods based on multimedia reference content. This enables users to easily generate first multimedia content that meets their needs based on the user's selected visual element operation methods and the multimedia reference content, providing users with greater creative freedom, stimulating their creative enthusiasm, and enhancing user experience.

[0105] Figure 12 A block diagram of an electronic device 7 according to some embodiments of the present disclosure is shown. Figure 12 As shown, the electronic device 7 includes: at least one memory 71; and at least one processor 72 coupled to the at least one memory 71, the at least one processor 72 being configured to execute any of the embodiments of the above methods based on instructions stored in the at least one memory 71.

[0106] Memory 71 is used to store one or more computer-readable instructions. Memory 71 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Memory 111 may, for example, store operating systems, application programs, bootloaders, databases, and other programs, as well as various application programs and various data.

[0107] The processor 72 is configured to execute computer-readable instructions to implement the generation method described in any of the foregoing embodiments. Specific implementations of each step of the method can be found in the above embodiments; repeated details will not be elaborated upon here.

[0108] The electronic device 7 disclosed herein guides users by providing them with selectable visual element operation methods based on multimedia reference content. This enables users to easily generate first multimedia content that meets their needs based on the visual element operation methods selected by the user and the multimedia reference content, providing users with greater creative freedom, stimulating their creative enthusiasm, and improving user experience.

[0109] The processor 72 can be various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The central processing unit (CPU) can be based on x86 or ARM architectures, etc.

[0110] The processor 72 and the memory 71 can communicate with each other directly or indirectly. For example, the processor 72 and the memory 71 can communicate via a network. The network can include a wireless network, a wired network, and / or any combination of wireless and wired networks. The processor 72 and the memory 71 can also communicate with each other via a system bus, which is not limited in this disclosure.

[0111] It should be noted that Figure 12 The components of the electronic device 7 shown are merely exemplary and not limiting. The electronic device 7 may have other components depending on the specific application requirements. The processor 72 can control other components in the electronic device to perform desired functions.

[0112] Electronic device 7 can be implemented by software, firmware and / or hardware, and can be integrated into a device with the relevant application installed.

[0113] Figure 13 A block diagram of an electronic device 8 according to other embodiments of the present disclosure is shown. Figure 13 The electronic device 8 shown can be a computer system with a dedicated hardware structure, which can perform corresponding functions when the relevant application is installed.

[0114] In this disclosure, electronic devices (e.g., Figure 12 The electronic device shown is 7. Figure 13 The electronic devices shown 8) include, but are not limited to, mobile terminals such as smartphones, laptops, personal digital assistants (PDAs), tablet PCs, PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), wearable devices, etc., as well as fixed terminals such as digital televisions, desktop computers, etc.

[0115] like Figure 13As shown, the Central Processing Unit (CPU) 81 performs various processes based on a program stored in the Read-Only Memory (ROM) 82 or a program loaded from the Storage Section 88 into the Random Access Memory (RAM) 83. The RAM 83 stores data required as needed when the CPU 81 performs various processes, etc. The CPU is merely exemplary and can also be other types of processors, such as the various processors described above. The ROM 82, RAM 83, and Storage Section 88 can be various forms of computer-readable storage media. It should be noted that although the ROM 82, RAM 83, and Storage Section 88 are shown separately in the figure, one or more of them can be combined or located in the same or different memories or storage modules.

[0116] CPU 81, ROM 82, and RAM 83 are interconnected via bus 84. Input / output interface 85 is also connected to bus 84.

[0117] The following components are connected to the input / output interface 85: input section 86, such as a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output section 87, including displays such as cathode ray tube (CRT), liquid crystal display (LCD), speakers, vibrators, etc.; storage section 88, including hard disk, magnetic tape, etc.; and communication section 89, including network interface cards such as LAN cards, modems, etc. The communication section 89 allows communication processing to be performed via a network such as the Internet. It is readily understood that although some parts of the electronic device 8 shown in the figure communicate via bus 84, they can also communicate via a network or other means, wherein the network can include wireless networks, wired networks, and / or any combination of wireless and wired networks.

[0118] As needed, drive 810 is also connected to input / output interface 85. Removable media 811, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 810 as needed, so that computer programs read from them can be installed into storage section 88 as needed.

[0119] When the above series of processes are implemented with the help of software, the program constituting the software can be installed from a network such as the Internet or a storage medium such as a removable medium 811.

[0120] According to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product that, when run on a computer, causes the computer to implement the generation method described in any of the foregoing embodiments. The computer program product includes computer instructions carried on a computer-readable medium, containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer instructions can be downloaded and installed from a network via communication section 89, or installed from storage section 88, or installed from ROM 82. When the computer program is executed by CPU 81, the methods of embodiments of this disclosure are performed.

[0121] The above method guides users by providing them with selectable visual element operation methods based on multimedia reference content. This enables users to easily generate first multimedia content that meets their needs based on the selected visual element operation methods and the multimedia reference content, giving users greater creative freedom, stimulating their creative enthusiasm, and improving the user experience.

[0122] It should be noted that, in the context of this disclosure, a computer-readable medium can be a tangible medium that may contain or store programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0123] A computer-readable medium may be a computer-readable storage medium, a computer-readable signal medium, or any combination thereof.

[0124] Computer-readable storage media include, but are not limited to, systems, apparatuses, or devices that are electrical, magnetic, optical, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the generation method described in any of the foregoing embodiments.

[0125] The above method guides users by providing them with selectable visual element operation methods based on multimedia reference content. This enables users to easily generate first multimedia content that meets their needs based on the selected visual element operation methods and the multimedia reference content, giving users greater creative freedom, stimulating their creative enthusiasm, and improving the user experience.

[0126] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0127] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0128] In some embodiments, a computer program is also provided, comprising: instructions that, when executed by a processor, cause the processor to perform the generation method described in any of the foregoing embodiments. For example, the instructions may be embodied in computer program code.

[0129] In embodiments of this disclosure, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or it can be connected to an external computer (e.g., via an Internet service provider).

[0130] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0131] The functions described above can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0132] While specific embodiments of this disclosure have been described in detail with the aid of examples, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A method for generating multimedia content, comprising: In response to a trigger request to generate first multimedia content based on multimedia reference content, a method for manipulating visual elements is provided; In response to the selection of the visual element operation mode, the first multimedia content is generated based on the visual element operation mode and the multimedia reference content.

2. The generation method according to claim 1, wherein, The response to the trigger request to generate first multimedia content based on multimedia reference content provides the following visual element operation methods: In response to a trigger request to generate first multimedia content based on multimedia reference content, the classification information of the multimedia reference content is obtained. The visual element operation method is provided based on the classification information of the multimedia reference content.

3. The generation method according to claim 2, wherein, The process of obtaining the classification information of the multimedia reference content includes: Identify at least one visual element in the multimedia reference content; The classification information of the multimedia reference content is determined based on the at least one determined visual element according to the preset visual element priority.

4. The generation method according to claim 2, wherein, The generation method further includes: Before providing a visual element operation method in response to a trigger request to generate first multimedia content based on multimedia reference content, at least one visual element in the multimedia reference content is determined. The classification information of the multimedia reference content is determined based on the at least one determined visual element according to the preset visual element priority.

5. The generation method according to claim 1, wherein, The step of generating the first multimedia content based on the visual element operation mode and the multimedia reference content in response to the selection of the visual element operation mode includes: The system responds to the selection of the visual element operation mode and generates a prompt message based on the visual element operation mode. The first multimedia content is generated based on the prompt information and the multimedia reference content.

6. The generation method according to claim 5, wherein, The response to the selection of the visual element operation mode, generating a prompt message based on the visual element operation mode, includes at least one of the following: In response to the selection of an operation mode for an object element, a prompt message is generated instructing the object element in the multimedia reference content to be adjusted. In response to the selection of an operation mode for a style element, a prompt message is generated indicating that the style element in the multimedia reference content should be migrated. In response to the selection of an operation mode for a text element, a prompt message is generated instructing the text element in the multimedia reference content to be modified.

7. The generation method according to claim 5, wherein, The prompting information includes multiple sub-prompting messages for multiple visual elements in the multimedia reference content.

8. The generation method according to claim 5, wherein: The generation method further includes: after generating the prompt information based on the visual element operation mode, in response to the modification operation of the prompt information, obtaining the modified prompt information; The step of generating the first multimedia content based on the prompt information and the multimedia reference content includes: generating the first multimedia content based on the modified prompt information and the multimedia reference content.

9. The generation method according to claim 1, wherein: The generation method further includes: in response to the selection of the visual element operation mode, acquiring second multimedia content; The step of generating the first multimedia content based on the visual element operation method and the multimedia reference content includes: generating the first multimedia content based on the visual element operation method, the multimedia reference content, and the second multimedia content.

10. The generation method according to claim 9, wherein, The visual element manipulation method includes manipulation methods for object elements, and the generation of the first multimedia content based on the visual element manipulation method, the multimedia reference content, and the second multimedia content includes: Obtain object features for a first object element of the multimedia reference content, and obtain object features for a second object element of the second multimedia content; The first multimedia content is generated based on the object features of the first object element, the object features of the second object element, the multimedia reference content, the second multimedia content, and the visual element operation mode.

11. The generation method according to claim 10, wherein, The object features include at least one of the following: quantity features, location features, attribute features, and posture features of the object elements.

12. The generation method according to claim 1, wherein, The visual element manipulation methods include at least one of the following: Operation methods for object elements; Operation methods for style elements; Operation methods for text elements.

13. The generation method according to claim 1, wherein, The generation method further includes: In response to the trigger request, additional operation methods are also provided; In response to the selection of the additional operation mode, input prompt information from the user is obtained; The first multimedia content is generated based on the input prompt information and the multimedia reference content.

14. The generation method according to claim 1, wherein, The generation method further includes: After the first multimedia content is generated, the first multimedia content is displayed; In response to the approval operation for the first multimedia content, the first multimedia content is used as newly added multimedia reference content.

15. A multimedia content generation apparatus, comprising: The module is configured to provide a visual element manipulation method in response to a trigger request to generate first multimedia content based on multimedia reference content. The multimedia content generation module is configured to generate the first multimedia content based on the visual element operation method and the multimedia reference content.

16. An electronic device comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute the generation method as described in any one of claims 1 to 14 based on instructions stored in the memory.

17. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the generation method of any one of claims 1 to 14.

18. A computer program product, when run on a computer, causes the computer to perform the generation method according to any one of claims 1 to 14.

Images