Interaction method and device for multimedia content, medium and program product

Abstract

The embodiment of the invention provides an interaction method and device for multimedia content, a storage medium and a computer program product. The method comprises the steps of displaying a dialogue interface used for generating multimedia content in response to a trigger operation; in response to the received request for generating the multimedia content, displaying a multimedia content outline associated with the multimedia content to be generated in the dialogue interface; and displaying the generated multimedia content based on a multimedia generation instruction, where the multimedia generation instruction indicates confirmation of a multimedia content outline or confirmation of an edited multimedia content outline in the dialogue interface. According to the method disclosed by the embodiment of the invention, the multimedia content outline can be provided for the user before the multimedia content is generated, and the user can edit the multimedia content outline through the user-friendly interaction interface so as to obtain the multimedia content meeting the personalized requirement, and the user experience is further improved.

Description

Technical Field

[0001] The present disclosure relates generally to the field of computers, and more particularly to an interactive method for multimedia content, an electronic device, a computer-readable storage medium, and a computer program product. Background Art

[0002] With the continuous development of artificial intelligence (AI) technology, its application scenarios are also constantly expanding and gradually covering various fields. For example, from smart homes to agriculture, from retail to manufacturing, the application of AI technology is affecting people's lives and work. In addition, AI technology is also widely used in various fields such as finance, education, transportation, and medical care, and has brought great impetus to social and economic development. Summary of the invention

[0003] According to an exemplary embodiment of the present disclosure, an interactive method for multimedia content, an electronic device, a computer storage medium, and a computer program product are provided.

[0004] In a first aspect of the present disclosure, a method for interacting with multimedia content is provided, comprising: in response to a trigger operation, displaying a dialogue interface for generating multimedia content; in response to receiving a request to generate multimedia content, displaying a multimedia content outline associated with the multimedia content to be generated in the dialogue interface; and based on a multimedia generation instruction, displaying the generated multimedia content, wherein the multimedia generation instruction indicates confirmation of the multimedia content outline or confirmation of the edited multimedia content outline in the dialogue interface.

[0005] In a second aspect of the present disclosure, an electronic device is provided, comprising: at least one processing unit; and at least one memory, wherein the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, and when the instructions are executed by the at least one processing unit, the electronic device executes the method described in the first aspect of the present disclosure.

[0006] In a third aspect of the present disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has machine-executable instructions stored thereon. When the machine-executable instructions are executed by a device, the device performs the method described in the first aspect of the present disclosure.

[0007] According to a fourth aspect of the present disclosure, a computer program product is provided, comprising computer executable instructions, wherein the computer executable instructions implement the method described according to the first aspect of the present disclosure when executed by a processor.

[0008] The invention summary is provided to introduce a series of concepts in a simplified form, which will be further described in the specific embodiments below. The invention summary is not intended to identify the key features or essential features of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easy to understand through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] Figure 1 A schematic diagram showing an example system in which embodiments of the present disclosure can be implemented;

[0011] Figure 2 A flowchart of an interactive method for multimedia content according to an embodiment of the present disclosure is shown;

[0012] Figure 3A-Figure 3F A schematic diagram showing an exemplary process for multimedia content interaction according to an embodiment of the present disclosure is shown;

[0013] Figures 4A-4D A schematic diagram showing an exemplary process of editing multimedia content in an editing interface for displaying text-type multimedia content according to an embodiment of the present disclosure;

[0014] Figures 5A-5D A schematic diagram showing an exemplary process of editing multimedia content in an editing interface for displaying image-type multimedia content according to an embodiment of the present disclosure;

[0015] Figures 6A-6E A schematic diagram showing an exemplary process of associating and displaying a portion to be associated in multimedia content with data information according to an embodiment of the present disclosure;

[0016] Figure 7 A schematic block diagram showing an example apparatus according to some embodiments of the present disclosure; and

[0017] Figure 8 A block diagram of an example device that may be used to implement embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0018] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for illustrative purposes and are not intended to limit the scope of protection of the present disclosure.

[0019] At present, artificial intelligence technology is applied to various application scenarios. With the continuous development of intelligent models and the continuous emergence of large-scale data sets, artificial intelligence technology has also made great progress in generating multimedia content (e.g., text, images, audio, etc.), and has brought many conveniences and innovations to people's work and life. While generating multimedia content that meets the requirements, using interactive operations to maximize the user's personalized needs and improve the user experience is also a hot topic in current research. Therefore, there is a need for a technical solution that can maximize the user's personalized needs and improve the user experience in the process of multimedia content generation through interactive operations.

[0020] In view of this, an embodiment of the present disclosure provides an interactive method for multimedia content. The method may include: in response to a trigger operation, displaying a dialogue interface for generating multimedia content; in response to receiving a request to generate multimedia content, displaying a multimedia content outline associated with the multimedia content to be generated in the dialogue interface; and based on a multimedia generation instruction, displaying the generated multimedia content, wherein the multimedia generation instruction indicates confirmation of the multimedia content outline or confirmation of the edited multimedia content outline in the dialogue interface. By adopting this method according to an embodiment of the present disclosure, a multimedia content outline can be provided to the user before the multimedia content is generated, and through a user-friendly interactive interface, the user can edit the multimedia content outline to obtain multimedia content that meets their personalized requirements and further improve the user experience.

[0021] The embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. The example environment 100 includes computing devices 110 and 120. The computing device 110 may be deployed with an intelligent model 112 (e.g., an artificial intelligence model such as a generative intelligent model), which may be trained to generate various contents, such as, but not limited to, multimedia contents, etc. Figure 11 and 12. The computing device 120 is also shown. In some embodiments, the computing device 120 communicates with the computing device 110 via a network 130. The network 130 may include a wired network, a wireless network, or a combination thereof, for providing communication between the computing device 120 and the computing device 110. In some embodiments, the computing device 120 may be connected to the computing device 110 via a data line, and the present disclosure does not limit the connection method between the computing device 110 and the computing device 120.

[0022] Computing devices 110 and 120 may include, but are not limited to, personal computers, server computers, handheld or laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players, etc.), multi-processor systems, consumer electronics, wearable electronic devices, smart home devices, minicomputers, mainframe computers, edge computing devices, distributed computing systems including any of the above systems or devices, etc.

[0023] The computing device 120 may be installed with an application (eg, a client program) for invoking the intelligent model 112 to generate multimedia content. Figure 1 Taking the system 100 in FIG. 1 as an example, the computing device 120 can communicate with the computing device 110 through the network 130, and send a request to generate multimedia content to the intelligent model 112 in the computing device 110. The intelligent model 112 in the computing device 110 can generate multimedia content in response to the request from the computing device 120 and provide the generated multimedia content to the computing device 120.

[0024] In some embodiments, the computing device 120 may display a dialogue interface for generating multimedia content in response to a trigger operation in an interface (e.g., a main interface) of an application. The computing device 120 may display a multimedia content outline associated with the multimedia content to be generated in the dialogue interface in response to receiving a request to generate multimedia content. In some embodiments, the computing device 120 may send a request to generate multimedia content to the computing device 110, so that the intelligent model 112 in the computing device 110 generates a multimedia content outline associated with the multimedia content based on the request to generate multimedia content. The computing device 110 may send the generated multimedia content outline to the computing device 120 for display in the dialogue interface of the computing device 120. The computing device 120 may also obtain and display the generated multimedia content based on a multimedia generation instruction, wherein the multimedia generation instruction indicates confirmation of the multimedia content outline displayed in the current dialogue interface or confirmation of the edited multimedia content outline in the current dialogue interface.

[0025] In some embodiments, the user of the computing device 120 can browse the multimedia content outline displayed in the dialogue interface and decide whether to perform an editing operation on the multimedia content outline in the current dialogue interface. If it is decided not to perform the editing operation, that is, the user believes that the currently generated multimedia content outline meets the requirements, the multimedia generation instruction can be triggered to generate the multimedia content. In addition, the user can also edit the multimedia content outline, and after the editing operation is completed and the multimedia content outline that meets the expectations is obtained, the multimedia generation instruction is triggered to trigger the generation of the multimedia content.

[0026] The computing device 120 may respond to the multimedia generation instruction and send an instruction to generate multimedia content to the computing device 110, so that the intelligent model 112 generates multimedia content based on the multimedia content outline confirmed by the user (the multimedia content outline after the editing operation or the multimedia content outline without the editing operation). The computing device 110 may send the generated multimedia content to the computing device 120 and display it in an interface of the computing device 120, such as a multimedia content editing interface.

[0027] It is understandable that although Figure 1 The intelligent model 112 is deployed in the computing device 110, but according to actual needs, the intelligent model 112 can be split into multiple sub-models, and each sub-model can be deployed in a corresponding computing device to achieve distributed deployment to support large-scale models. Accordingly, the corresponding computing device can respond to a request or command from the computing device 120, send the generated information to the computing device 120 and display it.

[0028] In addition, despite Figure 1 1 shows that the intelligent model 112 and the computing device 120 are deployed separately, but it is understandable that as the intelligent model 112 becomes lighter, the intelligent model 112 can also be deployed locally on the computing device 120, so as to respond to user requests more quickly and generate corresponding information. When the intelligent model 112 is deployed locally on the computing device 120, the corresponding multimedia content interaction method and combination Figure 1 The described process is similar, and those skilled in the art may refer to the above description for understanding, and for the sake of brevity, it will not be repeated here.

[0029] According to the interactive method for multimedia content of the embodiment of the present disclosure, a multimedia content outline can be provided to the user before the multimedia content is generated, and through a user-friendly interactive interface, the user can edit the multimedia content outline to obtain multimedia content that meets their personalized requirements and further enhance the user experience.

[0030] Combined with the above Figure 1A block diagram of an example environment 100 is depicted in which embodiments of the present disclosure can be implemented. Figure 2 An interactive method for multimedia content according to an embodiment of the present disclosure is described. Figure 2 FIG. 2 is a flowchart of a method 200 for interacting with multimedia content according to an embodiment of the present disclosure. The method 200 may be performed in Figure 1 It should be understood that the numbers in the flowchart of method 200 do not represent the order in which these steps are executed. Some or all of these steps can be executed in parallel, or the order of execution can be interchanged, and this is not limited by the present disclosure. Figure 2 The method 200 in the embodiment may also include additional steps not shown and / or may omit the steps shown, and the scope of the present disclosure is not limited in this respect.

[0031] In block 202, the computing device 120 may display a dialog interface for generating multimedia content in response to a trigger operation. In some embodiments, the computing device 120 may be installed with an application (e.g., a client program) that calls the intelligent model 112 to generate multimedia content, so that the interactive method for multimedia content according to the embodiments of the present disclosure may be executed.

[0032] In some embodiments, the computing device 120 may start an application and display a trigger control in an interface after the application is started (e.g., a startup interface or a main interface of the application). The user may start the trigger operation by clicking or touching the trigger control. For example, the trigger control may be a button control displayed in the current interface. Alternatively, the user may also start the trigger operation by means such as voice. The present disclosure does not limit the specific implementation of the trigger operation.

[0033] The computing device 120 may display a dialogue interface for generating multimedia content in response to a trigger operation from the user. The dialogue interface may include an input area and an information display area. The input area may receive input information from the user and transmit the input information to the intelligent model 112 in the computing device 110, so that the model 112 generates corresponding results based on the information input by the user and sends the results to the computing device 120. The computing device 120 may display the received results in the information display area for the convenience of user browsing.

[0034] In block 204 , the computing device 120 may display a multimedia content outline associated with the multimedia content to be generated in the dialog interface in response to receiving the request to generate the multimedia content.

[0035] In some embodiments, the computing device 120 may receive a request for generating multimedia content input into an input area in the dialog interface. In some embodiments, the request may include prompt information associated with the multimedia content to be generated. The prompt information may indicate the relevant content of the multimedia content to be generated (e.g., theme, etc.), the size of the information (for example, the number of words for text information; for example, the resolution size for image information), keywords in the content to be generated, application fields, etc.

[0036] The computing device 120 may display a multimedia content outline associated with the multimedia content to be generated in the dialogue interface in response to receiving a request to generate multimedia content. In some embodiments, the computing device 120 may send the received request to generate multimedia content to the intelligent model 112, so that the model 112 generates a multimedia content outline associated with the multimedia content based on the request. The computing device 120 may obtain the multimedia content outline generated by the model 112, and display the obtained multimedia content outline in the current dialogue interface. For example, the multimedia content outline may be displayed in the information display area in the dialogue interface to facilitate user browsing.

[0037] In some embodiments, the multimedia content outline can represent the structure of the multimedia content to be generated in the form of multiple levels and each level including at least one part. For example, a multimedia content outline including two levels, the first level including two parts and the second level including three parts indicates that the structure of the multimedia content is divided into two parts, and the first part has two sub-parts and the second part has three sub-parts. In addition, a brief introduction is provided for each level and each part in the corresponding level in the multimedia content outline, indicating the main content of the generated multimedia content in the corresponding part.

[0038] By displaying the multimedia content outline to the user in the dialogue interface, the user can understand the overview of the multimedia content to be generated before obtaining the generated multimedia content, thereby facilitating the user to determine in a later step whether the multimedia content outline needs to be adjusted to obtain multimedia content that better meets the requirements or needs.

[0039] In block 206, computing device 120 may display the generated multimedia content based on the multimedia generation instruction. In some embodiments, the multimedia generation instruction indicates confirmation of the multimedia content outline or confirmation of the edited multimedia content outline in the dialog interface.

[0040] In some embodiments, computing device 120 displays the multimedia content outline in, for example, an information display area in a dialog interface. The displayed multimedia content outline may be editable. In other words, computing device 120 may receive a user's editing operation on the multimedia content outline in the information display area in the dialog interface, and display the edited or adjusted multimedia content outline based on the received editing operation.

[0041] In some embodiments, the computing device 120 may send the received editing operation on the multimedia content outline to the intelligent model 112, so that the intelligent model 112 can adjust the multimedia content outline based on the user's editing operation. The computing device 120 may obtain the multimedia content outline adjusted by the intelligent model 112, and display the adjusted multimedia content outline in the information display area of ​​the dialogue interface. In some embodiments, the user may perform the editing operation on the multimedia content outline multiple times to obtain a multimedia outline that meets the requirements.

[0042] In some embodiments, the intelligent model 112 may further adjust its parameters based on the user's editing operation, so as to provide the user with generated content that better meets the user's requirements in the subsequent multimedia content generation process for the user.

[0043] In addition, in some embodiments, after the computing device 120 displays the generated multimedia content outline in box 204, the user browses the generated multimedia content outline and determines that the multimedia content outline currently displayed in the dialogue interface already meets his requirements, and the multimedia content outline does not need to be edited.

[0044] In some embodiments, when the user determines that the multimedia content outline after the editing operation or the multimedia content outline without the editing operation has met the requirements, the user can send a multimedia generation instruction to the computing device 120 by clicking or touching the control for generating multimedia. The computing device 120 can send the instruction to the intelligent model 112, so that the intelligent model 112 can generate corresponding multimedia content based on the multimedia content outline after the editing operation or without the editing operation. The computing device 120 (for example, an application installed in the computing device 120) can obtain the generated multimedia content from the intelligent model 112 and display the multimedia content.

[0045] In some embodiments, the levels of the generated multimedia content correspond to the levels of the outline, and the content in each level of the multimedia content is generated based on the corresponding introduction in the level of the outline. For example, taking the generated multimedia content as text content as an example, each part in each level of the text corresponds to each part in each level of the outline, and the content of each part in each level of the text is generated based on the introduction of each part in each level of the outline. Taking the generated multimedia content as video image content as an example, the video image can be divided into multiple levels according to the content dimension, and each part in each level of the video image corresponds to each part in each level of the outline, and the content of each part in each level of the video image is generated based on the introduction of each part in each level of the outline. For example, if the generated multimedia content is audio content, the audio content can be similarly divided into multiple levels according to the content dimension, and each part in each level of the audio corresponds to each part in each level of the outline, and the content of each part in each level of the audio is generated based on the introduction of each part in each level of the outline. In addition, the generated multimedia content may be matched with the multimedia content outline according to other dimensions, which is not limited in the present disclosure.

[0046] In some embodiments, in response to the received multimedia generation instruction, the computing device 120 can jump from the dialogue interface to the multimedia content editing interface, and display the acquired multimedia content in the multimedia content editing interface, so that the user can edit the multimedia content. In some embodiments, the generated multimedia content can include one or more of the following types: text, image or audio, and different types of multimedia content can be displayed in the corresponding types of multimedia content editing pages. For example, the multimedia content can include a document with text information, and accordingly, the generated document can be displayed in the document editing interface. The multimedia content can also include image content (e.g., static images or video images, etc.) with image information, and accordingly, the generated image content can be displayed in the image editing interface. The multimedia content can include multimedia content with audio information, and accordingly, the generated audio content can be displayed in the audio editing interface.

[0047] Therefore, according to the interactive method for multimedia content of the embodiment of the present disclosure, it is possible to provide the user with a multimedia content outline before generating the multimedia content, and through a user-friendly interactive interface, enable the user to edit the multimedia content outline to obtain multimedia content that meets their personalized requirements and further improve the user experience. For example, the user can edit the displayed multimedia content outline in the dialogue interface, and can also edit the generated multimedia content in the multimedia content editing page. By providing the user with a friendly interface for editable operations, the processing power of the intelligent model 112 can be fully utilized through interactive operations, so that content that meets user needs and personalized requirements can be provided during the content generation process, thereby further improving the user experience.

[0048] The following will be combined with the attached Figure 3A-Figure 3F Describes the interactive process for multimedia content. Figure 3A-Figure 3F A schematic diagram of an exemplary process for multimedia content interaction according to an embodiment of the present disclosure is shown in FIG. Figure 3A-Figure 3F FIG. 3 is a schematic diagram showing an interactive interface 300 of an application installed on a computing device 120 for calling an intelligent model 112 during the generation of multimedia content according to an embodiment of the present disclosure. It can be understood that Figure 3A-Figure 3F The interactive interface 300 is merely illustrative, and depending on the type of computing device 120 , the interactive interface 300 may be adapted to the corresponding type and displayed accordingly.

[0049] Figure 3A An interface diagram 300 is shown showing a dialog interface for generating multimedia content displayed by the computing device 120 based on a trigger operation. Figure 3A The interface diagram 300 in FIG. 3 may include a control area 310 and a dialog interface 320. The control area 310 displays multiple controls associated with the application "XXXX", such as a first control 3111, a second control 3112, and a third control 3113. Each control may be used to trigger a corresponding function in the application. For example, the first control 3111 may trigger the generation of multimedia content, the second control 3112 may trigger a search function, and the third control 3113 may trigger a translation function, etc. Although Figure 3A Three controls are shown in , but this is only exemplary. Depending on the type of function that the application can support, the number of controls can be different. In some embodiments, multiple controls can be displayed in the control area 310 by triggering the "new conversation" control 311 in the control area 310.

[0050] In addition, the control area 310 may also include a "recent conversation" control 313 for displaying historical conversation information and a favorites control 315. It is understandable that other types of controls may be provided in the control area 310 as required, and the present disclosure does not limit this.

[0051] In response to triggering the first control 3111 (for example, the first control 3111 corresponds to a function of generating multimedia content), the computing device 120 displays a dialogue interface 320 in the interface 300. The dialogue interface 320 may include an information display area 340 and an input area 360. Various information associated with the generation of multimedia content may be displayed in the information display area 340. The input area 360 includes a dialog box 362 for receiving information input by a user to further implement interaction with the user.

[0052] like Figure 3A As shown in , in response to the triggering operation on the first control 3111, the computing device 120 can determine that the function for generating multimedia content is activated. Accordingly, the computing device 120 displays the dialogue interface 320 in the interface 300. The computing device 120 can display prompt information for the user in the information display area 340 in the dialogue interface 320. The prompt information may include the type or style of the multimedia content to be generated in some embodiments to facilitate the user to select. Based on the user's selection of the type, the application can use the intelligent model 112 to generate and display multimedia content corresponding to the selected type for the user.

[0053] Figure 3B FIG. 3 is a schematic diagram showing that a request for generating multimedia content is received in the input area 360 in the dialogue interface 320. Figure 3B For example, the user selects the first type displayed in the information display area 340 and enters a request to generate multimedia content in the input area 360. In some embodiments, the request may include prompt information associated with the multimedia content to be generated. The prompt information may indicate the relevant content of the multimedia content to be generated (for example, the theme, etc.), the size of the information (for example, the number of words for text information; for example, the resolution size for image information), keywords, application fields, etc. Figure 3B The request information in may be "please generate multimedia content about field A, including keyword B, with a size of C".

[0054] In response to receiving Figure 3BIn response to a request for generating multimedia content inputted in the dialog, computing device 120 displays a multimedia content outline associated with the multimedia content to be generated in dialog interface 320. In some embodiments, the multimedia content outline is editable. That is, computing device 120 can receive an editing operation of the user on the multimedia content outline in dialog interface 320, and display the edited multimedia content outline.

[0055] Figure 3C and 3D 3 is a schematic diagram showing an editable multimedia content outline displayed in the dialogue interface 320 in response to receiving a request to generate multimedia content according to an embodiment of the present disclosure. Figure 3C 3 shows a first schematic diagram of a multimedia content outline being displayed in the interface 300. Figure 3C As can be seen in FIG. 3 , due to the limitation of the interface length, the dialogue interface 320 does not fully display the multimedia content outline. Therefore, the user can continuously display the multimedia content outline in the interface 320 by operating an input device such as a mouse. Figure 3D As shown in , the remainder of the multimedia outline is displayed in the dialogue interface 320 .

[0056] In some embodiments, the multimedia content outline may include multiple levels, each level may include multiple parts, and each part in each level includes at least one corresponding sub-part. Figure 3C and 3D For example, the multimedia content outline shown in the figure includes two levels, wherein the first level includes three parts: the first part 351, the second part 352 and the third part 353. The second level includes: the first sub-part and the second sub-part in the first part 351, the third sub-part, the fourth sub-part and the fifth sub-part in the second part 352, and the sixth sub-part in the third part 353. Figure 3C Only the third sub-portion of the second portion 352 is displayed, and Figure 3D The rest of the multimedia content outline is shown in . It is understood that Figure 3C and Figure 3D The multimedia content outline in the figure is only illustrative, and the intelligent model 112 can generate a multimedia content outline with different numbers of levels and corresponding parts and divided sub-parts in each level according to the prompt information of the multimedia content to be generated.

[0057] In some embodiments, the multimedia content outline is editable. Accordingly, the computing device 120 may display the edited multimedia content outline according to the editing operation performed by the user on the multimedia content outline in the dialogue interface 320. In some embodiments, the editing operation may include: adjusting at least a portion of the corresponding hierarchy (e.g., adding one or more new portions in the corresponding hierarchy; deleting one or more portions in the corresponding hierarchy; regenerating one or more new portions in the corresponding hierarchy); adjusting at least one sub-portion in the corresponding portion (e.g., including: adding one or more new sub-portions in the corresponding portion in the corresponding hierarchy; deleting one or more sub-portions in the corresponding portion targeted by the editing operation; regenerating one or more new sub-portions in the corresponding portion); sequentially adjusting multiple sub-portions in the corresponding portion targeted by the editing operation; setting the content size of the corresponding portion; instructing to generate an image in the corresponding portion, and displaying the attributes of the image to be generated in the corresponding portion, etc.

[0058] An exemplary implementation of editing a multimedia outline will be described below with reference to the accompanying drawings. Figure 3E A schematic interface diagram 300 is shown for adding a new part in a corresponding level according to an embodiment of the present disclosure. Figure 3D By clicking or touching the “Add part” control in the part 354 in the figure, the computing device 120 displays the dialog interface 320 after adding the new part 355, such as Figure 3E In the new section 355, a prompt message is displayed, prompting the user to enter a title for the section. In some embodiments, the computing device 120 sorts the subsections in the new section according to the generated multimedia content outline (e.g., the seventh subsection), and prompts the user to enter a title and introduction for the subsection. In addition, a control for setting the content size of the section may also be provided in the added section 355.

[0059] In addition, by setting a corresponding control, the computing device 120 can also delete one or more parts in the corresponding level in response to a user's triggering operation on the control. In some embodiments, by setting a corresponding control, the computing device 120 can also regenerate one or more new parts in the corresponding level in response to a user's triggering operation on the control.

[0060] In some embodiments, the editing operation on the multimedia content outline may also include adjusting at least one sub-section in the corresponding section, for example, adding a new sub-section to the corresponding section in the corresponding level. Figure 3C and Figure 3D Each section shown in FIG. 1 is provided with controls for adding subsections to the section, such as Figure 3Cand Figure 3D In response to clicking or triggering the add sub-section control, the computing device 120 may add a sub-section to the corresponding section and display prompt information for setting the sub-section. The present disclosure does not limit the specific implementation method.

[0061] In some embodiments, adjusting at least one sub-portion in the corresponding portion may also include deleting the sub-portion in the corresponding portion targeted by the editing operation. Figure 3C and Figure 3D Each section shown in FIG. 1 is provided with a control for deleting a subsection in the section, such as Figure 3C and Figure 3D In response to clicking or triggering the delete sub-part control, the computing device 120 may delete the pre-selected sub-part in the corresponding part.

[0062] In some embodiments, adjusting at least one sub-portion in the corresponding portion may also include regenerating one or more updated sub-portions in the portion targeted by the editing operation. Figure 3C and Figure 3D Each section shown in is provided with controls for regenerating subsections within that section. Figure 3C and Figure 3D In response to clicking or triggering the regenerate sub-section control "R", the computing device 120 may regenerate updated sub-sections in the corresponding section. In some embodiments, in response to triggering the regenerate sub-section control "R", the computing device 120 may send a request to regenerate the sub-sections in the section to the intelligent model 112, so that the model 112 regenerates the sub-sections of the section, and displays the regenerated sub-sections to the user via the computing device 120. In some embodiments, the regenerated sub-sections may have different numbers, titles, or introductions, etc., from the previous sub-sections.

[0063] In some embodiments, the editing operation on the multimedia content outline may also include sequentially adjusting multiple sub-sections in the section targeted by the editing operation. Figure 3C and Figure 3D Each section shown in FIG. 1 is provided with a control for sequentially adjusting the subsections in the section, such as Figure 3C and Figure 3D In response to clicking or triggering the sort sub-section control “O”, the computing device 120 may reorder all sub-sections of the section in the corresponding section and display the reordered sub-sections in the current section.

[0064] In some embodiments, the editing operation for the multimedia content outline may also include setting the content size in the corresponding part. The content size may have different measurement methods depending on the type of multimedia content. Taking text as an example, the content size may include the number of words in the text. Taking an image as an example, the content size may include the resolution of the image, etc. In some embodiments, the computing device 120 may provide a control for setting the corresponding content size to the user in each part. The computing device 120 may set the size of the multimedia content in the corresponding part in response to the user's control of the control. For example, the control is a sliding type control. In response to the user sliding the control in a first direction, the content size may be increased based on the currently set content size; in response to the user sliding the control in a second direction opposite to the first direction, the content size may be reduced based on the currently set content size. Other methods may also be used to adjust the content size in the corresponding part, which is not limited in the present disclosure.

[0065] In some embodiments, the editing operation performed on the multimedia content outline may also include: instructing to generate an image in the corresponding part, and further displaying the properties of the image to be generated in the corresponding part. In some embodiments, the corresponding part also provides a control for generating an image in the part. In response to receiving a trigger operation of the user on the control, the computing device 120 may display the properties of the image to be generated in the corresponding part. The properties may include, but are not limited to, a description of the image, the image size, etc. In some embodiments, the image may be generated by the intelligent model 112 based on the displayed property information. Figure 3F FIG. 3 is a schematic diagram of an interface 300 for instructing to generate an image in a corresponding part according to an embodiment of the present disclosure. Figure 3F As shown in , in response to receiving a trigger operation of a user on a generate image control (not shown) in the first part 351, the computing device 120 may display the properties of the image to be generated (e.g., the AI ​​image) in the image property information display area 3511 in the first part 351, such as Figure 3F "A designed black and white image" as shown in.

[0066] The above describes the editing operation of the multimedia content outline according to the embodiment of the present disclosure in combination with the accompanying drawings. It can be understood that the above editing operation is only illustrative, and corresponding editing operations can be set according to requirements, and the present disclosure does not limit this.

[0067] return Figure 3E , Figure 3E, a control 380 for generating multimedia content is shown. In some embodiments, after the user completes the editing operation on the multimedia content outline, the multimedia generation instruction can be issued by triggering the control 380 to start the generation of the multimedia content. In some embodiments, the computing device 120 can respond to the received multimedia generation instruction, obtain the multimedia content generated based on the edited multimedia content outline, and display the generated multimedia content. For example, the computing device 120 can send the received multimedia generation instruction to the intelligent model 112, obtain the multimedia content generated by the intelligent model 112 based on the edited multimedia content outline, and display the obtained multimedia content.

[0068] In some embodiments, when the multimedia content outline generated by the intelligent model 112 meets the user's requirements, the user may not edit the multimedia content outline, but directly obtain the generated multimedia content based on the generated multimedia content outline. Figure 3D As shown, users can modify the multimedia content without editing the multimedia content outline. Figure 3D The generated multimedia content control 380 displayed in the figure is clicked or touched to start the generation of multimedia content. The intelligent model 112 can generate multimedia content based on the unedited multimedia content outline. Accordingly, the computing device 120 can obtain the multimedia content generated by the intelligent model 112 and display the multimedia content.

[0069] In some embodiments, in addition to generating the multimedia content outline, the dialogue interface 320 may also provide a title recommendation 340 (eg, Figure 3C and Figure 3F In some embodiments, the title may also be edited.

[0070] like Figure 3D and Figure 3E As shown in , a modification control 374 may also be provided in the dialogue interface 320. The modification control 374 may be used to indicate further modification of the outline and / or title. For example, the modification control 374 may include a control indicating further increasing the length of the outline, changing the title recommendation, and further searching and updating the multimedia content outline.

[0071] In some embodiments, the intelligent model 112 may search for material information matching the prompt information in the request to generate the multimedia content in the material information set according to the request to generate the multimedia content, and generate a multimedia content outline based on the searched material information. The intelligent model 112 may also generate a multimedia content outline based on the request to generate the multimedia content. The computing device 120 may obtain a multimedia content outline generated based on the request or the searched material information.

[0072] In some embodiments, when the intelligent model 112 searches for material information, the intelligent model 112 may also provide the searched material information to the computing device 120, so that the computing device 120 may obtain material information related to the multimedia content to be generated. In some embodiments, the computing device 120 may display the title information of the obtained material information in the reference material area 370 of the dialogue interface 320. Figure 3E As shown in FIG. 1 , the reference material area 370 may be displayed adjacent to the multimedia content outline. The reference material area 370 displays the title of the material information associated with the multimedia content to be generated acquired by the computing device 120, such as Figure 3E In addition, the computing device 120 may also display various other information related to the corresponding reference material in the reference material area 370 to facilitate user browsing.

[0073] In some embodiments, the reference information displayed in the reference area 370 may also include information uploaded by the user. In some embodiments, the reference area 370 may also be provided with controls for updating the display of the reference information, such as controls for adding reference information and controls for deleting reference information. The computing device 120 may update and display the reference area in response to receiving an update operation for the reference area 370. For example, in response to an operation of adding reference information, the computing device 120 may display the title of the added reference information in the reference area 370; and in response to an operation of deleting reference information, the computing device 120 may display the title of the remaining reference information after deleting the title of the corresponding reference information in the reference area 370.

[0074] In some embodiments, the computing device 120 may display an updated reference material area 370. Furthermore, the computing device 120 may also send the updated reference material information to the intelligent model 112, so that the model 112 can update the multimedia content outline based on the updated reference material information. Accordingly, the computing device 120 may display an updated multimedia content outline.

[0075] In some embodiments, in response to the received multimedia generation instruction, the computing device 120 can jump from the dialogue interface 320 to the multimedia content editing interface, and the generated multimedia content is displayed in the multimedia content editing interface. In some embodiments, the type of the generated multimedia content may include one or more of the following types: text, image or audio, and accordingly, different types of multimedia content are correspondingly displayed in the corresponding type of multimedia content editing interface.

[0076] Figures 4A-4D A schematic diagram showing an exemplary process of editing multimedia content in an editing interface for displaying text-type multimedia content according to an embodiment of the present disclosure. Figure 4A In response to multimedia generation instructions, Figure 3E or Figure 3D Schematic diagram 400 after the dialogue interface 320 jumps to the text content editing interface 410. Figure 4A The interface 400 shown in FIG. 4 may include a multimedia content editing interface area 410 and a control area 420. The generated text content may be displayed in the multimedia content editing interface area 410, for example, according to Figure 3E or Figure 3D The text content generated by the multimedia content outline in the multimedia content editing interface 410 is displayed accordingly. The multimedia content title, the title of the first part, the title of the first sub-part, the title of the second sub-part, the title of the second part, the title of the third sub-part, etc. are displayed in the multimedia content editing interface 410. And under each sub-title, the corresponding text content is displayed. The structure of the generated text content corresponds to the hierarchy of the multimedia content outline previously generated.

[0077] like Figure 4A As shown, the interface 400 may also include a control area 420 for displaying various controls to facilitate user operations. Figure 4A The example in is used as an example for explanation. The control area 420 may include an "add part" control 430 for adding a corresponding part to the generated multimedia content to adjust the generated content. In addition, the control area 420 may also include controls such as adjusting the size of the multimedia content 452, changing the title of the multimedia content 454, and searching for related information 456. In some embodiments, the control area 420 may also include an input sub-area 462, similar to Figures 3A-3F The input area 362 is used to receive information input by the user and to start a new dialogue interface.

[0078] Understandably, Figure 4A The controls displayed in the control area 420 are only illustrative, and those skilled in the art may configure various types of other controls in the control area 420 as needed, and the present disclosure does not limit this.

[0079] In some embodiments, computing device 120 may display the adjusted multimedia content in response to an editing operation on the multimedia content received in multimedia content editing interface 410. In some embodiments, computing device 120 may determine a portion to be edited in the multimedia content in response to a selection operation on at least a portion of the multimedia content, and may also display the adjusted multimedia content in response to an editing operation on the portion to be edited.

[0080] Figure 4B A schematic diagram of selecting a portion to be edited in the multimedia content editing interface 410 is shown. The user can select the portion to be edited 411 by box selection. The portion to be edited can be highlighted to prompt the user. In addition, after determining the portion to be edited 411, the computing device 120 can further display an editing operation selection box 421 in the multimedia content editing interface 410 to provide the user with editing operations to be selected.

[0081] In some embodiments, in response to a user triggering operation on the edit operation selection box 421, the edit operation selection box 421 may be expanded into two parts: an instruction input box 422 and an operation selection box 424. The instruction selection box 422 may be used to receive instructions or search, inquiry, and other information input by the user. The operation selection box 424 lists various types of edit operations for the user to select.

[0082] Figure 4C A schematic diagram showing a display instruction input box 422 and an operation selection box 424 in response to a user triggering operation on an edit operation selection box 421 . Figure 4C The operations listed in the operation selection box 424 in are operations performed on the selected text content, and the editing operation may include at least one of the following items: continuing the part to be edited; expanding the part to be edited; abbreviating the part to be edited; polishing the part to be edited (for example, for the text content); generating a content extraction corresponding to the part to be edited based on the part to be edited (for example, summarizing the part to be edited); adjusting the tone of the part to be edited; translating the part to be edited; correcting the grammar of the part to be edited; or generating an image based on the part to be edited, etc. In addition, the operation selection box 424 may also include search and reference operations, as well as query operations, etc.

[0083] In some embodiments, the computing device 120 may send the editing operation (e.g., "expand") instruction selected by the user to the intelligent model 112, so that the intelligent model 112 can edit the part to be edited according to the editing operation instruction of the user. The intelligent model 112 may send the content after the editing operation to the computing device 120 for display.

[0084] In some embodiments, in response to the editing operation on the part to be edited, the computing device 120 may display the information after the editing operation in a pop-up box. In response to the triggering operation on the first control in the pop-up box, the computing device 120 may insert the information after the editing operation into the multimedia content or replace the part to be edited in the multimedia content.

[0085] by Figure 4C For example, in response to receiving the user's selection of the "expand" operation, the computing device 120 enters Figure 4D The interface in . Figure 4D The interface 400 after the part to be edited 411 is expanded is displayed. A pop-up box 428 is displayed in the interface 400, and the information after the editing operation (e.g., "expand") is displayed in the pop-up box 428. Various types of controls may be provided in the pop-up box 428, such as a "copy" control, a "regenerate" control, an "insert" control, and a "replace" control. In response to the user's selection of the corresponding control, the computing device 120 may process the information displayed in the pop-up box 428. For example, in response to the triggering operation of the "insert" control in the pop-up box 428, the computing device 120 may insert the information after the editing operation into the multimedia content (e.g., after the part to be edited 411). Alternatively, in response to the triggering operation of the "replace" control in the pop-up box 428, the computing device 120 may replace the part to be edited 411 in the multimedia content with the information after the editing operation.

[0086] In some embodiments, in response to the triggering operation on the second control in the pop-up box, the computing device 120 may re-execute the corresponding editing operation (i.e., the most recently selected editing operation) on the information displayed in the pop-up box. The computing device 120 may display the updated information after the re-editing operation in the pop-up box. Through this operation, the user may be provided with the convenience of re-executing the editing operation to obtain multimedia content that has been edited and meets the requirements more.

[0087] by Figure 4D For example, in response to the triggering operation of the "regenerate" control in the pop-up box 428, the computing device 120 can perform the "expand" operation on the part to be edited 411 again. For example, the computing device 120 can send the "expand" instruction to the intelligent model 112 again, so that the intelligent model 112 can edit the part to be edited again according to the instruction. The intelligent model 112 sends the content after the re-editing operation to the computing device 120 and displays it. Thus, the updated information after the re-editing operation is displayed in the pop-up box 428. The user can perform the above operation multiple times until the multimedia content that meets the requirements is obtained.

[0088] Combination of the above Figures 4A-4D An exemplary process for editing text content is described. It is understandable that multimedia content may include various types, and accordingly, the method according to the embodiment of the present disclosure may be used for other types of multimedia content, and the generated multimedia content may be edited in the corresponding multimedia content editing interface.

[0089] The following will be combined Figures 5A-5D Describes the process of editing image content. Figures 5A-5D A schematic diagram showing an exemplary process of editing multimedia content in an editing interface for displaying image-type multimedia content according to an embodiment of the present disclosure is shown. It can be understood that the principles of editing operations performed on various types of multimedia content are similar.

[0090] Figure 5A A multimedia content editing interface 510 is shown displaying multimedia content of an image type. Figure 5A The image types in include video images. Figure 5A Also shown is a control area 520, which is similar to Figures 4A-4D The control area 420 in the above combination can be referred to. Figures 4A-4D The description of understanding area 520 is not repeated here for the sake of brevity.

[0091] exist Figure 5A In some embodiments, the generated image content (e.g., video content) is displayed in a player 512 of a multimedia content editing interface 510. In some embodiments, the video image can be divided into multiple levels according to the content dimension, and each part in each level in the video image corresponds to each part in each level in a previously generated multimedia content outline, and the content of each part in each level in the video image is generated based on the introduction of each part in each level in the outline. In some embodiments, a timeline associated with the generated video content can also be displayed in the multimedia content editing interface 510 to display the playback progress. In addition, the timeline can also be used to select the part to be edited.

[0092] In some embodiments, the selection of video content can be made by operating the timeline. Figure 5B As shown in , a corresponding time period can be selected on the time axis, and the video clip corresponding to the time period is used as the part to be edited. Figure 5B In the example, the video segment corresponding to the time period 511 between the 20th second and the 30th second is selected as the portion to be edited. Figure 4BSimilarly, the part to be edited can be highlighted to prompt the user. In addition, after the part to be edited is determined, an edit operation selection box 521 can be further displayed in the multimedia content editing interface 510 to provide the user with selectable edit operations.

[0093] In some embodiments, in response to a user triggering operation on the edit operation selection box 521, the edit operation selection box 521 may be expanded into two parts: an instruction input box 522 and an operation selection box 524. The instruction selection box 522 is used to receive instructions or search, inquiry, and other information input by the user. The operation selection box 524 lists various operations for the user to select.

[0094] Figure 5C A schematic diagram showing a display instruction input box 522 and an operation selection box 524 in response to a user triggering operation on an edit operation selection box 521 . Figure 5C The editing operations listed in the operation selection box 524 in are operations performed on the image content, and the editing operations may include at least one of the following items: adjusting (including operations such as adding, modifying or deleting) the filter of the part to be edited; adjusting (including operations such as adding, modifying or deleting) the special effects of the part to be edited; adjusting the image characteristics of the part to be edited (such as resolution, brightness, texture, etc.); generating a content extraction corresponding to the part to be edited based on the part to be edited (for example, summarizing the part to be edited); adding corresponding text content or audio content to the part to be edited; adjusting the image style of the part to be edited (for example, adjusting to a comic style, an oil painting style, etc.), etc. In addition, the operation selection box 524 may also include search and reference operations, as well as query operations, etc.

[0095] In some embodiments, the computing device 120 may send the editing operation (e.g., "adjust filter") instruction selected by the user to the intelligent model 112, so that the intelligent model 112 can edit the part to be edited according to the editing operation instruction of the user. The intelligent model 112 may send the content after the editing operation to the computing device 120 for display.

[0096] In some embodiments, in response to the editing operation on the part to be edited, the computing device 120 may display the information after the editing operation in a pop-up box. In response to the triggering operation on the first control in the pop-up box, the computing device 120 may insert the information after the editing operation into the multimedia content or replace the part to be edited in the multimedia content.

[0097] by Figure 5C For example, in response to receiving the user's selection of the "filter" operation, the computing device 120 enters Figure 5D. In this interface, the interface after adjusting the filter of the part to be edited is displayed. A pop-up box 528 is displayed in the interface, and the pop-up box 528 displays the information after the editing operation (for example, "adjust filter"). Various types of controls may be provided in the pop-up box 528, such as a "copy" control, a "regenerate" control, an "insert" control, and a "replace" control. In response to the user's selection of the corresponding control, the computing device 120 may process the information displayed in the pop-up box 528. For example, in response to the triggering operation of the "insert" control in the pop-up box 528, the computing device 120 may insert the information after the editing operation into the multimedia content (for example, after the part to be edited). Alternatively, in response to the triggering operation of the "replace" control in the pop-up box 528, the computing device 120 may replace the part to be edited in the multimedia content with the information after the editing operation.

[0098] In some embodiments, in response to the triggering operation on the second control in the pop-up box 528, the computing device 120 may re-execute the corresponding editing operation (i.e., the most recently selected editing operation) on the information displayed in the pop-up box. The computing device 120 may display the updated information after the re-editing operation in the pop-up box. Through this operation, the user may be provided with the convenience of re-executing the editing operation to obtain the multimedia content that meets the requirements and has undergone the editing operation.

[0099] by Figure 5D For example, in response to the triggering operation of the "regenerate" control in the pop-up box 528, the computing device 120 can perform the "adjust filter" operation on the part to be edited again. For example, the computing device 120 can send the "adjust filter" instruction to the intelligent model 112 again, so that the intelligent model 112 can edit the part to be edited here according to the instruction. The intelligent model 112 sends the content after the re-editing operation to the computing device 120 and displays it. Thus, the updated information after the re-editing operation is displayed in the pop-up box 528. The user can perform the above operations multiple times until the multimedia content that meets the requirements is obtained.

[0100] Combination of the above Figures 4A-4D and Figures 5A-5D The editing operations performed on the text content and the image content are described separately. It is understandable that, according to the type of the generated multimedia content, the editing operation can be performed similarly as described above, and the editing operations on the audio content and the multimedia content including one or more types of audio type, text type and image type can be similarly understood with reference to the above description. For the sake of simplicity, it will not be repeated here.

[0101] In some embodiments, computing device 120 may associate one or more parts of the generated multimedia content with material information referenced in the process of generating the multimedia content, and display the associated material information in a reference material display area in the multimedia content editing interface.

[0102] Specifically, the computing device 120 may determine the portion to be associated in the multimedia content based on the user's first selection operation. The computing device 120 may further display candidate material information associated with the portion to be associated based on the received trigger identifier. In some embodiments, the computing device 120 may determine reference material information in the candidate material information to be displayed in association with the portion to be associated in response to the user's second selection operation on the candidate material information, and display the title information of the reference material information in the reference material display area of ​​the multimedia content editing interface. In some embodiments, the index of the title information of the reference material information in the reference material display area is the same as the index of the portion to be associated.

[0103] The following will schematically describe the schematic process of associating and displaying the to-be-associated part of the multimedia content with the data information with reference to the accompanying drawings. Figures 6A-6E A schematic diagram showing an exemplary process of associating and displaying a to-be-associated portion of multimedia content with data information according to an embodiment of the present disclosure.

[0104] exist Fig. 6A In the example, the computing device 120 may determine the portion to be associated in the multimedia content in response to the user's first selection operation (such as a cursor or other marker being located at a certain position in the multimedia content for more than a predetermined time threshold). Fig. 6A As shown in FIG. 1 , according to the indication of the cursor, the paragraph below the title of the second sub-part is the part to be associated.

[0105] In some embodiments, in response to determining the part to be associated, the computing device 120 may further display reference information such as the basis of the part to be associated through an information box 640 in the control area 620 .

[0106] The computing device 120 may also prompt the user to enter a specific identifier to browse the reference material information related to the part to be associated through prompt information around the part to be associated. In response to the received trigger identifier, the computing device 120 may display candidate material information associated with the part to be associated, such as Figure 6B As shown in . Figure 6B Reference information related to the part to be associated and its related description are shown.

[0107] In some embodiments, the computing device 120 may determine, in response to the user's second selection operation on the candidate profile information, reference profile information to be displayed in association with the to-be-associated portion in the candidate profile information. Figure 6C As shown in , the user selects the first reference material by a box selection operation. Thus, the computing device 120 can determine that the user desires to associate the first reference material with the part to be associated and display it.

[0108] The computing device 120 may display the title information of the reference information in the reference display area of ​​the multimedia content editing interface 610. In some embodiments, the index of the title information of the reference information in the reference display area is the same as the index of the part to be associated. Fig.6D As shown in , the part to be associated has an index "[1]". The information of the first reference material displayed in association with the part to be associated is displayed in Fig. 6E . Exemplarily, the first reference information may be displayed via a title and other related information associated with the information, and the index of the first reference information in the reference information display area is "[1]", which is the same as the index of the part to be associated.

[0109] Combination of the above Figures 6A-6E The description is about the information association and display of text content. It can be understood that for multimedia content such as images, audio, etc., the operation mode of associating and displaying the corresponding part to be associated with the reference material is the same as the combination Figures 6A-6E The process is similar to that in , and those skilled in the art can refer to the above description to understand it. For the sake of brevity, it will not be repeated here.

[0110] Figure 7 1 shows a schematic block diagram of an example device 700 according to some embodiments of the present disclosure. The device 700 may be implemented in software, hardware, or a combination of both. Figure 7 As shown, the device 700 includes a first display module 710 , a second display module 720 and a third display module 730 .

[0111] In some embodiments, the first display module 710 may display a dialog interface for generating multimedia content in response to a trigger operation. The second display module 720 may display a multimedia content outline associated with the multimedia content to be generated in the dialog interface in response to receiving a request to generate multimedia content. The third display module 730 may display the generated multimedia content based on the multimedia generation instruction. In some embodiments, the multimedia generation instruction indicates confirmation of the multimedia content outline or confirmation of the edited multimedia content outline in the dialog interface.

[0112] Figure 7 The device 700 can be used to achieve the above combination Figures 1 to 6E For the sake of brevity, the process will not be described in detail here.

[0113] The division of modules or units in the embodiments of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in the disclosed embodiments may be integrated into one unit, or may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0114] Figure 8 800 is a block diagram of an example device 800 that can be used to implement embodiments of the present disclosure. It should be understood that Figure 8 The device 800 shown is merely an example and should not constitute any limitation on the functionality and scope of the implementation described herein. Figure 1 The computing device 120 described above can be used to perform the above-described Figures 1 to 7 The process described.

[0115] like Figure 8 As shown, the device 800 is in the form of a general-purpose computing device. The components of the computing device 800 may include, but are not limited to, one or more processors or processing units 810, a memory 820, a storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processing unit 810 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 820. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to increase the parallel processing capabilities of the computing device 800.

[0116] The computing device 800 typically includes a plurality of computer storage media. Such media may be any available media accessible to the computing device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 820 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 830 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the computing device 800.

[0117] The computing device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 8 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 820 may include a computer program product 825 having one or more program modules that are configured to perform various methods or actions of various implementations of the present disclosure.

[0118] The communication unit 840 implements communication with other computing devices through a communication medium. Additionally, the functions of the components of the computing device 800 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the computing device 800 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0119] The input device 850 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 860 may be one or more output devices, such as a display, a speaker, a printer, etc. The computing device 800 may also communicate with one or more external devices (not shown) through the communication unit 840 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the computing device 800, or communicate with any device that allows the computing device 800 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0120] According to an example implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided, the computer program product is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is provided, on which a computer program is stored, and when the program is executed by a processor, the method described above is implemented.

[0121] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0122] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0123] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0124] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0125] The above descriptions of various implementations of the present disclosure are illustrative, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the marketplace, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for interacting with multimedia content, the method comprising: In response to a trigger operation, displaying a dialog interface for generating multimedia content; In response to receiving a request to generate multimedia content, displaying a multimedia content outline associated with the multimedia content to be generated in the dialogue interface; as well as Based on the multimedia generation instructions, display the generated multimedia content, The multimedia generation instruction indicates confirmation of the multimedia content outline or confirmation of the multimedia content outline edited in the dialogue interface.

2. The method according to claim 1, further comprising: In response to an editing operation on the multimedia content outline in the dialog interface, the edited multimedia content outline is displayed.

3. The method according to claim 2, wherein displaying the generated multimedia content based on the multimedia generation instruction comprises: In response to the received multimedia generation instruction, acquiring the multimedia content generated based on the edited multimedia content outline; as well as The multimedia content is displayed. The method according to claim 1 , wherein the request includes prompt information associated with the multimedia content to be generated.

5. The method according to claim 1, wherein the multimedia content outline includes multiple levels, each level includes at least one part, and wherein each of the at least one part includes at least one corresponding sub-part.

6. The method according to claim 5, further comprising: Displaying the edited multimedia content outline according to an editing operation performed on the multimedia content outline in the dialog interface, wherein the editing operation includes at least one of the following: adjusting at least a portion of the corresponding hierarchy; adjusting at least one sub-portion of the corresponding portion; Sequentially adjust multiple sub-parts in the corresponding part; Set the content size of the corresponding part; or It is instructed to generate an image in the corresponding part, and properties of the image to be generated are displayed in the corresponding part.

7. The method according to claim 1, further comprising: Acquiring data information related to the multimedia content to be generated; as well as The multimedia content outline generated based on at least one of the request or the profile information is obtained.

8. The method according to claim 7, further comprising: Displaying title information of the material information in the reference material area of ​​the dialogue interface; as well as In response to receiving an update operation for the reference material area, the reference material area is updated and displayed, wherein the update operation includes adding material information or deleting the material information, or both.

9. The method according to claim 1, further comprising: In response to the received multimedia generation instruction, the interface jumps from the dialogue interface to a multimedia content editing interface, wherein the generated multimedia content is displayed in the multimedia content editing interface.

10. The method according to claim 9, wherein the type of the multimedia content comprises one or more of the following types: text, image or audio, and wherein: Different types of multimedia content are displayed in corresponding types of multimedia content editing interfaces.

11. The method according to claim 1, further comprising: In response to a selection operation on at least a portion of the multimedia content, determining a portion of the multimedia content to be edited; as well as In response to an editing operation on the to-be-edited portion, the edited multimedia content is displayed.

12. The method according to claim 11, wherein the portion to be edited comprises a text portion, and wherein the editing operation on the portion to be edited comprises at least one of the following items: Continue writing the part to be edited; Expanding the part to be edited; abbreviating the part to be edited; Based on the part to be edited, generating a content extraction corresponding to the part to be edited; Adjusting the tone of the portion to be edited; Translating the part to be edited; Correct the grammar of the part to be edited; or An image is generated based on the portion to be edited.

13. The method according to claim 11, wherein the portion to be edited comprises an image portion, and wherein the editing operation on the portion to be edited comprises at least one of the following: Adjusting the filter of the portion to be edited; Adjusting the special effects of the part to be edited; adjusting the image characteristics of the portion to be edited; Based on the part to be edited, generating a content extraction corresponding to the part to be edited; Adding corresponding text content or audio content to the part to be edited; or Adjust the style of the portion to be edited.

14. The method according to claim 11, further comprising: In response to the editing operation on the to-be-edited portion, displaying information after the editing operation in a pop-up box; as well as In response to a triggering operation on a first control in the pop-up box, the information after the editing operation is inserted into the multimedia content or replaces the to-be-edited portion in the multimedia content.

15. The method according to claim 14, further comprising: In response to a triggering operation on a second control in the pop-up box, re-execute the corresponding editing operation on the information; as well as The updated information after the editing operation is displayed in the pop-up box.

16. The method according to claim 1, further comprising: Based on the user's first selection operation, determining a portion to be associated in the multimedia content; as well as Based on the received trigger identifier, candidate profile information associated with the to-be-associated part is displayed.

17. The method according to claim 16, wherein the generated multimedia content is displayed in a multimedia content editing interface, the method further comprising: In response to a second selection operation of the user on the candidate material information, determining reference material information in the candidate material information to be displayed in association with the to-be-associated portion; as well as Displaying title information of the reference material information in a reference material display area of ​​the multimedia content editing interface, The index of the title information of the reference material information in the reference material display area is the same as the index of the part to be associated.

18. An electronic device comprising: at least one processing unit; At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to any one of claims 1 to 17.

19. A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the method according to any one of claims 1 to 17 when executed by a processor.

20. A computer program product having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method according to any one of claims 1 to 17.

Images