Method, device and computer readable storage medium for generating interactive multimedia content

Abstract

The present disclosure relates to a method, device and computer readable storage medium for generating interactive multimedia content, and relates to the technical field of multimedia. The method for generating interactive multimedia content comprises: receiving user input content; displaying one or more plot nodes and logical relationships between the one or more plot nodes, the one or more plot nodes and the logical relationships being generated according to a processing result of a first generation model on the user input content; displaying plot content of at least one plot node, the plot content being generated according to a processing result of the first generation model on the one or more plot nodes and the logical relationships; and creating interactive multimedia content by using the plot content of the one or more plot nodes.

Description

Technical Field

[0001] This disclosure relates to the field of multimedia technology, and in particular to a method, apparatus and computer-readable storage medium for generating interactive multimedia content. Background Technology

[0002] Interactive multimedia content integrates various elements such as images, sound, and text, and provides an interactive interface for its viewers (or users). Examples of interactive multimedia content include games, interactive stories, and interactive movies, all based on a pre-defined storyline. Creators draw the visuals for each scene based on a pre-written script, or organize actors for filming. Programmers organize the artistic creations through coding and other means, and set up interactive interfaces at points where viewers need to interact with the interactive multimedia content to receive user input. Summary of the Invention

[0003] This summary section is provided to briefly introduce the concepts, which will be described in detail in the detailed description section below. This summary section is not intended to identify key or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] According to some embodiments of this disclosure, a method for generating interactive multimedia content is provided, comprising: receiving content input by a user; displaying one or more plot nodes and logical relationships between the one or more plot nodes, wherein the one or more plot nodes and logical relationships are generated based on the processing result of the user input content by a first generation model; displaying plot content of at least one plot node, wherein the plot content is generated based on the processing result of the one or more plot nodes and logical relationships by the first generation model; and creating interactive multimedia content using the plot content of the one or more plot nodes.

[0005] According to other embodiments of this disclosure, an apparatus for generating interactive multimedia content is provided, comprising: a receiving module configured to receive content input by a user; a first display module configured to display one or more plot nodes and logical relationships between the one or more plot nodes, wherein the one or more plot nodes and logical relationships are generated based on the processing result of the user input content by a first generation model; a second display module configured to display plot content of at least one plot node, wherein the plot content is generated based on the processing result of the one or more plot nodes and logical relationships by the first generation model; and a creation module configured to create interactive multimedia content using the plot content of the one or more plot nodes.

[0006] According to some embodiments of the present disclosure, an apparatus for generating interactive multimedia content is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to execute the method for generating interactive multimedia content according to any embodiment of the present disclosure based on instructions stored in the memory.

[0007] According to some embodiments of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, performs a method for generating interactive multimedia content according to any embodiment of the present disclosure.

[0008] Other features, aspects, and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0009] Preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The accompanying drawings, which are included to provide a further understanding of the present disclosure, and which, together with the following detailed description, are incorporated in and form a part of this specification and are used to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and are not intended to limit the scope of the disclosure.

[0010] In the attached diagram:

[0011] Figure 1 A flowchart illustrating a method for generating interactive multimedia content according to some embodiments of the present disclosure is shown.

[0012] Figure 2 A flowchart illustrating a method for generating plot nodes and plot content according to some embodiments of the present disclosure is shown.

[0013] Figure 3 A flowchart illustrating a method for generating multimedia resources according to some embodiments of the present disclosure is shown.

[0014] Figure 4 A schematic diagram of a user input interface according to some embodiments of the present disclosure is shown.

[0015] Figure 5 A schematic diagram of an input interface for setting information according to some embodiments of the present disclosure is shown.

[0016] Figure 6A and 6B A schematic diagram of a plot node according to some embodiments of the present disclosure is shown as an example.

[0017] Figure 7A and 7B Exemplary illustrations are shown of visual interfaces of plot nodes according to other embodiments of this disclosure.

[0018] Figure 8 A schematic diagram of the structure of an apparatus for generating interactive multimedia content according to some embodiments of the present disclosure is shown.

[0019] Figure 9 A schematic diagram of the structure of an electronic device according to some embodiments of the present disclosure is shown.

[0020] Figure 10 A schematic diagram of the structure of a computer system according to some embodiments of the present disclosure is shown.

[0021] It should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not necessarily drawn to actual scale. The same or similar reference numerals are used in the various drawings to denote the same or similar parts. Therefore, once an item is defined in one drawing, it may not be discussed further in subsequent drawings. Detailed Implementation

[0022] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. However, it is obvious that the described embodiments are only some embodiments of this disclosure, and not all embodiments. The following description of the embodiments is merely illustrative and is in no way intended to limit this disclosure or its application or use. It should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0023] It should be understood that the various steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of components and steps set forth in these embodiments should be interpreted as merely exemplary and do not limit the scope of this disclosure.

[0024] As used in this disclosure, the term "comprising" and its variations are open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to". Furthermore, as used in this disclosure, the term "including" and its variations are open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to". Therefore, "comprising" and "including" are synonymous. The term "based on" means "at least partially based on".

[0025] Throughout this specification, the terms "one embodiment," "some embodiments," or "embodiment" mean that a specific feature, structure, or characteristic described in connection with an embodiment is included in at least one embodiment of this disclosure. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Furthermore, the appearance of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout the specification does not necessarily refer to the same embodiment, but may refer to the same embodiment.

[0026] It should be noted that the concepts of "first," "second," etc., used in this disclosure are used only to distinguish different devices, modules, or units, and are not intended to define the order of functions performed by these devices, modules, or units or their interdependencies. Unless otherwise specified, the concepts of "first," "second," etc., are not intended to imply that the objects described herein must be in a given temporal, spatial, rank, or any other given order.

[0027] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0028] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0029] The embodiments of this disclosure are described in detail below with reference to the accompanying drawings; however, this disclosure is not limited to these specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Furthermore, in one or more embodiments, specific features, structures, or characteristics can be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.

[0030] It should be understood that this disclosure does not limit how the image to be applied / processed is obtained. In one embodiment of this disclosure, it can be obtained from a storage device, such as internal or external memory; in another embodiment, it can be captured by a camera component. It should be noted that the acquired image can be a single captured image or a frame from a captured video, and is not particularly limited to these methods.

[0031] In the context of this disclosure, "image" can refer to any of a variety of images, such as color images, grayscale images, etc. It should be noted that the type of image is not specifically limited in the context of this specification. Furthermore, an image can be any suitable image, such as a raw image obtained by a camera device, or an image from which specific processing has been performed, such as preliminary filtering, dealiasing, color adjustment, contrast adjustment, normalization, etc. It should be noted that preprocessing operations may also include other types of preprocessing operations known in the art, which will not be described in detail here.

[0032] Interactive multimedia content falls under the category of Professional Generated Content (PGC). Its creation process has a high barrier to entry and typically involves collaboration among professionals from multiple fields. For example, planners or screenwriters write scripts, artists create character and scene illustrations, and technicians organize these materials through coding and other operations to ultimately generate interactive multimedia content. The entire process requires a significant investment of time and manpower from all parties and has a high creative threshold.

[0033] Taking scriptwriting as an example, in the process of creating interactive multimedia content based on a storyline, in addition to determining the outline of the plot, creators also need to specify details, such as descriptions of scenes; descriptions of characters, including their appearance, clothing, actions, etc.; and dialogue, including the speech of non-player-controlled characters in the interactive multimedia content to the player (or viewer), or speech or choices that require player input. Some non-professional creators have excellent stories and interactive ideas, but lack experience in writing plot content and organizing plot content and multimedia resources into interactive multimedia content.

[0034] Therefore, interactive multimedia content is difficult to create in the form of user-generated content (UGC), and its generation efficiency is relatively low.

[0035] To improve the efficiency of generating interactive multimedia content, embodiments of this disclosure provide a method, apparatus, and computer-readable storage medium for generating interactive multimedia content.

[0036] Figure 1 A flowchart illustrating a method for generating interactive multimedia content according to some embodiments of the present disclosure is shown. This embodiment can be executed by a user device, such as a personal computer, mobile phone, tablet computer, wearable device, etc. Figure 1 As shown, the interactive multimedia content generation method of this embodiment includes steps S102 to S108.

[0037] In step S102, the user input is received.

[0038] User input includes key information about the interactive multimedia content the user wants to create; this key information can be considered the basic elements of the story of the interactive multimedia content. User input may include, for example, background information, character information, a brief summary of the main plot, etc.

[0039] For example, users can input a plot synopsis, which includes information they deem necessary for the story. This could include who the protagonist encounters after the story begins, what major events they experience, and the final outcome. Of course, this input can also include any other information the user deems relevant to the interactive multimedia content.

[0040] User input can include at least one of text and images. Users can directly input text or input text via voice or speech-to-text conversion. The text obtained through speech conversion can be displayed to the user for adjustment as needed. Images can be one or more, and can be still images, animated images, or images from video.

[0041] In step S104, one or more plot nodes and the logical relationships between them are displayed. The plot nodes and logical relationships are generated based on the processing results of the user input content by the first generation model.

[0042] After receiving user input, the content can be processed using a generative model to automatically generate and display one or more plot nodes and the logical relationships between them.

[0043] Generative models are used to output target content based on input information. The input information includes the processing criteria used by the generative model during the generation process, such as which information is referenced during the generation process and the requirements for the target output content. Generative models include, for example, models that generate text based on text or models that generate images based on images. The output of a generative model can include text, images, or a combination of both. Of course, the input or output of a generative model can also be data from other modalities, such as audio, video, or a combination of multiple data types. Generative models can be single-modal models, such as models that generate text from text (referred to as "text-to-text models") or models that generate images from images (referred to as "image-to-image models"); or, generative models can be cross-modal models, where the input and output belong to different modalities, such as models that generate images from text (referred to as "text-to-image models"); or, the input of a generative model can include multiple modalities, and the output can also include multiple modalities.

[0044] A plot node can be understood as a unit obtained by dividing a complete plot, with the content within each plot node closely connected. For example, a plot node unfolds around a scene or an event. The logical relationships between plot nodes can include sequential relationships, as well as sequential relationships under specified conditions, and so on. In some embodiments, interactive multimedia content may include one or more chapters, and each chapter may include one or more plot nodes.

[0045] One or more plot nodes and their logical relationships can be displayed in the visual editing interface of interactive multimedia content to facilitate user preview and editing.

[0046] In step S106, the plot content of at least one plot node is displayed. The plot content is generated based on the processing results of one or more plot nodes and logical relationships by the first generation model.

[0047] Plot content is a detailed description of the events that occur at a plot node. For example, plot content can be a script. Plot content includes dialogue, descriptions of scenes, descriptions of characters, and so on. After generating plot nodes and logical relationships, plot content for each plot node can be further generated based on this information.

[0048] In some embodiments, the plot content of each plot node includes one or more texts, which include at least one of the following: dialogue text of virtual characters, narration text, action description text, and alternative interaction text of players, each text being represented in a specified format.

[0049] A virtual character is a character within the story of interactive multimedia content; this can be a player-controlled character or a non-player-controlled character. The dialogue text of a virtual character refers to what the virtual character says within the interactive multimedia content. Narration text does not belong to any virtual character; it is used to describe the environment, transition between scenes, etc. Action description text describes the actions of the virtual character, such as "walk over," "laugh," etc. Player alternative interaction text provides options to the player, determining the next action or dialogue of the player-controlled character within the interactive multimedia content based on the player's choice. For example, in a scenario involving encountering an enemy, the alternative interaction text might be "fight" or "escape."

[0050] Here's an example of using different formats to represent different types of text. Narrative text begins and ends with a "#" symbol, action description text begins and ends with parentheses, and so on. This facilitates automatic machine recognition of different information types when generating interactive multimedia content, and also makes it easier for users to browse.

[0051] The plot content can be displayed in the visual editing interface of the interactive multimedia content. It can display the plot content of all plot nodes within the field of view at once, or it can display the plot content corresponding to the triggered plot node based on the user's triggering operation.

[0052] In step S108, interactive multimedia content is created using the plot content of one or more plot nodes. The created interactive multimedia content organizes materials corresponding to each plot node according to the logical relationship between plot nodes. The materials include the plot content of each plot node, and may also include images, audio, etc.

[0053] Since plot nodes, the logical relationships between plot nodes, plot content, and multimedia resources are all displayed in a specific way or have a specific data format, this information can be assembled for each type of data to ultimately generate interactive multimedia content.

[0054] The embodiments of this disclosure process user input to automatically generate plot nodes, logical relationships between plot nodes, and plot content, displaying them visually to the user. By expanding upon user input to generate the information needed for interactive multimedia content, the user's operations during the creation process are greatly reduced, thus improving the efficiency of interactive multimedia content creation. Furthermore, after generating the aforementioned information, it can be displayed to the user for preview or modification, improving the accuracy of the creation.

[0055] Furthermore, the embodiments of this disclosure reduce the creative experience requirements for creators of interactive multimedia content, that is, lower the threshold for creating interactive multimedia content, and enable more users to transform their ideas into actual interactive multimedia products through technical means.

[0056] Generative models can be used to generate plot nodes, logical relationships, and plot content. See below for reference. Figure 2 This describes an embodiment of the method for generating plot nodes and plot content disclosed herein.

[0057] Figure 2 A flowchart illustrating a method for generating plot nodes and plot content according to some embodiments of this disclosure is shown. Figure 2 As shown, the generation method in this embodiment includes steps S202 to S204. This generation step can be implemented on a user device, or the user device can send the information to be processed to other devices, such as a server, and obtain the processing results returned by the other devices.

[0058] In step S202, the user input and processing instructions are input into the first generation model, wherein the processing instructions include descriptive information of one or more processes to be performed on the first generation model.

[0059] The processing instructions are represented in a format that the first generative model can understand. The processing instructions can be preset, for example, derived from content in a template. Templates can correspond to different tasks. For example, the processing instructions in step S202 can come from a template corresponding to a generative task.

[0060] The first generative model is, for example, a text generation model or a multimodal generative model with text generation capabilities. The first generative model can be implemented based on machine learning models such as neural network models. In some embodiments, the first generative model can be a foundation model (also known as a large model). The foundation model is capable of understanding the input content and providing corresponding outputs. When using the foundation model for the above processing, the processing instructions can also be natural language, such as "Generate plot nodes based on the above plot synopsis, then generate the logical relationships between plot nodes, and then generate the plot content for each plot node."

[0061] In some embodiments, the processing instructions may further include the format of information output by the first generation model, wherein one or more plot nodes, logical relationships, and plot content of each node are output in different formats. For example, the processing instructions may also include "plot nodes are represented in the format of ..., logical relationships are represented in the format of ..., plot content is represented in the format of ...", so as to determine the information of each category according to the different formats and display the information of each category in the manner corresponding to that category.

[0062] The examples above are merely illustrative, and for ease of description, processing instructions are expressed in natural language. In practical applications, more detailed processing instructions can be set to enable the first generative model to output the generated content more accurately; or other forms of processing instructions can be used to adapt to various types of first generative models.

[0063] In some embodiments, the first generation model can sequentially output plot nodes, logical relationships between plot nodes, and plot content. For example, firstly, it obtains one or more plot nodes generated by the first generation model through processing user input; then, it obtains the logical relationships generated by the first generation model through processing user input and one or more nodes, i.e., the generation of logical relationships references user input and content generated in the previous step; finally, it obtains the plot content of each plot node generated by the first generation model through processing user input, one or more nodes, and logical relationships, i.e., the generation of plot content references user input and content generated in the previous two steps. By generating logical relationships after generating plot nodes and plot content after generating logical relationships, the logical relationships can reference global plot information, and the plot content can be generated according to reasonable logic. For example, when the plot involves multiple branches, by generating plot content by referencing logical relationships, the plot content in a certain branch will be closer to the theme of the current branch rather than closer to the themes of other branches.

[0064] The first generative model utilizes the content generated in each step to process the next step, making the generated content more reasonable and usable. For example, when processing using the base model, the base model can remember the previous inputs or outputs, so all the previous inputs or outputs can be used as a reference when outputting each piece of information. Therefore, it can output generated content based on more available information, making the generated results more comprehensive and accurate.

[0065] In step S204, the one or more plot nodes generated by the first generation model, the logical relationships, and the plot content of each plot node are obtained.

[0066] If the first generation model outputs plot nodes, logical relationships, and plot content all at once, this output can be obtained directly. If the first generation model outputs plot nodes, logical relationships, and plot content in multiple steps, the outputs from the multiple steps can be integrated.

[0067] The above embodiments can automatically break down and analyze user input based on artificial intelligence (AI), and automatically generate plot nodes and plot content. This allows for the efficient generation of interactive multimedia content based on the powerful computing capabilities and vast amounts of prior knowledge of AI. Therefore, it achieves efficient and professional plot expansion based on user input, lowers the barrier to entry for creating interactive multimedia content, and improves the efficiency of interactive multimedia content generation.

[0068] In addition to displaying plot nodes and their logical relationships, as well as the plot content, some embodiments may also display multimedia resources for at least one plot node. These multimedia resources serve to supplement the plot node description based on the plot content, allowing users to more intuitively understand the style of the current plot node. Multimedia resources may include, for example, at least one of scene images, character images, character voices, background music, and sound effects, and may further include other additional information.

[0069] Multimedia resources are generated based on the plot content of the aforementioned plot nodes. In addition, they can be generated by further referencing plot nodes and their logical relationships, setting information, etc. When generating multimedia resources for a specific plot node, besides referencing the plot content of that plot node, at least one of the plot content, story outline, scene setting, and character setting of other plot nodes can be referenced to provide richer reference information for the generation of multimedia resources. See below for reference. Figure 3 An exemplary embodiment of a method for generating multimedia resources is described.

[0070] Figure 3 A flowchart illustrating a method for generating multimedia resources according to some embodiments of the present disclosure is shown. Figure 3 As shown, the multimedia resource generation method of this embodiment includes steps S302 to S304. This generation step can be implemented on a user device, or the user device can send the information to be processed to other devices, such as a server, and obtain the processing results returned by the other devices.

[0071] In step S302, for each plot node, the visual content of the plot content of the plot node is extracted using the first generation model. The visual content can be visually related information in the plot content, such as descriptions of the environment, or characters' actions, clothing, expressions, etc. For example, the plot content of the plot node and the extraction instructions can be input into the first generation model; other reference information can also be input if necessary. An extraction instruction could be, for example, "Extract visual information from the above content and output it." Of course, as needed, the extraction instructions can also include other content or be expressed in other non-natural language ways.

[0072] In step S304, the visual content is processed using the second generation model to generate multimedia resources for the plot nodes.

[0073] The second generative model is a model used to generate multimedia resources. It can be implemented based on machine learning models such as neural networks. In some embodiments, the second generative model can be a base model. For example, for multimedia resources such as images, the second generative model can be an image generation model, such as a "text-to-image" model. Alternatively, the input to the second generative model can be multimodal, meaning it includes both text and images. This allows adjustments to the input image based on the input text to output an adjusted image. For example, the second generative model can be input with a basic concept image of interactive multimedia content, and then, based on the plot content of a certain plot point, it can further generate images of the scene at that plot point based on the concept image. Of course, the second generative model can also generate sound, video, etc., which will not be elaborated upon here.

[0074] When the second generative model processes data, in addition to the visual input, it can also input other content generated by the first generative model as supplementary reference. Furthermore, generation instructions can be input into the second generative model to help it understand the current processing task. Such instructions could be, for example, "Generate a portrait of each character and a scene concept map based on the above description." The second generative model can also be implemented based on the base model, with natural language as input and multimedia resources such as images, videos, and audio as output.

[0075] By automatically generating multimedia resources, the efficiency of generating interactive multimedia content can be further improved. Furthermore, since the multimedia resources are generated based on the existing storyline content, they can be more closely matched to the storyline.

[0076] The above embodiments can automatically generate multimedia resources matching the plot content based on artificial intelligence. This leverages the powerful computing capabilities and vast prior knowledge of AI to efficiently generate interactive multimedia content, further lowering the artistic creation threshold. Therefore, the above embodiments further reduce the creation threshold of interactive multimedia content and improve its generation efficiency.

[0077] After describing the generation method of the materials involved in the interactive multimedia content, the following further describes the specific implementation of the visualization content in some embodiments of this disclosure.

[0078] First, describe the visual content involved in the user input phase.

[0079] As described in the previous examples, plot nodes and plot content can be generated based on user input. The user input can include story background, character information, main plot details, and so on. Figure 4 A schematic diagram of a user input interface according to some embodiments of the present disclosure is shown. For example... Figure 4 As shown, input interface 4 includes one or more plot setting controls. Figure 4 The example illustrates setting controls corresponding to three plot points, including the ending. The input interface can include any number of setting controls as needed. For example, information about the entire story can be input into a single setting control without requiring the user to manually divide the plots. Taking setting control 41 corresponding to plot one as an example, setting control 41 can include a text input control 411 for users to input text. Additionally, it can include an image resource input control 412 for inputting images, videos, and other resources; or it can include an audio input control 413 for users to upload background music. Those skilled in the art will understand that... Figure 4 This is merely an exemplary interface. As needed, those skilled in the art can add, delete, or modify content in the user input interface 4.

[0080] In some embodiments, the system may also receive user-inputted setting information, which includes at least one of character settings, scene settings, and visual style settings. Therefore, the setting information can be referenced when generating plot content; that is, plot content can be generated based on the processing results of the first generation model on one or more plot nodes, the logical relationships, and the setting information. Character settings include descriptive information about virtual characters in the interactive multimedia content, such as character concept art, basic attributes, basic information, dialogue style, etc. Scene settings include descriptive information about scenes in the interactive multimedia content, such as outdoor geographical environment, time, weather, indoor decoration style, items, etc. Visual styles include, for example, comic book style, classical style, technological style, etc.

[0081] The settings information and the aforementioned user input can be entered through the same interface or control to improve user efficiency; alternatively, they can be entered through different interfaces or controls to more accurately distinguish between different types of input.

[0082] Figure 5 A schematic diagram of an input interface for setting information according to some embodiments of the present disclosure is shown. For example... Figure 5 As shown, the input interface 5 for setting information exemplarily illustrates a story background setting control 51 and a character setting control 52. The story background setting can be a description of the overall story, and can be more than... Figure 4The plot setting shown is more general. In the character setting control 52, one or more more specific setting controls can be set as needed. For example, any one or more of the following can be included: image setting control 521 for uploading character concept art, name setting control 522, gender setting control 523, basic setting control 524, dialogue style setting control 525, whether the character is player-controlled setting control 526, and voice acting selection control 527. Basic settings can include settings other than dialogue style, such as the character's personality, main experiences, and appearance description. Whether the character is player-controlled refers to whether the character is controlled by a player. One or more player-controlled characters can be set as needed. Some characters can also be set to be unplayer-controlled; for such characters, control 526 is not included in the character setting control 52, or control 526 is unavailable. Selecting voice acting refers to selecting the character's voice attributes or selecting audio for some fixed spoken lines. In addition, the setting interface 5 can also selectively include controls for scene setting and visual style setting, which will not be elaborated here.

[0083] The above embodiments of this disclosure, by receiving user-inputted setting information and generating story content based on it, can make the generated story content richer, more three-dimensional, and more closely meet the user's needs, thus further improving the generation efficiency of interactive multimedia content.

[0084] Next, we will describe the visualizations that are generated after user input to create story nodes.

[0085] After automatically generating the materials involved in the interactive multimedia content, their display method can be set as needed. In some embodiments, plot nodes and the logical relationships between them can be displayed in a more intuitive graphical format. For example, controls for one or more plot nodes and connectors between them can be displayed, with the style of the connector indicating the type of logical relationship between the plot nodes. The style of the plot node controls can also indicate the type of plot node, such as a normal node type, a branch node type, etc. Displaying them in a flowchart-like manner makes the plot nodes and their logical relationships clearer and facilitates user preview.

[0086] Figure 6A Exemplary illustrations are shown of visual interfaces representing plot nodes according to some embodiments of this disclosure. For example... Figure 6AAs shown, the story of this interactive multimedia content comprises multiple chapters. The left side of the visualization interface 6 displays a list of chapters, while the right side displays the plot nodes corresponding to the triggered chapter "Terrain Exploration" and their logical relationships (Figure 61). In Figure 61, "Previous Chapter" triggers the display of the visualization content corresponding to the previous chapter "Landing on Mars," and "Next Chapter" triggers the display of the visualization content corresponding to the next chapter "Discovering New Creatures." The other nodes in Figure 61 represent multiple plot nodes within that chapter. Thus, users can clearly understand the logical relationships between the various plot nodes.

[0087] In some embodiments, in response to a user's triggering action on a control of any one of a plurality of story nodes, the story content of the triggered story node is displayed. The triggering action may be, for example, a click action or other type of action. Figure 6A In the interface shown, in response to the user's trigger operation on node 611, the following can be displayed: Figure 6B The interface shown is as follows. In the visualization interface 6, a display control 62 is used to display the plot content corresponding to the plot node "Exploring the Mountains". The display control 62 may include a text description control 621 for the plot content, in which the narration text "After a long journey, everyone has finally reached the flat land" is marked with "#" on both sides, the action description text "pointing excitedly into the distance" and "tense" are marked with parentheses on both sides, the left side of the colon ":" indicates the character speaking or performing the action (such as NPC 1 or NPC 2), and the content to the right of the colon ":" that is not marked with parentheses indicates the character's dialogue content.

[0088] Of course, the method of displaying plot content based on trigger actions is not limited to... Figure 6B In the interface shown, any plot node displayed visually can have its plot content displayed in response to a control action on that node. Alternatively, the plot content of at least one plot node can be displayed by default without user intervention. For example, the plot content of all plot nodes within the visible area can be displayed.

[0089] After browsing the automatically generated story content, users can modify it. This modification can be done automatically based on the user's adjustment instructions or through manual editing by the user.

[0090] The automatic modification method can include: for any one of multiple plot nodes, receiving user adjustment instructions for the plot content of that plot node; displaying the adjusted plot content of the plot node, which is generated based on the processing results of the first generation model of the adjustment instructions and the original plot content. The adjustment instructions can be a description of the adjustments to be made, which is relatively broad, indicating which aspects need to be modified, and may not include specific adjustment details. For example, the adjustment instructions could be "NPC 1's language can be more lively," "Reduce NPC 2's actions," etc. This method can enrich the details of the modifications based on user instructions, thereby reducing the user's workload and improving modification efficiency. Users can input adjustment instructions through an adjustment instruction input control. In some embodiments, the first generation model can be used to process the adjustment instructions to generate the adjusted plot content. In addition to adjustment instructions, any one or more of the following can be input into the first generation model: the original plot content, one or more plot nodes, logical relationships between plot nodes, setting information, etc., thereby making the adjusted content more accurate.

[0091] Manual modification methods can include: for any one of multiple story nodes, in response to the user's editing operation on the story content of the story node, displaying the edited story content of the story node. For example, Figure 6B The text description control 621 shown can be editable, allowing users to more precisely adjust the plot content by performing editing operations (such as adding or deleting text, changing formatting, or formatting) within the text description control 621. This method offers high flexibility and accuracy.

[0092] Depending on the needs, users can combine the two modification methods mentioned above. For example, they can first use the automatic modification method for overall, large-scale adjustments, and then use the manual modification method to edit details. This can improve the overall efficiency of generating interactive multimedia content.

[0093] In some embodiments, in addition to the story content, in response to a user's triggering action on a control of any one of the multiple story nodes, multimedia resources of at least one story node are also displayed. For example... Figure 6B As shown, in response to the user triggering the story node 611, the display control 62 can simultaneously display the text description control 621, the scene image 622 of the story node 611, the character setting image 623 of the story node 611, and the background music "music1.mp3" used by the story node 611. The display control 62 may also include other content as needed, which will not be elaborated here. The controls corresponding to the multimedia resources, such as 622, 623, and 624, can also be triggerable, used to modify, delete, or replace the multimedia resources.

[0094] Similar to adjusting plot content, multimedia resources can also be adjusted automatically, in addition to manual adjustments. For example, it can receive user instructions to adjust multimedia resources for plot nodes; display the adjusted multimedia resources for the plot nodes, which are generated based on the adjustment instructions from the second generation model and the processing results of the multimedia resources before adjustment.

[0095] In addition to the aforementioned methods of automatically generating story nodes, some embodiments of this disclosure also support manual creation of story nodes by the user. In some embodiments, the system receives instructions from the user to create story nodes; it also receives the logical relationships between the created story nodes and other nodes configured by the user. For example, for story nodes represented in a flowchart format, the logical relationships between the created story nodes and other nodes can be configured by adding or modifying connectors. By supporting further manual adjustments by the user on top of automatic generation, the flexibility of interactive multimedia content generation is improved.

[0096] Figure 7A Exemplary illustrations are shown of visual interfaces for story nodes according to other embodiments of this disclosure. For example... Figure 7A As shown, in the visualization interface 7A, by triggering the creation control 71 for plot nodes, users can manually create plot nodes 72 and configure the logical relationship between plot node 72 and other nodes by adjusting the connecting lines in the interface. For example, users can move the arrow corresponding to option 1 to connect the newly created plot node 72 with the already created plot node 73, and trigger the plot content corresponding to plot node 72 when the user selects option 1. Plot node 73 can be automatically generated or manually created by the user. The visualization interface 74 can provide various creation controls so that users can create various types of nodes. For example, a condition node 75 can be created by triggering the creation control 74 for condition nodes. Condition nodes are used to determine the next plot node to advance based on the current state, such as the player's character's attack power.

[0097] Users can also further edit the plot content or other related information of a plot node by triggering it. For example, after the plot node "New Node" 72 is triggered, the editing control 76 corresponding to plot node 72 can be displayed. The editing control 76 may include an editing control 761 for plot content, a control 762 for uploading images (such as background images or character images), and a control 763 for uploading music.

[0098] After generating and editing the materials required for interactive multimedia content, you can perform the interactive multimedia content generation operation.

[0099] An exemplary generation method involves generating each frame of a storyline based on its content and multimedia resources for each storyline node. These frames are then stitched together to create multiple segments (e.g., video clips). Interactive interfaces are inserted between some adjacent segments based on the interactive information described in the storyline to receive user input, thus forming the segment corresponding to that storyline node. Finally, the segments corresponding to each storyline node are stitched together to generate interactive multimedia content.

[0100] Another exemplary generation method involves packaging plot nodes, the logical relationships between plot nodes, plot content, multimedia resources, and control logic to generate interactive multimedia content. The control logic is used to generate multimedia content fragments based on the processing results of the text generation model on the plot content of one or more plot nodes and the player's input of the interactive multimedia content. That is, this type of interactive multimedia content generates visuals in real time as the plot progresses and the player inputs. This control logic can determine the text and multimedia resources to be read or generated based on the current progress of the plot and the player's input, and then synthesizes and displays the read or generated content to the player. The control logic may include, for example, a calling interface for the basic model to flexibly provide feedback based on user input, which can even temporarily deviate from the original plot content. This provides the player with a better interactive experience.

[0101] Reference points below Figure 8 This describes an embodiment of the apparatus for generating interactive multimedia content disclosed herein.

[0102] Figure 8 A schematic diagram of the structure of an apparatus for generating interactive multimedia content according to some embodiments of the present disclosure is shown. For example... Figure 8 As shown, the interactive multimedia content generation apparatus 80 of this embodiment includes: a receiving module 801 configured to receive content input by a user; a first display module 802 configured to display one or more plot nodes and logical relationships between the one or more plot nodes, wherein the one or more plot nodes and logical relationships are generated based on the processing result of the user input content by a first generation model; a second display module 803 configured to display plot content of at least one plot node, wherein the plot content is generated based on the processing result of the one or more plot nodes and logical relationships by the first generation model; and a creation module 804 configured to create interactive multimedia content using the plot content of one or more plot nodes.

[0103] In some embodiments, the interactive multimedia content generation apparatus 80 further includes a generation module 805, configured to: input user input content and processing instructions into a first generation model, the processing instructions including descriptive information of one or more processes to be performed on the first generation model; and obtain one or more plot nodes, logical relationships, and plot content of each plot node generated by the first generation model.

[0104] In some embodiments, the generation module 805 is further configured to: obtain one or more plot nodes generated by the first generation model through processing the content; obtain logical relationships generated by the first generation model through processing the content and one or more nodes; and obtain the plot content of each plot node generated by the first generation model through processing the content, one or more nodes, and logical relationships.

[0105] In some embodiments, the processing instructions further include the format of information output by the first generation model, wherein one or more plot nodes, logical relationships, and plot content of each node are output in different formats.

[0106] In some embodiments, the second display module 803 is further configured to: display the plot content of the triggered plot node in response to a user's triggering operation on a control of any one of the multiple plot nodes.

[0107] In some embodiments, the interactive multimedia content generation apparatus 80 further includes an adjustment module 806, configured to: receive, for any one of a plurality of plot nodes, an adjustment instruction from a user regarding the plot content of the plot node; and display the adjusted plot content of the plot node, wherein the adjusted plot content is generated based on the processing result of the adjustment instruction and the plot content by the first generation model.

[0108] In some embodiments, the second display module 803 is further configured to: for any one of a plurality of plot nodes, in response to a user's editing operation on the plot content of the plot node, display the edited plot content of the plot node.

[0109] In some embodiments, the interactive multimedia content generation apparatus 80 further includes a third display module 807 configured to display multimedia resources of at least one story node, the multimedia resources being generated based on the story content of the story node.

[0110] In some embodiments, the interactive multimedia content generation apparatus 80 further includes a multimedia resource generation module 808, configured to: for each plot node, extract the visual content of the plot content of the plot node using a first generation model; process the visual content using a second generation model to generate multimedia resources for the plot node.

[0111] In some embodiments, multimedia resources include at least one of scene images, character images, character voices, background music, and sound effects.

[0112] In some embodiments, the interactive multimedia content generation apparatus 80 further includes a setting information receiving module 809, configured to: receive setting information input by a user, the setting information including at least one of character settings, scene settings, and visual style settings, and the plot content is generated based on the processing results of one or more plot nodes, logical relationships, and setting information by the first generation model.

[0113] In some embodiments, the interactive multimedia content generation apparatus 80 further includes a node creation module 810, configured to: receive a user's instruction to create a story node; and receive the logical relationship between the created story node and other nodes configured by the user.

[0114] In some embodiments, the first display module 802 is further configured to: display controls for one or more story nodes and connectors between one or more story nodes, wherein the style of the connectors is used to indicate the type of logical relationship between one or more story nodes.

[0115] In some embodiments, the user input includes at least one of text and images.

[0116] In some embodiments, the plot content of each plot node includes one or more texts, which include at least one of the following: dialogue text of virtual characters, narration text, action description text, and alternative interaction text of players, each text being represented in a specified format.

[0117] In some embodiments, the interactive multimedia content further includes control logic, which is used to generate multimedia content fragments based on the processing results of the first generation model on the plot content of one or more plot nodes and the player's input to the interactive multimedia content.

[0118] It should be noted that the above-described units are merely logical modules divided according to their specific functions, and are not intended to limit the specific implementation method. For example, they can be implemented in software, hardware, or a combination of both. In actual implementation, the above-described units can be implemented as independent physical entities, or they can be implemented by a single entity (e.g., a processor (CPU or DSP, etc.), integrated circuit, etc.). Furthermore, the units shown in the accompanying drawings with dashed lines indicate that these units may not actually exist, and the operations / functions they perform can be implemented by the processing circuitry itself.

[0119] In addition, although not shown, the device may also include a memory that can store various information generated by the device and its constituent units during operation, programs and data used for operation, data to be transmitted by the communication unit, etc. The memory can be volatile memory and / or non-volatile memory. For example, the memory may include, but is not limited to, random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Of course, the memory may also be located outside the device. Optionally, although not shown, the device may also include a communication unit that can be used to communicate with other devices. In one example, the communication unit can be implemented in a manner known in the art, such as including communication components such as antenna arrays and / or radio frequency links, various types of interfaces, communication units, etc. These will not be described in detail here. Furthermore, the device may also include other components not shown, such as radio frequency links, baseband processing units, network interfaces, processors, controllers, etc. These will not be described in detail here.

[0120] Some embodiments of this disclosure also provide an electronic device for implementing an apparatus for generating interactive multimedia content. Figure 9 A schematic diagram of the structure of an electronic device according to some embodiments of the present disclosure is shown. For example, in some embodiments, the electronic device 9 can be various types of devices, including but not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. For example, the electronic device 9 may include a display panel for displaying data and / or execution results utilized in the scheme according to the present disclosure. For example, the display panel can be of various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel. In addition, the display panel can be not only a planar panel, but also a curved panel, or even a spherical panel.

[0121] like Figure 9 As shown, the electronic device 9 of this embodiment includes a memory 91 and a processor 92 coupled to the memory 91. It should be noted that... Figure 9 The components of the electronic device 9 shown are merely exemplary and not limiting; the electronic device 9 may have other components as needed for the actual application. The processor 92 can control other components in the electronic device 9 to perform desired functions.

[0122] In some embodiments, memory 91 is used to store one or more computer-readable instructions. When processor 92 executes the computer-readable instructions, the computer-readable instructions are executed by processor 92 to implement the method according to any of the above embodiments. For specific implementations and related explanations of the various steps of the method, please refer to the above embodiments; repeated details will not be elaborated here.

[0123] For example, processor 92 and memory 91 can communicate with each other directly or indirectly. For example, processor 92 and memory 91 can communicate via a network. The network can include wireless networks, wired networks, and / or any combination of wireless and wired networks. Processor 92 and memory 91 can also communicate with each other via a system bus, which is not limited in this disclosure.

[0124] For example, processor 92 can be embodied in various suitable processors, processing devices, such as central processing unit (CPU), graphics processing unit (GPU), network processor (NP), etc.; it can also be digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The central processing unit (CPU) can be an x89 or ARM architecture, etc. For example, memory 91 can include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Memory 91 can include, for example, system memory, which stores, for example, the operating system, application programs, boot loader, database, and other programs. Various application programs and various data can also be stored in the storage medium.

[0125] Furthermore, according to some embodiments of this disclosure, various operations / processes according to this disclosure, when implemented via software and / or firmware, can be transmitted from a storage medium or network to a computer system with a dedicated hardware architecture, such as... Figure 10 The computer system 1000 shown is equipped with the programs that constitute the software. When various programs are installed, the computer system is able to perform various functions, including functions such as those described above. Figure 10 A schematic diagram of the structure of a computer system according to some embodiments of the present disclosure is shown.

[0126] exist Figure 10In this configuration, the Central Processing Unit (CPU) 1001 performs various processes based on programs stored in the Read-Only Memory (ROM) 1002 or loaded from the Storage Section 1008 into the Random Access Memory (RAM) 1003. The RAM 1003 also stores data required when the CPU 1001 performs various processes, etc. The CPU is merely exemplary; it can also be other types of processors, such as the various processors described above. The ROM 1002, RAM 1003, and Storage Section 1008 can be various forms of computer-readable storage media, as described below. It should be noted that although... Figure 10 The image shows ROM 1002, RAM 1003 and storage device 1008, but one or more of them may be combined or located in the same or different memory or storage modules.

[0127] CPU 1001, ROM 1002 and RAM 1003 are connected to each other via bus 1004. Input / output interface 1005 is also connected to bus 1004.

[0128] The following components are connected to the input / output interface 1005: input section 1006, such as a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output section 1007, including displays such as cathode ray tube (CRT), liquid crystal display (LCD), speakers, vibrators, etc.; storage section 1008, including hard disks, magnetic tapes, etc.; and communication section 1009, including network interface cards such as LAN cards, modems, etc. The communication section 1009 allows communication processing to be performed via a network such as the Internet. It is easy to understand that, although... Figure 10 The various devices or modules in the electronic device 1000 shown communicate via bus 1004, but they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of wireless and wired networks.

[0129] As needed, drive 1010 is also connected to input / output interface 1005. Removable media 1011, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 1010 as needed, so that computer programs read from them can be installed into storage section 1008 as needed.

[0130] When the above series of processes are implemented through software, the program constituting the software can be installed from a network such as the Internet or from a storage medium such as removable media 1011.

[0131] According to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 1009, or installed from a storage device 1008, or installed from a ROM 1002. When the computer program is executed by the CPU 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0132] It should be noted that, in the context of this disclosure, a computer-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, capable of transmitting, propagating, or transmitting a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0133] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0134] In some embodiments, a computer program is also provided, comprising: instructions that, when executed by a processor, cause the processor to perform the method of any of the above embodiments. For example, the instructions may be embodied in computer program code.

[0135] In embodiments of this disclosure, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0136] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0137] The modules, components, or units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules, components, or units do not necessarily constitute a limitation on the module, component, or unit itself.

[0138] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that can be used include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0139] According to some embodiments of this disclosure, a method for generating interactive multimedia content is provided, comprising:

[0140] Receive user input; display one or more plot nodes and the logical relationships between them, wherein the plot nodes and logical relationships are generated based on the processing results of the user input by the first generation model; display the plot content of at least one plot node, wherein the plot content is generated based on the processing results of the one or more plot nodes and logical relationships by the first generation model; and create interactive multimedia content using the plot content of one or more plot nodes.

[0141] In some embodiments, the method for generating interactive multimedia content further includes: inputting user input and processing instructions into a first generation model, wherein the processing instructions include descriptive information of one or more processes to be performed on the first generation model; and obtaining one or more plot nodes, logical relationships, and plot content of each plot node generated by the first generation model.

[0142] In some embodiments, obtaining one or more plot nodes, logical relationships, and plot content of each plot node generated by the first generation model includes: obtaining one or more plot nodes generated by the first generation model through processing the content; obtaining logical relationships generated by the first generation model through processing the content and one or more nodes; and obtaining plot content of each plot node generated by the first generation model through processing the content, one or more nodes, and logical relationships.

[0143] In some embodiments, the processing instructions further include the format of information output by the first generation model, wherein one or more plot nodes, logical relationships, and plot content of each node are output in different formats.

[0144] In some embodiments, displaying the plot content of at least one plot node includes: in response to a user's triggering operation on a control of any one of the multiple plot nodes, displaying the plot content of the triggered plot node.

[0145] In some embodiments, the method for generating interactive multimedia content further includes: for any one of a plurality of plot nodes, receiving user adjustment instructions for the plot content of the plot node; displaying the adjusted plot content of the plot node, wherein the adjusted plot content is generated based on the processing result of the adjustment instructions and the plot content by the first generation model.

[0146] In some embodiments, the method for generating interactive multimedia content further includes: for any one of a plurality of plot nodes, in response to a user's editing operation on the plot content of the plot node, displaying the edited plot content of the plot node.

[0147] In some embodiments, the method for generating interactive multimedia content further includes: displaying a multimedia resource of at least one story node, the multimedia resource being generated based on the story content of the story node.

[0148] In some embodiments, the method for generating interactive multimedia content further includes: for each plot node, using a first generation model to extract the visual content of the plot content of the plot node; and using a second generation model to process the visual content to generate multimedia resources for the plot node.

[0149] In some embodiments, multimedia resources include at least one of scene images, character images, character voices, background music, and sound effects.

[0150] In some embodiments, the method for generating interactive multimedia content further includes: receiving setting information input by a user, wherein the setting information includes at least one of character settings, scene settings, and visual style settings, and the plot content is generated based on the processing results of one or more plot nodes, logical relationships, and setting information by a first generation model.

[0151] In some embodiments, the method for generating interactive multimedia content further includes: receiving a user's instruction to create a story node; and receiving the logical relationship between the created story node and other nodes configured by the user.

[0152] In some embodiments, displaying one or more story nodes and the logical relationships between them includes: a control for displaying one or more story nodes and a connector between the one or more story nodes, the style of which is used to indicate the type of logical relationship between the one or more story nodes.

[0153] In some embodiments, the user input includes at least one of text and images.

[0154] In some embodiments, the plot content of each plot node includes one or more texts, which include at least one of the following: dialogue text of virtual characters, narration text, action description text, and alternative interaction text of players, each text being represented in a specified format.

[0155] In some embodiments, the interactive multimedia content further includes control logic, which is used to generate multimedia content fragments based on the processing results of the first generation model on the plot content of one or more plot nodes and the player's input to the interactive multimedia content.

[0156] According to some embodiments of this disclosure, an apparatus for generating interactive multimedia content is provided, comprising:

[0157] The receiving module is configured to receive user input; the first display module is configured to display one or more plot nodes and the logical relationships between them, wherein the plot nodes and logical relationships are generated based on the processing results of the user input by the first generation model; the second display module is configured to display the plot content of at least one plot node, wherein the plot content is generated based on the processing results of the one or more plot nodes and logical relationships by the first generation model; and the creation module is configured to create interactive multimedia content using the plot content of one or more plot nodes.

[0158] According to some embodiments of the present disclosure, an apparatus for generating interactive multimedia content is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to execute the method for generating interactive multimedia content according to any embodiment of the present disclosure based on instructions stored in the memory.

[0159] According to some embodiments of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements a method for generating interactive multimedia content according to any embodiment of the present disclosure.

[0160] According to some embodiments of the present disclosure, a machine program is provided, including: instructions that, when executed by a processor, cause the processor to perform a method for generating interactive multimedia content according to any embodiment of the present disclosure.

[0161] According to some embodiments of the present disclosure, a computer program product is provided, including instructions that, when executed by a processor, implement a method for generating interactive multimedia content according to any embodiment of the present disclosure.

[0162] The above description is merely an embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0163] Many specific details are set forth in the description provided herein. However, it is understood that embodiments of this disclosure may be practiced without these specific details. In other instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of the description.

[0164] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0165] While specific embodiments of this disclosure have been described in detail by way of example, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A method for generating interactive multimedia content, comprising: Receive user input; The display shows one or more generated plot nodes and the logical relationships between the one or more plot nodes, which are generated based on the processing results of the user input content by the first generation model; The plot content is generated as at least one plot node. The plot content is generated based on the processing results of the first generation model on the one or more plot nodes and the logical relationship. The plot content is used to describe the plot that occurs in the corresponding plot node. Using the story content of one or more story nodes, interactive multimedia content is created. The interactive multimedia content is configured to receive player input, wherein, in response to the player input, a multimedia content fragment is output. The multimedia content fragment is generated by a first generation model, which is configured to process the story content of the one or more story nodes and the player input to generate the multimedia content fragment.

2. The generation method according to claim 1 further includes: The user input and processing instructions are input into the first generation model, wherein the processing instructions include descriptive information of one or more processes to be performed on the first generation model; Obtain the one or more plot nodes generated by the first generation model, the logical relationships, and the plot content of each plot node.

3. The generation method according to claim 2, wherein, The step of obtaining the one or more plot nodes generated by the first generation model, the logical relationships, and the plot content of each plot node includes: Obtain the one or more story nodes generated by the first generation model through processing the content; Obtain the logical relationship generated by the first generation model through processing the content and the one or more nodes; Obtain the plot content of each plot node generated by the first generation model through processing the content, the one or more nodes, and the logical relationships.

4. The generation method according to claim 2, wherein, The processing instructions also include the format of the information output by the first generation model, wherein the one or more plot nodes, the logical relationships, and the plot content of each node are output in different formats.

5. The generation method according to claim 1, wherein, The plot content generated for at least one plot node includes: In response to the user's triggering operation on the control of any one of the multiple story nodes, the story content of the triggered story node is displayed.

6. The generation method according to any one of claims 1 to 5, further comprising: For any one of the multiple story nodes, receive the user's instruction to adjust the story content of the story node; The adjusted plot content of the plot node is displayed. The adjusted plot content is generated based on the processing results of the first generation model on the adjustment instruction information and the plot content.

7. The generation method according to any one of claims 1 to 5, further comprising: For any one of the multiple story nodes, in response to the user's editing operation on the story content of the story node, the edited story content of the story node is displayed.

8. The generation method according to claim 1, further comprising: Displaying a multimedia resource for at least one story node, the multimedia resource being generated based on the story content of the story node.

9. The generation method according to claim 8, further comprising: For each plot node, the visual content of the plot content of the plot node is extracted using the first generation model; The visual content is processed using a second generation model to generate multimedia resources for the plot nodes.

10. The generation method according to claim 8 or 9, wherein, The multimedia resources include at least one of scene images, character images, character voices, background music, and sound effects.

11. The generation method according to any one of claims 1 to 5, further comprising: The system receives user-inputted setting information, which includes at least one of character settings, scene settings, and visual style settings. The plot content is generated based on the processing results of the first generation model on one or more plot nodes, the logical relationships, and the setting information.

12. The generation method according to any one of claims 1 to 5, further comprising: Receive the user's instruction to create a story node; Receive the logical relationships between the user-configured and created story nodes and other nodes.

13. The generation method according to any one of claims 1 to 5, wherein, The one or more plot nodes generated by the display, and the logical relationships between the one or more plot nodes, include: Controls that display one or more story nodes and connectors between the one or more story nodes, the style of which indicates the type of logical relationship between the one or more story nodes.

14. The generation method according to any one of claims 1 to 5, wherein, The user input includes at least one of text and images.

15. The generation method according to any one of claims 1 to 5, wherein, The plot content of each plot node includes one or more types of text, which include at least one of the following: dialogue text of virtual characters, narration text, action description text, and alternative interaction text of players, with each type of text represented in a specified format.

16. The generation method according to any one of claims 1 to 5, wherein, The interactive multimedia content also includes control logic, which is used to generate multimedia content fragments based on the processing results of the first generation model on the plot content of the one or more plot nodes and the player's input of the interactive multimedia content.

17. An apparatus for generating interactive multimedia content, comprising: The receiving module is configured to receive user input. The first display module is configured to display one or more generated plot nodes and the logical relationships between the one or more plot nodes, wherein the one or more plot nodes and the logical relationships are generated based on the processing results of the user input content by the first generation model; The second display module is configured to display plot content generated for at least one plot node. The plot content is generated based on the processing results of the first generation model on the one or more plot nodes and the logical relationship. The plot content is used to describe the events that occur in the corresponding plot node. A creation module is configured to create interactive multimedia content using the story content of one or more story nodes. The interactive multimedia content is configured to receive player input, wherein, in response to the player input, a multimedia content fragment is output. The multimedia content fragment is generated by a first generation model, which is configured to process the story content of the one or more story nodes and the player input to generate the multimedia content fragment.

18. An apparatus for generating interactive multimedia content, comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute a method for generating interactive multimedia content as described in any one of claims 1 to 16, based on instructions stored in the memory.

19. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for generating interactive multimedia content according to any one of claims 1 to 16.

20. A computer program product, when run on a computer, causes the computer to implement the method for generating interactive multimedia content according to any one of claims 1 to 16.

Images