Generation method and apparatus for interactive multimedia content, and computer-readable storage medium

Abstract

The present disclosure relates to the technical field of multimedia, and relates to a generation method and apparatus for interactive multimedia content, and a computer-readable storage medium. The generation method for interactive multimedia content comprises: receiving content input by a user; displaying one or more plot nodes and a logic relationship between the one or more plot nodes, wherein the one or more plot nodes and the logic relationship are generated on the basis of a processing result of a first generation model in respect of the content input by the user; displaying plot content of at least one plot node, wherein the plot content is generated on the basis of a processing result of the first generation model in respect of the one or more plot nodes and the logic relationship; and using the plot content of the one or more plot nodes to create interactive multimedia content.

Description

Method, device and computer-readable storage medium for generating interactive multimedia content

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on and claims priority to an application filed in China with application number 202311598800.3 and filing date November 27, 2023. The disclosed content of the Chinese application is hereby introduced as a whole into this application. Technical Field

[0003] The present disclosure relates to the field of multimedia technology, and in particular to a method and device for generating interactive multimedia content, and a computer-readable storage medium. Background Art

[0004] Interactive multimedia content is content that integrates multiple elements, such as images, sound, and text, and provides an interactive interface for its viewers (or users). Interactive multimedia content, such as games, interactive stories, and interactive movies, unfolds based on a pre-written plot. Creators draw scenes based on pre-written scripts or arrange actors for filming. Developers organize the artistic creations through code and other means, and provide interactive interfaces where viewers need to interact with the interactive multimedia content to receive user input.

[0005] Summary of the Invention

[0006] This summary is provided to briefly introduce concepts that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0007] According to some embodiments of the present disclosure, a method for generating interactive multimedia content is provided, comprising: receiving content input by a user; displaying one or more plot nodes, and logical relationships between the one or more plot nodes, wherein the one or more plot nodes and logical relationships are generated based on the processing results of the user input by a first generation model; displaying the plot content of at least one plot node, wherein the plot content is generated based on the processing results of the one or more plot nodes and logical relationships by the first generation model; and creating interactive multimedia content using the plot content of the one or more plot nodes.

[0008] According to other embodiments of the present disclosure, a device for generating interactive multimedia content is provided, comprising: a receiving module configured to receive content input by a user; a first display module configured to display one or more plot nodes, and logical relationships between the one or more plot nodes, wherein the one or more plot nodes and logical relationships are generated based on the processing results of the user input by a first generation model; a second display module configured to display the plot content of at least one plot node, wherein the plot content is generated based on the processing results of the one or more plot nodes and logical relationships by the first generation model; and a creation module configured to create interactive multimedia content using the plot content of the one or more plot nodes.

[0009] According to some embodiments of the present disclosure, a device for generating interactive multimedia content is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the method for generating interactive multimedia content of any embodiment of the present disclosure based on instructions stored in the memory.

[0010] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method for generating interactive multimedia content according to any embodiment of the present disclosure is performed.

[0011] According to some embodiments of the present disclosure, a computer program is provided, comprising: instructions, which, when executed by a processor, cause the processor to execute the method for generating interactive multimedia content according to any one of the embodiments of the present disclosure.

[0012] Other features, aspects and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings, together with the following detailed description, is included in this specification and forms a part of the specification to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation of the present disclosure. In the drawings:

[0014] FIG1 shows a schematic flow chart of a method for generating interactive multimedia content according to some embodiments of the present disclosure.

[0015] FIG2 shows a schematic flow chart of a method for generating plot nodes and plot content according to some embodiments of the present disclosure.

[0016] FIG3 shows a schematic flow chart of a method for generating multimedia resources according to some embodiments of the present disclosure.

[0017] FIG4 shows a schematic diagram of a user input interface according to some embodiments of the present disclosure.

[0018] FIG5 shows a schematic diagram of an input interface for setting information according to some embodiments of the present disclosure.

[0019] 6A and 6B exemplarily show schematic diagrams of visualization interfaces of plot nodes according to some embodiments of the present disclosure.

[0020] 7A and 7B exemplarily show schematic diagrams of visualization interfaces of plot nodes according to other embodiments of the present disclosure.

[0021] FIG8 shows a schematic structural diagram of an apparatus for generating interactive multimedia content according to some embodiments of the present disclosure.

[0022] FIG9 shows a schematic structural diagram of an electronic device according to some embodiments of the present disclosure.

[0023] FIG10 shows a schematic structural diagram of a computer system according to some embodiments of the present disclosure.

[0024] It should be understood that, for ease of description, the dimensions of the various parts shown in the drawings are not necessarily drawn to scale. The same or similar reference numerals are used throughout the drawings to indicate the same or similar parts. Therefore, once an item is defined in one drawing, it may not be discussed further in subsequent drawings. DETAILED DESCRIPTION

[0025] The following will be combined with the accompanying drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. However, it is obvious that the embodiments described are only some embodiments of the present disclosure, rather than all embodiments. The following description of the embodiments is actually only illustrative and is in no way intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein.

[0026] It should be understood that the various steps described in the method embodiments of the present disclosure can be performed in different orders and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values ​​of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.

[0027] As used in this disclosure, the term "include" and its variations are intended to be open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to." Furthermore, the term "comprise" and its variations are intended to be open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to." Therefore, "include" and "include" are synonymous. The term "based on" means "based, at least in part, on."

[0028] References throughout this specification to "one embodiment," "some embodiments," or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. For example, the term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment, but may.

[0029] It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this way must be in a given order in time, space, ranking or any other way. It should be noted that the modifications of "one" and "multiple" mentioned in this disclosure are illustrative and not restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "one or more".

[0030] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0031] The following detailed description of the embodiments of the present disclosure is provided in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. In addition, in one or more embodiments, specific features, structures, or characteristics may be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.

[0032] It should be understood that the present disclosure does not limit how the image to be applied / processed is obtained. In one embodiment of the present disclosure, the image can be obtained from a storage device, such as an internal memory or an external storage device. In another embodiment of the present disclosure, the image can be captured by mobilizing a camera assembly. It should be noted that the image obtained can be a captured image or a frame of a captured video, and is not particularly limited to this.

[0033] In the context of this disclosure, an image may refer to any of a variety of images, such as a color image, a grayscale image, and the like. It should be noted that, in the context of this specification, the type of image is not specifically limited. Furthermore, the image may be any suitable image, such as a raw image obtained by a camera, or an image that has undergone specific processing, such as preliminary filtering, anti-aliasing, color adjustment, contrast adjustment, normalization, and the like. It should be noted that preprocessing operations may also include other types of preprocessing operations known in the art, which will not be described in detail here.

[0034] Interactive multimedia content is a type of professionally generated content (PGC). Its creation process is challenging and typically involves collaboration among professionals from multiple fields. For example, planners or screenwriters write the script, artists draw the characters and scenes, and technicians organize these materials through code and other operations to ultimately produce interactive multimedia content. This entire process requires significant time and manpower from multiple parties, and has a high threshold for creation.

[0035] Taking script creation as an example, when creating interactive multimedia content based on a storyline, in addition to establishing a plot outline, the creator must also detail details, such as setting descriptions; character descriptions, including their appearance, clothing, and movements; and dialogue, including the speech provided by non-player-controlled characters in the interactive multimedia content to the player (or viewer), as well as speech or choices that require player input. Some non-professional creators have great story and interactive ideas, but lack experience in writing the storyline and organizing it and multimedia resources into interactive multimedia content.

[0036] Therefore, it is difficult to create interactive multimedia content in the form of user-generated content (UGC), and its generation efficiency is relatively low.

[0037] In order to improve the efficiency of generating interactive multimedia content, embodiments of the present disclosure provide a method, apparatus, and computer-readable storage medium for generating interactive multimedia content.

[0038] Figure 1 illustrates a flow chart of a method for generating interactive multimedia content according to some embodiments of the present disclosure. This embodiment can be executed by a user device, such as a personal computer, mobile phone, tablet computer, wearable device, etc. As shown in Figure 1 , the method for generating interactive multimedia content in this embodiment includes steps S102 to S108.

[0039] In step S102, content input by a user is received.

[0040] The content input by the user includes key information of the interactive multimedia content that the user wants to create, which can be regarded as the basic elements of the story of the interactive multimedia content. The content input by the user includes, for example, the story background, character information, a brief description of the main plot, etc.

[0041] For example, a user can enter a plot summary, which includes what the user considers essential information about the plot. For example, after the story begins, the protagonist encounters whom, what major events they experience, and what the final outcome is. Of course, this input can also include any other information the user considers relevant to the interactive multimedia content.

[0042] The content entered by the user may include at least one of text and images. The user may enter text directly, or through voice input and the speech-to-text function. The text generated by voice conversion may be displayed to the user for adjustment as needed. The number of images may be one or more, and the images may be static, dynamic, or from a video.

[0043] In step S104 , one or more plot nodes and the logical relationship between the one or more plot nodes are displayed, where the one or more plot nodes and the logical relationship are generated based on the result of processing the user input content by the first generation model.

[0044] After receiving the content input by the user, the generative model may be used to process the content to automatically generate and display one or more plot nodes and the logical relationship between one or more plot nodes.

[0045] Generative models are used to output target content based on input information. The input information includes the processing basis of the generative model during the generation process, such as the information referenced during the generation process and the requirements for the target output content. Generative models include, for example, models that generate content based on text or images, and the output of generative models can include text, images, or a combination of the two. Of course, the input or output of a generative model can also be data in other modalities, such as audio, video, or a combination of multiple types of data. A generative model can be a single-modality model, such as a model that generates text from text (referred to as a "text-to-text model") or a model that generates images from images (referred to as a "image-to-image model"). Alternatively, a generative model can be a cross-modal model, meaning its input and output belong to different modalities, such as a model that generates images from text (referred to as a "text-to-image model"). Alternatively, a generative model can have inputs from multiple modalities and outputs from multiple modalities.

[0046] Plot nodes can be understood as units obtained by dividing a complete plot, with the content within each plot node being closely related. For example, a plot node is developed for a scene or an event. The logical relationships between plot nodes may include sequential relationships, sequential relationships when specified conditions are met, and so on. In some embodiments, the interactive multimedia content may include one or more chapters, and each chapter may include one or more plot nodes.

[0047] One or more plot nodes and their logical relationships can be displayed in a visual editing interface of the interactive multimedia content to facilitate user preview and editing.

[0048] In step S106 , the plot content of at least one plot node is displayed, where the plot content is generated based on the processing result of the first generation model on one or more plot nodes and logical relationships.

[0049] Plot content is a detailed description of the events occurring at a plot node. For example, plot content could be a script. Plot content includes dialogue, scene descriptions, character descriptions, and more. After generating plot nodes and logical relationships, plot content for each plot node can be generated based on this information.

[0050] In some embodiments, the plot content of each plot node includes one or more texts, including at least one of the virtual character's dialogue text, narration text, action description text, and player's alternative interaction text, and each text is expressed in a specified format.

[0051] A virtual character refers to a character in the story of interactive multimedia content, which can be a player-controlled character or a non-player-controlled character. The dialogue text of a virtual character refers to the words spoken by the virtual character in the interactive multimedia content. Narration text does not belong to any virtual character and is used to describe the environment, transition plots, etc. Action description text is used by the user to describe the actions of the virtual character, such as "walk over" and "laugh". The player's alternative interaction text is used to provide players with options so that the next action or words spoken by the player-controlled character in the interactive multimedia content can be determined based on the player's choice. For example, for a plot where an enemy is encountered, the alternative interaction text can be "start a fight" and "escape."

[0052] The following is an example of using different formats to represent different types of text. Narration text begins and ends with a "#" mark, while action description text begins and ends with brackets. This facilitates automatic machine recognition of different types of information when generating interactive multimedia content, while also making it easier for users to browse.

[0053] The plot content can be displayed in the interactive multimedia content visual editing interface. It can display the plot content of all plot nodes within the field of view at once, or it can display the plot content corresponding to the triggered plot node when the user triggers the plot node.

[0054] In step S108, interactive multimedia content is created using the plot content of one or more plot nodes. The created interactive multimedia content is organized into materials corresponding to each plot node based on the logical relationship between the plot nodes. The materials include the plot content of each plot node and may also include images, audio, etc.

[0055] Since plot nodes, logical relationships between plot nodes, plot content, and multimedia resources are all displayed in a specific way or have a specific data format, this information can be assembled for each type of data to ultimately complete the generation of interactive multimedia content.

[0056] The disclosed embodiments automatically generate plot nodes, logical relationships between plot nodes, and plot content by processing user input, and displaying them visually to the user. By expanding and generating the information required for interactive multimedia content based on user input, the user's creation process is significantly reduced, thereby improving the efficiency of creating interactive multimedia content. Furthermore, after generating this information, it can be displayed to the user for easy preview or modification, thereby improving the accuracy of the creation process.

[0057] Furthermore, the embodiments of the present disclosure lower the requirements for creative experience of creators of interactive multimedia content, that is, lower the threshold for creating interactive multimedia content, and can use technical means to enable more users to convert their creativity into actual interactive multimedia products.

[0058] When generating plot nodes, logical relationships, and plot content, a generative model can be used. An embodiment of a method for generating plot nodes and plot content disclosed herein will be described below with reference to FIG2 .

[0059] Figure 2 illustrates a flowchart of a method for generating plot nodes and plot content according to some embodiments of the present disclosure. As shown in Figure 2, the generation method of this embodiment includes steps S202 through S204. These generation steps can be implemented on a user device, or the user device can send the information to be processed to another device, such as a server, and receive the processing results returned by the other device.

[0060] In step S202, the content input by the user and the processing instructions are input into the first generation model, where the processing instructions include description information of one or more processes to be performed by the first generation model.

[0061] The processing instructions are expressed in a format that the first generation model can understand. The processing instructions can be preset, for example, from content in a template. Templates can correspond to different tasks. For example, the processing instructions in step S202 can be from a template corresponding to the generation task.

[0062] The first generation model is, for example, a text generation model, or a multimodal generation model with a text generation function. The first generation model can be implemented based on a machine learning model such as a neural network model. In some embodiments, the first generation model can be a foundation model (also known as a large model). The foundation model can understand the input content and give corresponding outputs. When the foundation model is used to perform the above-mentioned processing, the processing instructions can also be natural language, such as "generate plot nodes based on the above-mentioned plot summary, then generate the logical relationship between the plot nodes, and then generate the plot content of each plot node."

[0063] In some embodiments, the processing instructions further include the format of the information output by the first generation model, wherein one or more plot nodes, logical relationships, and the plot content of each node are output in different formats. For example, the processing instructions may include "plot nodes are represented in the format of...", logical relationships are represented in the format of...", and plot content is represented in the format of...", so that each category of information is determined according to different formats and displayed in a manner corresponding to that category.

[0064] The above examples are merely illustrative, and for ease of description, processing instructions are expressed in natural language. In actual applications, more comprehensive processing instructions can be provided to enable the first generation model to more accurately output generated content; or other forms of processing instructions can be used to accommodate various types of first generation models.

[0065] In some embodiments, the first generation model can sequentially output plot nodes, logical relationships between plot nodes, and plot content. For example, the first generation model first obtains one or more plot nodes generated by processing user input; then obtains logical relationships generated by the first generation model by processing the user input and one or more nodes, i.e., the generation of logical relationships references the user input and the content generated in the previous step; and finally, obtains plot content for each plot node generated by the first generation model by processing the user input, one or more nodes, and logical relationships, i.e., the generation of plot content references the user input and the content generated in the previous two steps. By generating logical relationships after generating plot nodes, and then generating plot content after generating logical relationships, the logical relationships can reference global plot information, and plot content can be generated according to reasonable logic. For example, when a plot involves multiple branches, by generating plot content based on logical relationships, the plot content in a particular branch will be closer to the theme of the current branch than to the themes of other branches.

[0066] The first generation model utilizes the content generated at each step to process the next step, making the generated content more reasonable and more usable. For example, when processing using the base model, the base model can remember the content of previous input or output. Therefore, when outputting each piece of information, all the previous input or output can serve as a reference. As a result, the generated content can be output based on more available information, making the generated results more comprehensive and accurate.

[0067] In step S204, the one or more plot nodes, the logical relationship, and the plot content of each plot node generated by the first generation model are obtained.

[0068] If the first generation model outputs plot nodes, logical relationships, and plot content all at once, the output can be directly obtained. If the first generation model outputs plot nodes, logical relationships, and plot content in multiple steps, the outputs of the multiple steps can be integrated.

[0069] The above-described embodiment can automatically decompose and analyze user input based on artificial intelligence (AI), and automatically generate plot nodes and plot content. This allows for efficient generation of interactive multimedia content based on AI's powerful computing capabilities and vast amounts of prior knowledge. This enables efficient and professional plot expansion based on user input, lowering the barrier to entry for interactive multimedia content creation and improving its efficiency.

[0070] In addition to displaying plot nodes, their logical relationships, and plot content, some embodiments may also display multimedia resources related to at least one plot node. Multimedia resources are used to provide auxiliary descriptions of plot nodes based on the plot content, allowing users to more intuitively understand the style of the current plot node. Multimedia resources may include, for example, at least one of scene images, character images, character voices, background music, and sound effects, and may also include other information.

[0071] Multimedia resources are generated based on the plot content of the plot nodes. Furthermore, they may be generated by further reference to the plot nodes, their logical relationships, and setting information. When generating multimedia resources for a particular plot node, in addition to the plot content of that plot node, reference may also be made to at least one of the plot content, story outlines, scene settings, and character settings of other plot nodes to provide richer reference information for generating the multimedia resources. An embodiment of a method for generating multimedia resources is exemplified below with reference to FIG3 .

[0072] Figure 3 illustrates a flowchart of a method for generating multimedia resources according to some embodiments of the present disclosure. As shown in Figure 3, the method for generating multimedia resources in this embodiment includes steps S302 to S304. These steps can be implemented on a user device, or the user device can send the information to be processed to another device, such as a server, and receive the processing results returned by the other device.

[0073] In step S302, for each plot node, the first generative model is used to extract the visual content of the plot node's plot content. Visual content can be visually relevant information within the plot content, such as descriptions of the environment or characters' actions, clothing, and expressions. For example, the plot node's plot content and extraction instructions can be input into the first generative model, along with other reference information if necessary. The extraction instructions, for example, could be "extract visual information from the above content and output it." Of course, the extraction instructions could also include other content or be expressed in other non-natural language formats, as needed.

[0074] In step S304, the visual content is processed using the second generation model to generate multimedia resources for the plot nodes.

[0075] The second generation model is a model for generating multimedia resources, and the second generation model can be implemented based on a machine learning model such as a neural network model. In some embodiments, the second generation model can be a basic model. For example, for multimedia resources such as images, the second generation model can be an image generation model, such as a "text image" model. Alternatively, the input of the second generation model can also be multimodal, that is, the input includes both text and images, so that adjustments can be made based on the input text on the basis of the input image to output the adjusted image. For example, the most basic setting diagram of the interactive multimedia content can be input to the second generation model, and then based on the plot content of a certain plot node, the image in the scene of the plot node can be further generated on the basis of the setting diagram. Of course, the second generation model can also generate sound, video, etc., which will not be repeated here.

[0076] When the second generative model is processing, in addition to inputting visual content, other content generated by the first generative model can also be input as an auxiliary reference. In addition, generation instructions can be input into the second generative model so that the second generative model understands the current processing task. The instruction is, for example, "Based on the above description, generate a portrait of each character and a scene concept map." The second generative model can also be implemented based on the basic model, with its input being natural language and its output being multimedia resources, such as images, videos, sounds, etc.

[0077] By automatically generating multimedia resources, the efficiency of generating interactive multimedia content can be further improved. In addition, the multimedia resources are generated based on the generated plot content, so they can better match the plot content.

[0078] The above-described embodiments can automatically generate multimedia resources matching the plot content based on artificial intelligence, thereby efficiently generating interactive multimedia content based on the powerful computing power and vast prior knowledge of artificial intelligence, further lowering the threshold for artistic creation. Therefore, the above-described embodiments further lower the threshold for creating interactive multimedia content and improve the efficiency of generating interactive multimedia content.

[0079] After describing the generation method of the materials involved in the interactive multimedia content, the specific implementation methods of the visualization content in some embodiments of the present disclosure are further described below.

[0080] First, the visualization content involved in the user input phase is described.

[0081] As described in the previous embodiments, plot nodes and plot content can be generated based on user input. User input can include story background, character information, main plot content, and so on. Figure 4 illustrates a schematic diagram of a user input interface according to some embodiments of the present disclosure. As shown in Figure 4, input interface 4 includes settings controls for one or more plots. Figure 4 exemplarily illustrates settings controls for three plots, including the ending. The input interface can include any number of settings controls as needed. For example, information related to the entire story can be entered in a single setting control, eliminating the need for the user to manually divide the plots. Taking setting control 41 corresponding to plot one as an example, setting control 41 can include a text input control 411 for user input via text. Furthermore, it can include an image resource input control 412 for inputting resources such as images and videos; or an audio input control 413 for users to upload background music. Those skilled in the art should understand that Figure 4 is merely an example interface, and those skilled in the art may add, delete, or modify content in user input interface 4 as needed.

[0082] In some embodiments, setting information input by the user can also be received, and the setting information includes at least one of character setting, scene setting, and picture style setting. Therefore, the setting information can also be referred to when generating the plot content, that is, the plot content can be generated based on the processing results of the one or more plot nodes, the logical relationship, and the setting information by the first generation model. Character setting includes descriptive information of the virtual character in the interactive multimedia content, such as character concept map, basic attributes, basic information, line style, etc. Scene setting includes descriptive information of the scene in the interactive multimedia content, such as outdoor geographical environment, time, weather, indoor decoration style, objects, etc. Picture style includes, for example, comic style, classical style, technological style, etc.

[0083] The setting information and the aforementioned user input content can be input through the same interface or control to improve user operation efficiency; or they can be input through different interfaces or controls to more accurately distinguish different types of input.

[0084] Figure 5 illustrates a schematic diagram of a setting information input interface according to some embodiments of the present disclosure. As shown in Figure 5 , setting information input interface 5 illustratively shows a story background setting control 51 and a character setting control 52. The story background setting can be a description of the overall story and can be more general than the plot setting shown in Figure 4 . Within the character setting control 52 , one or more more specific setting controls can be configured as needed. For example, these may include an image setting control 521 for uploading a character concept image, a name setting control 522, a gender setting control 523, a basic setting control 524, a dialogue style setting control 525, a playable character setting control 526, and a voiceover selection control 527. Basic settings can include settings beyond dialogue style, such as a character's personality, major experiences, and appearance. Playable character refers to whether the character is controlled by the player. Player-controlled characters can have one or more settings as needed. Some characters may also be set to be unplayable. For such characters, the character setting control 52 does not include control 526, or control 526 is disabled. Selecting dubbing means selecting the voice attribute of the character, or selecting the audio of some fixed voice lines. In addition, the setting interface 5 may also selectively include controls for scene setting and picture style setting, which will not be described in detail here.

[0085] The above-mentioned embodiments of the present disclosure receive setting information input by the user and generate plot content based on the setting information, so that the generated plot content can be richer, more three-dimensional, and more in line with the needs of the user, thereby further improving the efficiency of generating interactive multimedia content.

[0086] Next, the visualization content involved in generating plot nodes based on user input is described.

[0087] After the materials involved in the interactive multimedia content are automatically generated, their display mode can be set as needed. In some embodiments, the plot nodes and the logical relationships between the plot nodes can be displayed in a relatively intuitive graphical manner. For example, controls for one or more plot nodes and connectors between one or more plot nodes can be displayed, and the style of the connector is used to represent the type of the logical relationship between the one or more plot nodes. The style of the control for the plot node can also represent the type of the plot node, such as a normal node type, a branch node type, etc. By displaying in a manner similar to a flowchart, the plot nodes and their logical relationships can be presented more clearly, making it easier for users to preview.

[0088] Figure 6A exemplarily shows a schematic diagram of a visualization interface for plot nodes according to some embodiments of the present disclosure. As shown in Figure 6A, the story of the interactive multimedia content includes multiple chapters. The left side of the visualization interface 6 displays a list of chapters, and the right side displays the plot nodes corresponding to the triggered chapter "Terrain Exploration" and their logical relationship diagram 61. In Figure 61, "Previous Chapter" is used to trigger the display of the visualization content corresponding to the previous chapter "Landing on Mars", and "Next Chapter" is used to trigger the display of the visualization content corresponding to the next chapter "Discovering New Creatures". The other nodes in Figure 61 are multiple plot nodes of the chapter. Thus, the user can clearly understand the logical relationship between the various plot nodes.

[0089] In some embodiments, in response to a user triggering a control on any of a plurality of plot nodes, the plot content of the triggered plot node is displayed. The triggering operation may be, for example, a click operation or other type of operation. In the interface shown in FIG6A , in response to a user triggering a control on node 611, an interface as shown in FIG6B may be displayed. In the visual interface 6, a display control 62 is displayed for the plot content corresponding to the plot node "Exploring the Mountains." The display control 62 may include a text description control 621 for the plot content, wherein the narration text "After a long journey, everyone finally reached the flat land" is surrounded by "#" marks, the action description text "Excitedly pointing to the distance" and "Nervous" are surrounded by brackets, the left side of the colon ":" represents the character who speaks or performs the action (e.g., NPC 1 or NPC 2), and the content to the right of the colon ":" that is not bracketed represents the character's dialogue content.

[0090] Of course, the method of displaying plot content based on triggering operations is not limited to the interface shown in FIG6B . For any plot node displayed in a visual manner, plot content can be displayed in response to a triggering operation on a plot node control. If desired, the plot content of at least one plot node can be displayed by default without user triggering. For example, the plot content of all plot nodes within the visible range can be displayed.

[0091] After browsing the automatically generated plot content, the user may modify the automatically generated plot content. The modification may be automatically performed based on the user's adjustment instruction information or may be manually edited by the user.

[0092] The automatic modification method may include: receiving, for any of multiple plot nodes, user instructions for adjusting the plot content of the plot node; and displaying the adjusted plot content of the plot node, where the adjusted plot content is generated based on the results of processing the adjustment instruction and the pre-adjustment plot content by the first generation model. The adjustment instruction may be a broad description of the adjustments to be made, indicating the areas that need to be modified and may not include specific adjustment details. For example, the adjustment instruction may include "NPC 1's language can be more lively," "NPC 2's actions can be reduced," and so on. This method enriches the modification details based on the user's instructions, thereby reducing the user's modification workload and improving modification efficiency. The user can enter the adjustment instruction information through the adjustment instruction input control. In some embodiments, the adjustment instruction information can be processed by the first generation model to generate the adjusted plot content. In addition to the adjustment instruction, any one or more of the pre-adjustment plot content, one or more plot nodes, logical relationships between plot nodes, and setting information may also be input into the first generation model to ensure more accurate adjustment content.

[0093] Manual modification can include displaying the edited plot content of any of the multiple plot nodes in response to a user's editing operation on the plot content of the plot node. For example, the text description control 621 shown in FIG6B can be editable. By performing editing operations in the text description control 621 (e.g., adding or deleting text, changing the format or layout), the user can more precisely adjust the plot content. This approach offers greater flexibility and accuracy.

[0094] As needed, users can combine the two modification methods above. For example, they can first use automatic modification to make overall, large-scale adjustments, and then use manual modification to edit details. This can improve the overall efficiency of interactive multimedia content generation.

[0095] In some embodiments, in addition to the plot content, in response to a user triggering an operation on a control of any one of the multiple plot nodes, multimedia resources of at least one plot node are also displayed. As shown in Figure 6B, in response to a user triggering plot node 611, a text description control 621, a scene image 622 of plot node 611, a character setting image 623 of plot node 611, and the background music "Music 1.mp3" used by plot node 611 can be displayed simultaneously in the display control 62. As needed, the display control 62 can also include other content, which will not be repeated here. The controls corresponding to the multimedia resources, such as 622, 623 and 624, can also be triggerable and used to modify, delete or replace the multimedia resources.

[0096] Similar to adjusting plot content, in addition to manual adjustment, multimedia resources can also be adjusted automatically. For example, a user's instruction to adjust multimedia resources at a plot node is received; the adjusted multimedia resources at the plot node are displayed, where the adjusted multimedia resources are generated based on the second generation model's processing of the multimedia resource adjustment instruction and the original multimedia resources.

[0097] In addition to the aforementioned method of automatically generating plot nodes, some embodiments of the present disclosure also support manual creation of plot nodes by users. In some embodiments, a user instruction to create a plot node is received; and the user-configured logical relationship between the created plot node and other nodes is received. For example, for plot nodes represented as a flowchart, the logical relationship between the created plot node and other nodes can be configured by adding or modifying connectors. By enabling users to further manually adjust the automatically generated content, the flexibility of interactive multimedia content generation is increased.

[0098] Figure 7A exemplarily shows a schematic diagram of a visualization interface for plot nodes according to other embodiments of the present disclosure. As shown in Figure 7A, in the visualization interface 7A, by triggering the creation control 71 of the plot node, the user can manually create a plot node 72, and by adjusting the connection lines in the interface, configure the logical relationship between the plot node 72 and other nodes. For example, the user can move the arrow corresponding to option 1 to connect the newly created plot node 72 with the created plot node 73, and the plot content corresponding to the plot node 72 is triggered when the user selects option 1. The plot node 73 can be automatically generated or manually created by the user. The visualization interface 74 can provide a variety of creation controls so that the user can create multiple types of nodes. For example, a conditional node 75 can be created by triggering the creation control 74 of the conditional node. The conditional node is used to determine the next plot node to advance based on the current state, such as the force value of the player-controlled character.

[0099] Users can also edit the plot content or other related information of a plot node by triggering it. For example, after triggering the plot node "New Node" 72, editing controls 76 corresponding to plot node 72 may be displayed. Editing controls 76 may include a plot content editing control 761, an image upload control 762 (e.g., background image, character image), and a music upload control 763.

[0100] After completing the generation and editing of the materials required for the interactive multimedia content, the generation operation of the interactive multimedia content can be performed.

[0101] An exemplary generation method involves generating each frame for each plot node based on the plot content and multimedia resources of that plot node, and then splicing these frames to generate multiple segments (e.g., video segments). Based on the interactive information described in the plot content, interactive interfaces are inserted between some adjacent segments to receive user input, thereby forming the segment corresponding to the plot node. Finally, the segments corresponding to each plot node are spliced ​​together to generate interactive multimedia content.

[0102] Another exemplary generation method is to package plot nodes, the logical relationships between plot nodes, plot content, multimedia resources, and control logic to generate interactive multimedia content. The control logic is used to generate multimedia content segments based on the results of processing the plot content of one or more plot nodes and the player's input of the interactive multimedia content according to the text generation model. That is, this type of interactive multimedia content generates interactive multimedia content images in real time as the plot progresses and the player's input. The control logic can determine the text and multimedia resources that need to be read or generated based on the current progress of the plot content and the player's input, and synthesize the read or generated content and then display it to the player. The control logic, for example, includes a calling interface for the basic model to flexibly provide feedback based on the user's input, and this feedback can even temporarily deviate from the original plot content. Thus, giving players a better interactive experience.

[0103] The following describes an embodiment of the device for generating interactive multimedia content disclosed in the present invention with reference to FIG8 .

[0104] FIG8 shows a schematic diagram of the structure of an apparatus for generating interactive multimedia content according to some embodiments of the present disclosure. As shown in FIG8 , the apparatus 80 for generating interactive multimedia content in this embodiment includes: a receiving module 801 configured to receive content input by a user; a first display module 802 configured to display one or more plot nodes and the logical relationships between the one or more plot nodes, where the one or more plot nodes and the logical relationships are generated based on the processing results of the user input content by the first generation model; a second display module 803 configured to display the plot content of at least one plot node, where the plot content is generated based on the processing results of the one or more plot nodes and the logical relationships by the first generation model; and a creation module 804 configured to create interactive multimedia content using the plot content of the one or more plot nodes.

[0105] In some embodiments, the interactive multimedia content generation device 80 also includes a generation module 805, which is configured to: input the user input content and processing instructions into the first generation model, the processing instructions including descriptive information of one or more processes to be performed by the first generation model; obtain one or more plot nodes, logical relationships and plot content of each plot node generated by the first generation model.

[0106] In some embodiments, the generation module 805 is further configured to: obtain one or more plot nodes generated by the first generation model by processing the content; obtain the logical relationship generated by the first generation model by processing the content, one or more nodes; obtain the plot content of each plot node generated by the first generation model by processing the content, one or more nodes, and the logical relationship.

[0107] In some embodiments, the processing instructions further include the format of information output by the first generation model, wherein one or more plot nodes, logical relationships, and plot content of each node are output in different formats.

[0108] In some embodiments, the second display module 803 is further configured to: in response to a user triggering operation on a control of any one of the multiple plot nodes, display the plot content of the triggered plot node.

[0109] In some embodiments, the interactive multimedia content generation device 80 also includes an adjustment module 806, which is configured to: for any one of the multiple plot nodes, receive user adjustment indication information on the plot content of the plot node; and display the adjusted plot content of the plot node, where the adjusted plot content is generated based on the processing results of the first generation model on the adjustment indication information and the plot content.

[0110] In some embodiments, the second display module 803 is further configured to: for any one of the multiple plot nodes, in response to a user's editing operation on the plot content of the plot node, display the edited plot content of the plot node.

[0111] In some embodiments, the interactive multimedia content generating device 80 further includes a third display module 807 configured to display multimedia resources of at least one plot node, where the multimedia resources are generated based on the plot content of the plot node.

[0112] In some embodiments, the interactive multimedia content generation device 80 also includes a multimedia resource generation module 808, which is configured to: for each plot node, use the first generation model to extract the visual content of the plot content of the plot node; use the second generation model to process the visual content to generate multimedia resources for the plot node.

[0113] In some embodiments, the multimedia resource includes at least one of a scene image, a character image, a character voice, background music, and a sound effect.

[0114] In some embodiments, the interactive multimedia content generation device 80 also includes a setting information receiving module 809, which is configured to: receive setting information input by the user, the setting information including at least one of character setting, scene setting, and picture style setting, and the plot content is generated based on the processing results of one or more plot nodes, logical relationships, and setting information by the first generation model.

[0115] In some embodiments, the interactive multimedia content generation device 80 further includes a node creation module 810 configured to: receive a user's instruction to create a plot node; and receive the logical relationship between the user-configured and created plot node and other nodes.

[0116] In some embodiments, the first display module 802 is further configured to display controls of one or more plot nodes and connectors between the one or more plot nodes, where the style of the connector is used to indicate the type of logical relationship between the one or more plot nodes.

[0117] In some embodiments, the content input by the user includes at least one of text and image.

[0118] In some embodiments, the plot content of each plot node includes one or more texts, including at least one of the virtual character's dialogue text, narration text, action description text, and player's alternative interaction text, and each text is expressed in a specified format.

[0119] In some embodiments, the interactive multimedia content further includes control logic for generating multimedia content segments based on a result of processing, by the first generation model, the plot content of one or more plot nodes and the player's input of the interactive multimedia content.

[0120] It should be noted that the above-mentioned units are merely logical modules divided according to the specific functions they implement, and are not intended to limit specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned units are shown with dotted lines in the accompanying drawings to indicate that these units may not actually exist, and the operations / functions they implement can be implemented by the processing circuit itself.

[0121] In addition, although not shown, the device may also include a memory that can store various information generated by the device and the various units contained in the device during operation, programs and data used for operation, data to be sent by the communication unit, etc. The memory can be volatile memory and / or non-volatile memory. For example, the memory can include but is not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Of course, the memory can also be located outside the device. Optionally, although not shown, the device may also include a communication unit that can be used to communicate with other devices. In one example, the communication unit can be implemented in an appropriate manner known in the art, for example, including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. This will not be described in detail here. In addition, the device may also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. This will not be described in detail here.

[0122] Some embodiments of the present disclosure also provide an electronic device for implementing a device for generating interactive multimedia content. Figure 9 shows a schematic diagram of the structure of an electronic device according to some embodiments of the present disclosure. For example, in some embodiments, the electronic device 9 can be various types of devices, for example, including but not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 9 can include a display panel for displaying data and / or execution results utilized in the scheme of the present disclosure. For example, the display panel can be of various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel. In addition, the display panel can be not only a flat panel, but also a curved panel or even a spherical panel.

[0123] As shown in FIG9 , the electronic device 9 of this embodiment includes a memory 91 and a processor 92 coupled to the memory 91. It should be noted that the components of the electronic device 9 shown in FIG9 are merely exemplary and non-limiting. The electronic device 9 may also include other components as required by actual applications. The processor 92 may control the other components in the electronic device 9 to perform desired functions.

[0124] In some embodiments, the memory 91 is configured to store one or more computer-readable instructions. When the processor 92 is configured to execute the computer-readable instructions, the computer-readable instructions, when executed by the processor 92, implement a method according to any of the above-described embodiments. The specific implementation and related explanations of each step of the method can be found in the above-described embodiments, and any repetitive details are omitted here.

[0125] For example, the processor 92 and the memory 91 may communicate with each other directly or indirectly. For example, the processor 92 and the memory 91 may communicate with each other via a network. The network may include a wireless network, a wired network, and / or any combination of wireless networks and wired networks. The processor 92 and the memory 91 may also communicate with each other via a system bus, which is not limited in this disclosure.

[0126] For example, the processor 92 can be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The central processing unit (CPU) can be an X89 or ARM architecture, etc. For example, the memory 91 can include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 91 can include, for example, a system memory, which stores, for example, an operating system, an application, a boot loader (Boot Loader), a database, and other programs. Various applications and various data can also be stored in the storage medium.

[0127] In addition, according to some embodiments of the present disclosure, when various operations / processes according to the present disclosure are implemented through software and / or firmware, the programs constituting the software can be installed from a storage medium or a network to a computer system having a dedicated hardware structure, such as the computer system 1000 shown in Figure 10. When the various programs are installed, the computer system can perform various functions, including those described above. Figure 10 shows a schematic structural diagram of a computer system according to some embodiments of the present disclosure.

[0128] In Figure 10, a central processing unit (CPU) 1001 performs various processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage part 1008 to a random access memory (RAM) 1003. In the RAM 1003, data required when the CPU 1001 performs various processes, etc., is also stored as needed. The central processing unit is merely exemplary and may also be other types of processors, such as the various processors described above. The ROM 1002, RAM 1003, and storage part 1008 may be various forms of computer-readable storage media, as described below. It should be noted that although ROM 1002, RAM 1003, and storage device 1008 are shown separately in Figure 10, one or more of them may be combined or located in the same or different memory or storage modules.

[0129] The CPU 1001, the ROM 1002, and the RAM 1003 are connected to one another via a bus 1004. An input / output interface 1005 is also connected to the bus 1004.

[0130] The following components are connected to the input / output interface 1005: an input portion 1006, such as a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; an output portion 1007, including a display, such as a cathode ray tube (CRT), liquid crystal display (LCD), speaker, vibrator, etc.; a storage portion 1008, including a hard disk, magnetic tape, etc.; and a communication portion 1009, including a network interface card, such as a LAN card, modem, etc. The communication portion 1009 allows communication processing to be performed via a network, such as the Internet. It will be readily understood that although FIG10 shows that the various devices or modules in the electronic device 1000 communicate via the bus 1004, they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of wireless and wired networks.

[0131] A drive 1010 is also connected to the input / output interface 1005 as needed. A removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 1010 as needed so that a computer program read therefrom is installed in the storage section 1008 as needed.

[0132] In the case of realizing the above-described series of processing by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 1011 .

[0133] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the CPU 1001, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0134] It should be noted that in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0135] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0136] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to perform any of the methods of the above embodiments. For example, the instructions may be embodied as computer program codes.

[0137] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure can be written in one or more programming languages ​​or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or can be connected to an external computer (e.g., using an Internet service provider to connect via the Internet).

[0138] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0139] The modules, components, or units described in the embodiments of the present disclosure may be implemented in software or hardware. The names of the modules, components, or units do not necessarily limit the modules, components, or units themselves.

[0140] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, and without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0141] According to some embodiments of the present disclosure, a method for generating interactive multimedia content is provided, comprising:

[0142] Receive content input by a user; display one or more plot nodes and the logical relationship between the one or more plot nodes, where the one or more plot nodes and the logical relationship are generated based on the processing results of the user input by the first generation model; display the plot content of at least one plot node, where the plot content is generated based on the processing results of the one or more plot nodes and the logical relationship by the first generation model; and create interactive multimedia content using the plot content of the one or more plot nodes.

[0143] In some embodiments, the method for generating interactive multimedia content also includes: inputting user input content and processing instructions into a first generation model, the processing instructions including descriptive information of one or more processes to be performed by the first generation model; obtaining one or more plot nodes, logical relationships and plot content of each plot node generated by the first generation model.

[0144] In some embodiments, obtaining one or more plot nodes, logical relationships, and plot content of each plot node generated by the first generation model includes: obtaining one or more plot nodes generated by the first generation model by processing the content; obtaining logical relationships generated by the first generation model by processing the content, one or more nodes; and obtaining the plot content of each plot node generated by the first generation model by processing the content, one or more nodes, and logical relationships.

[0145] In some embodiments, the processing instructions further include the format of information output by the first generation model, wherein one or more plot nodes, logical relationships, and plot content of each node are output in different formats.

[0146] In some embodiments, displaying the plot content of at least one plot node includes: in response to a user triggering operation on a control of any one of the multiple plot nodes, displaying the plot content of the triggered plot node.

[0147] In some embodiments, the method for generating interactive multimedia content further includes: for any one of a plurality of plot nodes, receiving user adjustment indication information for the plot content of the plot node; and displaying the adjusted plot content of the plot node, where the adjusted plot content is generated based on the processing results of the adjustment indication information and the plot content by the first generation model.

[0148] In some embodiments, the method for generating interactive multimedia content further includes: for any one of the plurality of plot nodes, in response to a user's editing operation on the plot content of the plot node, displaying the edited plot content of the plot node.

[0149] In some embodiments, the method for generating interactive multimedia content further includes: displaying a multimedia resource of at least one plot node, where the multimedia resource is generated based on the plot content of the plot node.

[0150] In some embodiments, the method for generating interactive multimedia content further includes: for each plot node, extracting visual content of the plot content of the plot node using a first generation model; and processing the visual content using a second generation model to generate multimedia resources for the plot node.

[0151] In some embodiments, the multimedia resource includes at least one of a scene image, a character image, a character voice, background music, and a sound effect.

[0152] In some embodiments, the method for generating interactive multimedia content also includes: receiving setting information input by the user, the setting information including at least one of character setting, scene setting, and picture style setting, and the plot content is generated based on the processing results of one or more plot nodes, logical relationships, and setting information by the first generation model.

[0153] In some embodiments, the method for generating interactive multimedia content further includes: receiving a user's instruction to create a plot node; and receiving a logical relationship between the plot node configured by the user and the created plot node and other nodes.

[0154] In some embodiments, displaying one or more plot nodes and the logical relationship between the one or more plot nodes includes: displaying controls for the one or more plot nodes and connectors between the one or more plot nodes, where the style of the connector is used to indicate the type of the logical relationship between the one or more plot nodes.

[0155] In some embodiments, the content input by the user includes at least one of text and image.

[0156] In some embodiments, the plot content of each plot node includes one or more texts, including at least one of the virtual character's dialogue text, narration text, action description text, and player's alternative interaction text, and each text is expressed in a specified format.

[0157] In some embodiments, the interactive multimedia content further includes control logic for generating multimedia content segments based on a result of processing, by the first generation model, the plot content of one or more plot nodes and the player's input of the interactive multimedia content.

[0158] According to some embodiments of the present disclosure, a device for generating interactive multimedia content is provided, comprising:

[0159] A receiving module is configured to receive content input by a user; a first display module is configured to display one or more plot nodes and the logical relationship between one or more plot nodes, where the one or more plot nodes and the logical relationship are generated based on the processing results of the user input by the first generation model; a second display module is configured to display the plot content of at least one plot node, where the plot content is generated based on the processing results of the one or more plot nodes and the logical relationship by the first generation model; and a creation module is configured to create interactive multimedia content using the plot content of one or more plot nodes.

[0160] According to some embodiments of the present disclosure, a device for generating interactive multimedia content is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the method for generating interactive multimedia content of any embodiment described in the present disclosure based on instructions stored in the memory.

[0161] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method for generating interactive multimedia content according to any embodiment described in the present disclosure is implemented.

[0162] According to some embodiments of the present disclosure, a computer program is provided, comprising: instructions, which, when executed by a processor, cause the processor to execute the method for generating interactive multimedia content according to any one of the embodiments described in the present disclosure.

[0163] According to some embodiments of the present disclosure, a computer program product is provided, comprising instructions, which, when executed by a processor, implement the method for generating interactive multimedia content according to any one of the embodiments described in the present disclosure.

[0164] The above descriptions are merely some embodiments of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but also encompasses other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in the present disclosure.

[0165] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the present disclosure may be practiced without these specific details. In other cases, well-known methods, structures, and techniques are not presented in detail in order not to obscure the understanding of the description.

[0166] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0167] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art will appreciate that the above examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Those skilled in the art will appreciate that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A method for generating interactive multimedia content, comprising: Receive user input; Displaying the one or more plot nodes and the logical relationship between the one or more plot nodes, wherein the one or more plot nodes and the logical relationship are generated according to the result of processing the content input by the user by the first generation model; Displaying plot content of at least one plot node, wherein the plot content is generated according to a result of processing the one or more plot nodes and the logical relationship by the first generation model; Interactive multimedia content is created using the plot content of the one or more plot nodes.

2. The generation method according to claim 1, further comprising: Inputting the user input content and processing instructions into the first generation model, wherein the processing instructions include description information of one or more processes to be performed by the first generation model; The one or more plot nodes, the logical relationship, and the plot content of each plot node generated by the first generation model are obtained.

3. The generation method according to claim 2, wherein: The step of obtaining the one or more plot nodes, the logical relationship, and the plot content of each plot node generated by the first generation model includes: Obtaining the one or more plot nodes generated by the first generation model by processing the content; Acquire the logical relationship generated by the first generation model by processing the content and the one or more nodes; The plot content of each plot node is obtained by processing the content, the one or more nodes, and the logical relationship by the first generation model.

4. The generation method according to claim 2 or 3, wherein: The processing instructions also include the format of information output by the first generation model, wherein the one or more plot nodes, the logical relationships, and the plot content of each node are output in different formats.

5. The generation method according to any one of claims 1 to 4, wherein: The plot content of displaying at least one plot node includes: In response to the user's triggering operation on a control of any one of the plurality of plot nodes, the plot content of the triggered plot node is displayed.

6. The generation method according to any one of claims 1 to 5, further comprising: For any one of the plurality of plot nodes, receiving adjustment instruction information of the user on the plot content of the plot node; The adjusted plot content of the plot node is displayed, where the adjusted plot content is generated based on a result of the first generation model processing the adjustment indication information and the plot content.

7. The generation method according to any one of claims 1 to 6, further comprising: For any one of the plurality of plot nodes, in response to the user's editing operation on the plot content of the plot node, the edited plot content of the plot node is displayed.

8. The generation method according to any one of claims 1 to 7, further comprising: The multimedia resource of at least one plot node is displayed, wherein the multimedia resource is generated according to the plot content of the plot node.

9. The generating method according to claim 8, further comprising: For each plot node, extracting visual content of the plot content of the plot node using the first generation model; The visual content is processed using a second generation model to generate multimedia resources for the plot node.

10. The generation method according to claim 8 or 9, wherein: The multimedia resources include at least one of scene images, character images, character voices, background music, and sound effects.

11. The generation method according to any one of claims 1 to 10, further comprising: Receive setting information input by the user, the setting information including at least one of character setting, scene setting, and picture style setting, wherein the plot content is generated based on the processing result of the one or more plot nodes, the logical relationship, and the setting information by the first generation model.

12. The generation method according to any one of claims 1 to 11, further comprising: Receiving an instruction from the user to create a plot node; Receive the logical relationship between the plot node configured and created by the user and other nodes.

13. The generation method according to any one of claims 1 to 12, wherein: The displaying of the one or more plot nodes and the logical relationship between the one or more plot nodes includes: A control for displaying one or more plot nodes and connectors between the one or more plot nodes, wherein the style of the connector is used to indicate the type of logical relationship between the one or more plot nodes.

14. The generation method according to any one of claims 1 to 13, wherein: The content input by the user includes at least one of text and image.

15. The generation method according to any one of claims 1 to 14, wherein: The plot content of each plot node includes one or more texts, and the one or more texts include at least one of the dialogue text of the virtual character, the narration text, the action description text, and the player's alternative interaction text, and each text is expressed in a specified format.

16. The generation method according to any one of claims 1 to 15, wherein: The interactive multimedia content also includes control logic, and the control logic is used to generate multimedia content segments according to the processing results of the first generation model on the plot content of the one or more plot nodes and the player's input of the interactive multimedia content.

17. A device for generating interactive multimedia content, comprising: A receiving module, configured to receive content input by a user; A first display module is configured to display the one or more plot nodes and the logical relationship between the one or more plot nodes, wherein the one or more plot nodes and the logical relationship are generated according to the processing result of the first generation model on the content input by the user; A second display module is configured to display the plot content of at least one plot node, wherein the plot content is generated according to the processing result of the one or more plot nodes and the logical relationship by the first generation model; The creation module is configured to create interactive multimedia content using the plot content of the one or more plot nodes.

18. A device for generating interactive multimedia content, comprising: Memory; as well as A processor coupled to the memory, wherein the processor is configured to execute the method for generating interactive multimedia content according to any one of claims 1 to 16 based on instructions stored in the memory.

19. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the method for generating interactive multimedia content according to any one of claims 1 to 16 is implemented.

20. A computer program product, when the computer program product is run on a computer, enables the computer to implement the method for generating interactive multimedia content according to any one of claims 1 to 16.

21. A computer program comprising: Instructions, when executed by a processor, cause the processor to execute the method for generating interactive multimedia content according to any one of claims 1 to 16.

Images