Interaction method and device, computer readable storage medium and computer program product

Abstract

The invention relates to an interaction method and device, a computer readable storage medium and a computer program product, and relates to the technical field of multimedia. The interaction method comprises the following steps: receiving a first input of a user, wherein the user controls a virtual character of interactive multimedia content; in response to the fact that the first input is not matched with an original plot of the interactive multimedia content, a first target role is determined from one or more first-type roles based on the first input and the original plot of the interactive multimedia content, a temporary plot is generated, the first-type roles are non-user-controlled virtual roles in the interactive multimedia content, and the temporary plot is generated according to the first target role. The temporary plot is used for guiding the user to provide second input for triggering the original plot; generating first interaction information of the first target role to the first input based on the first input, the original plot and the temporary plot; and displaying first interaction information of the first target role for the first input.

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technologies, and particularly to an interaction method, apparatus, computer-readable storage medium, and computer program product. Background Art

[0002] With the development of computer technologies and multimedia technologies, interactive multimedia content such as video games and interactive TV dramas has become increasingly popular among users. Interactive multimedia content usually advances the plot according to a pre-determined script. For example, at nodes where users can interact, one or more pre-set options are provided to the users. After receiving the option selected by the user, according to the rules set in the script, the plot corresponding to the selected option is triggered. Summary of the Invention

[0003] This Summary of the Invention section is provided to introduce concepts in a brief form that will be described in detail in the Detailed Description section later. This Summary of the Invention section is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to be used to limit the scope of the claimed technical solution.

[0004] According to some embodiments of the present disclosure, an interaction method is provided, including: receiving a first input from a user, where the user controls a virtual character in interactive multimedia content; in response to the first input not matching the original plot of the interactive multimedia content, determining a first target character from one or more first-type characters and generating a temporary plot based on the first input and the original plot of the interactive multimedia content, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; generating first interaction information of the first target character with respect to the first input based on the first input, the original plot, and the temporary plot; and displaying the first interaction information of the first target character with respect to the first input.

[0005] According to some embodiments of the present disclosure, an interaction device is provided, including: an input device configured to receive a first input from a user who controls a virtual character in interactive multimedia content; one or more processors configured to: in response to the first input not matching the original plot of the interactive multimedia content, determine a first target character from one or more first-type characters and generate a temporary plot based on the first input and the original plot of the interactive multimedia content, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; and generate first interaction information of the first target character with respect to the first input based on the first input, the original plot, and the temporary plot; and a display configured to display the first interaction information of the first target character with respect to the first input.

[0006] According to some embodiments of the present disclosure, an interaction device is provided, including: a receiving module configured to receive a first input from a user who controls a virtual character in interactive multimedia content; a first generating module configured to, in response to the first input not matching the original plot of the interactive multimedia content, determine a first target character from one or more first-type characters and generate a temporary plot based on the first input and the original plot of the interactive multimedia content, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; a second generating module configured to generate first interaction information of the first target character with respect to the first input based on the first input, the original plot, and the temporary plot; and a first display module configured to display the first interaction information of the first target character with respect to the first input.

[0007] According to some embodiments of the present disclosure, an interaction device is provided, including: a memory; and a processor coupled to the memory, the processor being configured to execute the interaction method of any one of the embodiments described in the present disclosure based on instructions stored in the memory.

[0008] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, it executes the interaction method of any one of the embodiments described in the present disclosure.

[0009] According to some embodiments of the present disclosure, a computer program product is provided, and when the computer program product runs on a computer, it causes the computer to implement the interaction method of any one of the embodiments described in the present disclosure.

[0010] Other features, aspects, and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Preferred embodiments of the present disclosure will be described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure, and together with the following detailed description, are incorporated in this specification and form a part of this specification for explaining the present disclosure. It should be understood that the drawings in the following description only relate to some embodiments of the present disclosure and do not constitute a limitation to the present disclosure.

[0012] In the drawings:

[0013] Figure 1 A flowchart showing a process of an interaction method according to some embodiments of the present disclosure is shown.

[0014] Figure 2 A flowchart showing a process of a method for generating a temporary plot according to some embodiments of the present disclosure is shown.

[0015] Figure 3 A flowchart showing a process of a method for generating first interaction information according to some embodiments of the present disclosure is shown.

[0016] Figure 4 A flowchart showing a process of an interaction method according to some other embodiments of the present disclosure is shown.

[0017] Figure 5 A flowchart showing a process of an interaction method according to some further embodiments of the present disclosure is shown.

[0018] Figure 6 A flowchart showing a process of an interaction method according to some still further embodiments of the present disclosure is shown.

[0019] Figure 7A A schematic diagram showing an interaction between multiple characters according to some embodiments of the present disclosure is shown.

[0020] Figure 7B A schematic diagram showing an interaction between multiple characters according to some other embodiments of the present disclosure is shown.

[0021] Figures 8A to 8C A schematic diagram of an interface of interactive multimedia content according to some embodiments of the present disclosure is shown.

[0022] Figure 9 A schematic diagram of the structure of an interaction device according to some embodiments of the present disclosure is shown.

[0023] Figure 10 A schematic diagram of the structure of an interaction device according to some other embodiments of the present disclosure is shown.

[0024] Figure 11 A block diagram showing some embodiments of the electronic device of the present disclosure.

[0025] Figure 12 A schematic structural diagram of a computer system that can be adopted according to some embodiments of the present disclosure is shown.

[0026] It should be understood that, for the sake of convenience of description, the sizes of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar components. Therefore, once an item is defined in one drawing, it may not be further discussed in the subsequent drawings. Detailed implementation manners

[0027] Next, the technical solutions in the embodiments of the present disclosure will be clearly and completely described in conjunction with the drawings in the embodiments of the present disclosure. However, it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. The following description of the embodiments is actually only illustrative and in no way limits the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0028] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard. Unless otherwise specifically stated, the relative arrangements, numerical expressions, and numerical values of the components and steps set forth in these embodiments should be construed as merely exemplary and do not limit the scope of the present disclosure.

[0029] The term "comprising" and its variants used in the present disclosure mean an open term that includes at least the subsequent element / feature, but does not exclude other elements / features, that is, "including but not limited to". In addition, the term "containing" and its variants used in the present disclosure mean an open term that includes at least the subsequent element / feature, but does not exclude other elements / features, that is, "containing but not limited to". Therefore, "comprising" and "containing" are synonymous. The term "based on" means "at least partially based on".

[0030] As used throughout the specification, the terms "one embodiment", "some embodiments", or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Moreover, the appearances of the phrases "in one embodiment", "in some embodiments", or "in an embodiment" throughout the specification do not necessarily all refer to the same embodiment, but may also refer to the same embodiment.

[0031] It should be noted that the concepts such as "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules, or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules, or units. Unless otherwise specified, the concepts such as "first", "second", etc. are not intended to imply that the objects so described must be in a given order in terms of time, space, ranking, or any other way.

[0032] It should be noted that the modifications of "one" and "a plurality" mentioned in this disclosure are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise clearly specified in the context, it should be understood as "one or more".

[0033] The names of the messages or information exchanged between multiple devices in the embodiments of this disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0034] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to these specific embodiments. These specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures, or characteristics may be combined by any suitable means that will be apparent to those of ordinary skill in the art from this disclosure.

[0035] After some interactive multimedia content is generated, the interactive information that the player can input is also determined accordingly. For example, when the plot of the interactive multimedia content progresses to certain nodes, one or more options pre-set for the user can be provided for selection. After receiving the option selected by the user, according to the rules set in the script, the plot corresponding to the selected option is triggered. However, since the interactive multimedia content has been pre-written according to the set plot, it does not support the user to input content other than these options to advance the plot. Thus, the freedom and participation of the user in the game are relatively low.

[0036] In addition, there is some interactive multimedia content that can support arbitrary input from users and cause the plot to progress completely according to the content of the users' input. However, giving users too much freedom may lead to severely unreasonable progress of the plot and a significant decline in the user experience.

[0037] Therefore, a technical problem to be solved by the present disclosure is: how to enable the interactive multimedia content to progress reasonably automatically while giving users a certain degree of freedom, so as to improve the user experience.

[0038] Figure 1 The flowchart of an interaction method according to some embodiments of the present disclosure is shown. As Figure 1 shown, the interaction method of this embodiment includes steps S102 to S108.

[0039] In step S102, a first input from the user is received, and the user controls a virtual character in the interactive multimedia content.

[0040] The user in the embodiments of the present disclosure refers to the object that interacts with the interactive multimedia content. For example, the user can be a player, viewer, or consumer of the interactive multimedia content. The interactive multimedia content includes, for example, games, interactive movies, interactive stories, etc.

[0041] The first input from the user is, for example, the selection result of multiple options provided by the interactive multimedia content, or the information freely input by the user. For example, when the interactive multimedia content provides several options and the user does not want to select any of them, the user can still freely input the content they want to express through the displayed input control; or, the interactive multimedia content may not provide any options, but instead display an input control at the node where the user needs to interact, so that the user can freely input the content they want to express. The information freely input by the user is, for example, natural language text. When the interactive multimedia content provides options, the natural language text can be completely different from the content of all options, or completely the same as the content of one of the options, or have the same meaning as the content of one of the options but a different expression.

[0042] In some embodiments, after receiving the user's first input, the first input can be "performed" by a user-controlled virtual character. For example, when the first input represents a dialogue, the user can be instructed to control the virtual character to say the content, and the speaking process can be represented by at least one of playing the spoken content and displaying the text of the spoken content; when the first input represents an action, the user can be instructed to control the virtual character to perform the action, and the action can be represented by displaying a text description of the action, or by displaying an animation of the virtual character performing the action, or a combination of both. Alternatively, instead of having the user-controlled virtual character "perform" the first input, the subsequent plot corresponding to the first input can be directly displayed according to the first input.

[0043] In step S104, in response to the first input not matching the original plot of the interactive multimedia content, based on the first input and the original plot of the interactive multimedia content, a first target character is determined from one or more first-type characters and a temporary plot is generated, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot.

[0044] The original plot refers to the plot that has been determined after the generation of the interactive multimedia content. For the same interactive multimedia content, regardless of which user consumes it, its original plot is the same. However, due to differences in the inputs of different users, during the process of different users consuming the interactive multimedia content, the actually displayed content and the actually advancing plot may be different. That is, the original plot is similar to a "script" and is used to determine the main line of the interactive multimedia content. However, some specific content of the interactive multimedia content can be personalized and generated in real time according to the user's input, that is, intelligent secondary creation is performed by integrating the original plot and the user's input.

[0045] The interactive multimedia content can include multiple chapters, and the original plot corresponds to one of the multiple chapters of the interactive multimedia content, or can also correspond to the entire plot of the interactive multimedia content.

[0046] In the case where the first input is the selection result of the options provided by the interactive multimedia content, the first input matches the original plot of the interactive multimedia content. That is, the original plot has set the subsequent advancing plot or the multiple branch plots that need to be advanced subsequently, and the provided options also correspond to these plots. Therefore, in this case, the first input can match the original plot.

[0047] In the case where the first input is the content freely input by the user, in some embodiments, if the first input matches the trigger condition (for triggering the subsequent plot after the current plot) in the original plot, it can be considered that the first input matches the original plot of the interactive multimedia content; if the first input does not match the trigger condition in the original plot, it can be considered that the first input does not match the original plot of the interactive multimedia content. For example, if the first input is exactly the same as the content of an option provided by the interactive multimedia content, or has the same meaning as the content of an option but different expressions, it can be considered that the first input matches the original plot of the interactive multimedia content; if the first input is completely different from the content of all options, it can be considered that the first input does not match the original plot of the interactive multimedia content.

[0048] When the first input matches the original plot of the interactive multimedia content, the subsequent plot in the original plot corresponding to the first input can be triggered. When the first input does not match the original plot of the interactive multimedia content, a temporary plot will be generated. This temporary plot is a plot that does not exist in the original plot, that is, a plot automatically generated according to the user's personalized input. The temporary plot is descriptive information about the content that the interactive multimedia content is about to display, and it can be a general description.

[0049] During the generation of the temporary plot, the first input and the original plot need to be referred to, so that the temporary plot can take into account both the user input and the original plot, and can be developed within the framework of the original plot while responding to the user's free input, making it more reasonable. And this plot can guide the user to trigger the original plot, that is, guide the user to provide a second input for triggering the original plot in the next input.

[0050] For example, the character controlled by the current player is at a fork in a maze, and the user needs to decide whether to go to the left fork A or the right fork B. After choosing each fork, there is a corresponding subsequent plot in the original plot. If the user does not choose either and indicates to retreat through the first input, a temporary plot can be generated at this time to prompt the user to make a choice. For example, the temporary plot can be a reminder that retreating is very dangerous; another example is that after the character controlled by the user retreats for a period of time, the road behind collapses and cannot be retreated any further; another example is that after the character controlled by the user retreats for a period of time, a new passage is found, and this passage leads to the road of fork A, so that when the user's second input indicates to go to this passage, it can be connected with the original plot.

[0051] The temporary plot needs to be carried by a suitable virtual character, which is a non-user-controlled virtual character for interacting with the user-controlled virtual character. Therefore, in addition to determining the temporary plot, the first target character can also be determined. Thus, the temporary plot is the content to be expressed by the first target character. For example, if the temporary plot expresses that caution is needed at present, the virtual character set as cautious can be determined as the first target character.

[0052] In some embodiments, the temporary plot can be determined first, and then the first target character can be determined based on the temporary plot. Or the first target character can be determined first, and then the temporary plot can be determined. Or the first target character and the temporary plot can be determined simultaneously.

[0053] In step S106, based on the first input, the original plot, and the temporary plot, the first interaction information of the first target character for the first input is generated.

[0054] The first interaction information is used to respond to the first input and represents the visual information corresponding to the temporary plot. The first interaction information includes, for example, the dialogue text of the first target character, or options for the user to select, etc. In addition, it can also include one or more of actions and expressions. For example, if the temporary plot is to prompt that it is dangerous to retreat, the first interaction information can be that the first target character says "It's too dangerous behind. Let's go forward!" Another example, if the temporary plot is that after the user-controlled character retreats for a period of time, the road behind collapses and cannot retreat any further. Then the first interaction information can be that in the scene where the road behind collapses, the first target character says "We can't retreat anymore. Now we can only go forward", and two options of going left forward or right forward are displayed.

[0055] In step S108, the first interaction information of the first target character for the first input is displayed. The display method can be to display text, the expression or action of the first target character, etc.

[0056] For example, for any type of first interaction information, according to needs, it can be described through text. For the text of the speech content of the first target character, the text of the expression description, and the action, different styles or positions can be used to express different types of text. For example, the text of the description of the action and expression can be placed in parentheses to distinguish it from the speech content text.

[0057] For expressions or actions, the first target character can also be made to perform the expression or action to make the expression of the temporary plot more vivid and specific. This method requires generating corresponding multimedia resources, such as the animation of the first target character. And if it is described through text, the data volume of generating multimedia resources can be reduced.

[0058] The above embodiments allow a user to provide a first input that does not match the original plot during the viewing of interactive multimedia content. Moreover, for this first input, a temporary plot can also be generated to guide the user back to the original plot while responding to the user's first input. Thus, the embodiments of the present disclosure can support a certain degree of freedom for the user while enabling the interactive multimedia content to reasonably advance the plot, improving the user experience.

[0059] Some embodiments of the present disclosure can generate a temporary plot or first interaction information based on Artificial Intelligence (AI for short). For example, a machine learning model is used to implement the generation process. The machine learning model used in the embodiments of the present disclosure is, for example, a generative model. The generative model is used to output target content based on the input information. The input information includes the processing basis during the generation process of the generative model, such as which information to refer to for the generation process, requirements for the output target content, and so on. The generative model includes, for example, a model for generating based on text or a model for generating based on images. The output of the generative model can include text, images, or a combination of both. Of course, the input or output of the generative model can also be data of other modalities, such as audio, video, or a combination of multiple types of data. The generative model can be a single-modal model, such as a model for generating text based on text (abbreviated as "text-to-text model"), a model for generating images based on images (abbreviated as "image-to-image model"); or, the generative model can also be a cross-modal model, that is, a model where the input and output belong to different modalities, such as a model for generating images based on text (abbreviated as "text-to-image model"); or, the input of the generative model can include multiple modalities, and the output can also include multiple modalities. The machine learning model can be implemented based on a neural network model, etc., for example, it can be a Foundation Model or a Large Language Model (LLM for short).

[0060] The following will respectively refer to Figure 2 and Figure 3 to describe embodiments of the AI-based generation method of the present disclosure.

[0061] Figure 2 FIG. shows a flowchart of a method for generating a temporary plot according to some embodiments of the present disclosure. As Figure 2 shown, the method for generating a temporary plot in this embodiment includes steps S202 to S204.

[0062] In step S202, a machine learning model is used to process the first input, the original plot, and the first prompt information. The first prompt information includes an indication for generating a temporary plot when the user's input does not match the original plot.

[0063] The first prompt information is used to indicate the processing logic of the current task of the machine learning model, so that the machine learning model can understand the first input and the original plot (such as natural language understanding) according to this model, and generate a temporary plot. The first prompt information is represented in a format that the machine learning model can parse. The first prompt information can be preset, for example, it is the content from a template. The template can correspond to different tasks. For example, the first prompt information in step S202 can come from a template corresponding to the task of generating a temporary plot.

[0064] In some embodiments, the first prompt information can be natural language text. For example, "Generate a plot based on the user's input and the original plot. If the user's input deviates from the original plot, the generated temporary plot should be able to connect the current state with the original plot."

[0065] When generating the temporary plot, character information can also be referred to. In some embodiments, the first prompt information further includes the character information of one or more first-type characters, and an indication of selecting a first target character according to the character information. The character information includes, for example, at least one of character setting, line style, and behavior guidance. The character setting includes, for example, personality setting, basic attribute setting (such as gender, age, etc.). Thus, the appropriate first target character can be selected from the character information of the first-type characters to respond to the first input. And the generated temporary plot can also have a higher matching degree with the character performing the plot. Based on this indication, the character information of the first target character can have a higher matching degree with the temporary plot, making it more reasonable for the first target character to carry the temporary plot.

[0066] In step S204, obtain the first target character output by the machine learning model and the indication for generating interaction information, where, in the case where the first input does not match the original plot, the indication for generating interaction information includes the temporary plot.

[0067] The indication for generating interaction information is used to provide a basis for generating the first interaction information. Thus, the subject for generating the first interaction information can generate the first interaction information according to the temporary plot in the indication for generating interaction information. In the indication for generating interaction information, in addition to the temporary plot, it can also include the second prompt information. The second prompt information represented in natural language form is, for example: "Generate the dialogue of the first target character according to the above temporary plot." According to needs, the second prompt information can also be implemented in other forms, which will not be elaborated here.

[0068] Each first - type character can be configured with an interaction information generation module. The first interaction information can be sent to the interaction information generation module corresponding to the first target character to instruct it to generate the first interaction information. The interaction information generation module that each first - type character can be configured with can also be implemented by a machine - learning model. The process of generating the first interaction information using the machine - learning model will be described exemplarily later.

[0069] The above - mentioned embodiments can automatically generate a temporary plot based on artificial intelligence, and thus, based on the powerful computing power and vast prior knowledge of artificial intelligence, can efficiently generate a temporary plot in response to the user's input, so as to quickly respond to the user's input.

[0070] Figure 3 The flowchart of the method for generating the first interaction information according to some embodiments of the present disclosure is shown. As Figure 3 shown, the method for generating the first interaction information in this embodiment includes steps S302 to S304.

[0071] In step S302, a machine - learning model is used to process the first input, the original plot, the temporary plot, and the second prompt information, where the second prompt information includes the character information and memory summary of the first target character.

[0072] The type of this machine - learning model can be the same as or different from the type of the machine - learning model in step S202. In the case where their types are the same, the machine - learning model in step S202 and the machine - learning model in step S302 can even be the same model, but they correspond to different agents respectively. Thus, each agent has independent input, output, and context information during the processing, but they share the computing resources provided by the same machine - learning model. According to needs, steps S202 and S302 can also be executed by the same agent.

[0073] The second prompt information is used to indicate the processing logic of the current task of the machine - learning model, so that the machine - learning model can understand (such as natural - language understanding) the first input, the original plot, and the temporary plot according to this model, and generate the first interaction information. The second prompt information is represented in a format that the machine - learning model can parse. The second prompt information can be preset, for example, it is the content from a template. For example, the second prompt information in step S302 can come from the template corresponding to the generation task of the interaction information.

[0074] In some embodiments, the second prompt information can be a natural - language text. For example, "Generate the dialogue of the first target character according to the user's input, the original plot, and the temporary plot."

[0075] The memory summary of the first target character is a summary of the plot that the first target character has experienced in the interactive multimedia content. The interactive multimedia content may include one or more chapters. Suppose the current plot has advanced to the third chapter. If the first target character appears in the first, second, and third chapters, the memory summary of the first target character is a summary of the storylines that have occurred in the first and second chapters; if the first target character only appears in the first and third chapters, the memory summary of the first target character is a summary of the storyline that has occurred in the first chapter. In addition, the memory summary may also include a summary of the storyline that has occurred in the current chapter.

[0076] In step S304, obtain the first interaction information of the first target character with respect to the first input output by the machine learning model.

[0077] In some embodiments, input the first input, the original plot, the temporary plot, and the second prompt information to the agent of the machine learning model corresponding to the first target character, and obtain the first interaction information output by the agent. Thus, when generating the first interaction information based on the first target character and the temporary plot, interference from other irrelevant information can be avoided, improving the accuracy of content generation. When the first interaction information is represented by text, a model for generating text can be used; when the first interaction information is represented by an image, a model for generating images can be used. When the first interaction information includes both text and images, the above two models can be used simultaneously, or a generative model whose output includes both text and images can be used.

[0078] The above embodiments can automatically generate the first interaction information based on artificial intelligence, and thus, based on the powerful computing power and vast prior knowledge of artificial intelligence, the temporary plot can be efficiently converted into interaction information, so as to automatically provide a basis for the subsequent display content.

[0079] Through the above various embodiments, when the user's input deviates from the original plot, the user can be pulled back through the temporary plot. If the user persists in deviating from the plot multiple times, the original plot can be directly triggered through the temporary plot. For example, the original plot requires the user to explore the wreckage of a spaceship, but the user continuously indicates through the first input to explore other places. At this time, a temporary plot can be generated, indicating that a mysterious entrance has been found in the place where the user wants to explore, and after entering the entrance, it is found that it is exactly the wreckage of the spaceship.

[0080] Of course, when the user persists in deviating from the plot multiple times, it may also be considered to end the game in a timely manner. The following refers to Figure 4 Describe the interaction method of some other embodiments of the present disclosure.

[0081] Figure 4 Shows a schematic flowchart of an interaction method according to some other embodiments of the present disclosure. AsFigure 4 As shown, the interaction method of this embodiment includes steps S402 to S406.

[0082] In step S402, in response to the inputs specified by the user a consecutive number of times not matching the original plot, an indication for terminating the interactive multimedia content is generated based on the first input and the original plot of the interactive multimedia content.

[0083] When the inputs specified by the user a consecutive number of times do not match the original plot, it indicates that the user's purpose is not to advance the plot. At this time, it can be ended in a timely manner. However, a too rigid end may lead to a poor user experience, so a transitional screen can also be generated. The indication for terminating the interactive multimedia content is used to represent the plot of the terminating interactive multimedia content, so that interactive information can be further generated based on this indication. This indication is, for example, "generate a transitional plot to transition from the user's input to the game failure screen". In addition to the natural language method, other forms can also be used to represent this indication, which will not be elaborated here.

[0084] In some embodiments, this indication can be generated using a machine learning model. For example, the machine learning model processes the first input and the original plot of the interactive multimedia content, and when the inputs specified by the user a consecutive number of times do not match the original plot, an indication for generating the terminating interactive multimedia content output by the machine learning model is obtained. The specific implementation of the machine learning model can refer to the foregoing embodiments, which will not be elaborated here.

[0085] In step S404, second interactive information is generated based on the first input, the original plot, and the indication for terminating the interactive multimedia content, where the second interactive information represents the termination of the interactive multimedia content.

[0086] The second interactive information is used to respond to the first input and transition to the game failure interface. The second interactive information can be carried by a certain first type of character, or can be represented by the background screen and narration without being carried by any first type of character. The second interactive information can be visual information.

[0087] In step S406, the second interactive information is displayed.

[0088] The display method of the second interactive information can refer to the first interactive information, which will not be elaborated here. At the end of the second interactive information, the game over screen can be displayed.

[0089] For example, still taking the user's current situation in the maze as an example, in the original plot, the user is required to choose a fork in the road ahead and then move forward. However, the user insists on entering "go back" multiple times. In the case where guiding the user through the temporary plot fails multiple times, the following plot can be displayed: Since the character controlled by the player has stayed in the maze for too long, resulting in a lack of supplies and thus fainting, the game ends.

[0090] Through the above embodiments, when the user deviates from the plot continuously for multiple times, the interactive multimedia content can be ended in a timely manner.

[0091] Embodiments of the present disclosure can also hint at the correct option in the plot in advance when the user faces multiple options, so that the interactive multimedia content can continue to progress without affecting the user's viewing experience. The following refers to Figure 5 Describe the interaction method of some other embodiments of the present disclosure.

[0092] Figure 5 The flowchart of the interaction method according to some other embodiments of the present disclosure is shown. As Figure 5 shown, the interaction method of this embodiment includes steps S502 to S508.

[0093] In step S502, in response to the first input matching the branch node plot in the original plot, based on the first input and the branch node plot, determine a second target character from one or more first-type characters and generate a hint plot, where the hint plot is used to hint at a specified option among multiple options of the branch node.

[0094] The branch node plot refers to a plot node that contains multiple options, and different options correspond to different plot branches. The process of determining a second target character from one or more first-type characters and generating a hint plot can still be processed by a machine learning model, and the specific processing method can refer to the foregoing embodiments.

[0095] The specified option can be an option for advancing the plot or an option for triggering the end of the interactive multimedia content. For example, the two options are "climb the mountain" and "swim" respectively, where the "climb the mountain" option can advance the plot, and the "swim" option triggers game failure. At this time, the hint plot can be seeing a huge crocodile in the water.

[0096] The second target character is used to carry the hint plot. When determining the second target character, the character information of the first-type character can also be referred to so that the second target character has a higher degree of matching with the hint plot. In some embodiments, the hint plot can be determined first and then the second target character can be determined based on the hint plot, or the second target character can be determined first and then the hint plot can be determined, or the second target character and the hint plot can be determined simultaneously.

[0097] In step S504, based on the first input, the original plot, and the hint plot, generate the third interaction information of the second target character for the first input.

[0098] The form of the third interaction information is similar to that of the first interaction information, except for the function and specific content. In some embodiments, the third interaction information can also be generated by a machine learning model.

[0099] In step S506, display the third interaction information of the second target character for the first input. Thus, through the second target character, a hint for the specified option can be given to guide the user to continue advancing the plot.

[0100] In step S508, display multiple options. The multiple options can be expressed through the speech content of the second target character or displayed as selection controls on the interface. The user can make a selection by triggering the selection control or by free input.

[0101] Through the above embodiments, a hint plot for hinting at a specified option can be generated based on the user's input and the original plot. Thus, on the premise of giving the user a certain degree of freedom, the user can be guided to continue advancing the plot, improving the user experience.

[0102] In some embodiments of the present disclosure, when the user's input triggers an ending, in order to avoid showing the ending content abruptly, a transition plot can be generated to make the advancement of the plot smoother and more natural. The following refers to Figure 6 Describe the interaction method of some further embodiments of the present disclosure.

[0103] Figure 6 Shows a flowchart of an interaction method according to some further embodiments of the present disclosure. As Figure 6 shown, the interaction method of this embodiment includes steps S602 to S606.

[0104] In step S602, in response to the first input matching the ending in the original plot, generate a transition plot based on the first input and the ending, where the transition plot is used to transition from the current plot to the ending.

[0105] The ending can be the ending of a certain chapter or the ending of the entire interactive multimedia content. Since the ending is predetermined content, although the user's input matches the original plot, there may still be some differences from the original plot. Therefore, directly advancing according to the original plot will make the plot discontinuous. For example, in the original plot content, NPC 1 asks the user whether to stay on the boat or take a speedboat to shore. In the original plot, staying on the boat will lead to game failure, and taking a speedboat to shore will trigger the ending. The user is not limited by the two options provided and chooses to swim to shore. In fact, as long as the virtual character controlled by the user reaches the shore, the ending can be triggered, and the way doesn't matter. Therefore, the first input still matches the original plot. To make the plot more coherent, it is possible to display the scene where the virtual character controlled by the user swims and is wet all over after reaching the shore, and then trigger the display of the ending.

[0106] If it is necessary for other virtual characters to carry the transition plot, the target character for carrying the transition plot can also be determined from the first type of characters based on the first input and the ending.

[0107] In some embodiments, a machine learning model can be used to process the first input and the ending to generate a transition plot.

[0108] In step S604, based on the first input, the original plot, and the transition plot, the fourth interaction information is generated.

[0109] The form of the fourth interaction information is similar to that of the first interaction information, except for the function and specific content. In some embodiments, the fourth interaction information can also be generated by a machine learning model.

[0110] In step S606, the fourth interaction information is displayed.

[0111] The display method of the fourth interaction information can refer to the first interaction information and will not be elaborated here. At the end of the fourth interaction information, the picture corresponding to the ending can be displayed.

[0112] Through the above embodiments, when triggering the ending, the transition plot can be automatically generated according to the user's input and the content of the ending, so that the displayed content can naturally transition from the user's current state to the ending, making the plot progression of the interactive multimedia content smoother and more reasonable, and improving the user experience.

[0113] The above-described embodiments exemplarily describe the content of automatically generating various types of plotlines in interactive multimedia content. In the embodiments of the present disclosure, in addition to the first type of character, in some embodiments, a second type of character is also provided, and the second type of character is not a character in the interactive multimedia content. For example, the second type of character is not a character with a storyline in the interactive multimedia content, but a background control type of character for scheduling the interactive multimedia content. Any one of the processes of generating the temporary plotline, the prompt plotline, and the transition plotline described above can be implemented by the first type of character or the second type of character. Implementing by a certain type of character means implementing through the processing logic or processing module corresponding to that type. For example, in the case where each character corresponds to an agent of a machine learning model, implementing by the first type of character can refer to implementing through the agent of the first type of character, and implementing by the second type of character can refer to implementing through the agent of the second type of character. Implementing through an agent means inputting the information to be processed into the agent and obtaining the output of the agent as the processing result.

[0114] In some embodiments, in response to the first input not matching the original plotline of the interactive multimedia content, based on the first input and the original plotline of the interactive multimedia content, a first target character is determined from one or more first type of characters and a temporary plotline is generated by the first type of character or the second type of character. The following will respectively refer to Figure 7A and 7B for an exemplary description of these two cases.

[0115] In some embodiments, the temporary plotline and the first target character are generated by the first type of character. For example, the temporary plotline and the first target character are generated by the virtual character that spoke last among the first type of characters, that is, the virtual character that interacted with the user last.

[0116] Figure 7A Shows a schematic diagram of the interaction between multiple characters according to some embodiments of the present disclosure. As Figure 7A shown, in a certain chapter of the game, the game process is promoted through the interaction between the player, NPC A (the first type of character), and NPC B (another first type of character). Among them, the game engine is responsible for calling the corresponding AI agent and passing the interaction content to the corresponding AI agent.

[0117] First, according to the plotline of the game, NPC A speaks and outputs interaction information. For example, through the AI agent corresponding to NPC A, the plotline of the game such as the summary and ending of the current chapter and the memory summary of NPC A are input into the machine learning model, and the output obtained includes determining that the speech content of NPC A is xxxx.

[0118] In addition to outputting the speech content, NPC A can also provide interactive content to the player. Similarly, through the AI agent corresponding to NPC A, according to the game plot, options 1 and 2 are determined as the interactive content to be provided to the player, and this content can be streamed back to the player. Of course, if the determined content only includes the need for the player to provide input without options, a free input box is provided to the user.

[0119] Both the speech content of NPC A and the interactive content provided to the player can be displayed on the user interface corresponding to NPC A.

[0120] Next, the player makes a first input. For example, the player does not select any option but enters "zzzz". In response to the player's first input, the game engine can call the AI agent corresponding to NPC A and pass the player's first input to the AI agent corresponding to NPC A.

[0121] The AI agent corresponding to NPC A inputs the player's "zzzz" and the original plot into the machine learning model. After obtaining the temporary plot and the first target character NPC B, it processes this information and outputs the temporary plot "yyyy" for the first input and the first target character, and the character interacting with the player needs to be switched to NPC B, which is the first target virtual character. NPC B processes the speech content of NPC A, options 1 and 2 provided to the player, the player's input "zzzz", and the temporary plot "yyyy" generated by NPC A, and generates interactive information "kkkk", which can be streamed back to the player and displayed on the user interface corresponding to NPC A.

[0122] In some embodiments, the second type of character generates the temporary plot and determines the first target character. Figure 7B The interaction schematic diagram among multiple characters according to some other embodiments of the present disclosure is shown. As Figure 7B shown, in a certain chapter of the game, through the interaction among the player, the director (the second type of character), and actor A (the first type of character A), the game process is promoted. Among them, the game engine is responsible for calling the corresponding AI agent and passing the interaction content to the corresponding AI agent. In Figure 7B this, in each round of interaction with the machine learning model, the second type of character and the actor both maintain the historical conversation record.

[0123] First, the player makes a first input, for example, a free input. The game engine calls the AI agent corresponding to the director and passes the player's free input to the AI agent corresponding to the director.

[0124] The AI agent corresponding to the director inputs the plot of the game, such as the summary and ending of the current chapter, the interaction record of the current chapter (including the most recent N chat records and the player's latest free input), and the plot summary of the previous chapter, into the machine learning model. The output obtained includes that the determined first target character is actor A and the temporary plot is "xxxx".

[0125] According to the above output, the game engine calls the AI agent corresponding to the first type of character A and passes the interaction record of the current chapter and the temporary plot determined by the director to the AI agent corresponding to actor A.

[0126] The AI agent corresponding to actor A inputs the interaction record of the current chapter and the temporary plot into the machine learning model. The output obtained includes the first interaction information of actor A for the player's free input, such as "yyyy". The interaction information "yyyy" can be returned to the user in a streaming manner and displayed on the user interface corresponding to the first type of character A.

[0127] The game engine continues to call the AI agent corresponding to the director and passes the interaction information output by the AI agent corresponding to actor A to the AI agent corresponding to the director.

[0128] The AI agent corresponding to the director determines to provide options 1 and 2 as interactive content to the player according to the plot of the game. The interactive content "option 1 option 2" can be returned to the user in a streaming manner. In response to the player's second input, such as selecting "option 1", the AI agent corresponding to the actor, similar to the process of determining the first target character before, further inputs the player's selection result into the machine learning model. The output obtained also includes the determined next target character and plot.

[0129] The determined next target character may be the same as the first target character. For example, it is still actor A. At this time, actor A can continue to process options 1 and 2 output to the player, as well as the player's selection result and the plot zzzz to generate subsequent interaction information, which will not be elaborated here. Of course, the determined next target character may also be different from the first target character. For example, it is not actor A but actor B.

[0130] In some embodiments, the image of the first target character is displayed, so that the interaction information can be conveyed more clearly and vividly. The following refers to Figures 8A to 8C Exemplarily describes the interface schematic diagram of the interactive multimedia content generated by the above embodiments of the present application.

[0131] In the original plot, the virtual character controlled by the user (assumed to be the protagonist) and NPC 1 on the cruise ship are about to sink. The protagonist and NPC 1 fall into the water, and the user needs to choose whether to take the speedboat to shore or return to the cruise ship. If choosing to take the speedboat to shore, the protagonist and NPC 1 will be saved.Figure 8A In it, the interface 81 shows the NPC 1 in the water, and the dialogue box 811 of the NPC 1 shows "What should we do now?". Also, the options 812 "Go ashore by speedboat" and 813 "Return to the cruise ship" are shown in the interface 81. In addition, the input box 814 is also shown in the interface 81 for the user to freely input.

[0132] If in the interface 81, the user selects "Go ashore by speedboat", then the user's input matches the original plot. At this time, for example, it triggers Figure 8B the content shown in the interface 82 as shown. That is, after going ashore, the dialogue box 821 of the NPC 1 shows "Great, we're finally saved!", and this content is the content in the original plot.

[0133] If in the interface 81, the user inputs "Swim ashore" through the input box 814, then although it is not exactly the same as any of the options, this input content matches the plot of "Go ashore by speedboat", that is, going ashore means being saved. Therefore, the content in the interface 82 can still be triggered at this time.

[0134] If in the interface 81, the user does not select any option but inputs "Wait for the helicopter", then the user's input is neither an option provided by the original plot itself nor matches any option in the original plot. At this time, a temporary plot needs to be generated based on the original plot and the user's above input. The display content corresponding to the temporary plot is, for example, as shown in Figure 8C the interface 83, that is, the dialogue box 831 of the NPC 1 shows "There is no helicopter nearby. Let's think about whether to go ashore or return to the ship!". This content does not appear in the original plot. Or, when it is judged based on the user's input and the original plot that it is reasonable for a helicopter to appear at this time, the plot of the helicopter coming to take away the virtual character controlled by the user and the NPC 1 can be shown.

[0135] Next, refer to Figures 9 to 12 to describe the embodiments of the related devices and equipment of the present disclosure.

[0136] Figure 9 shows a schematic structural diagram of an interaction device according to some embodiments of the present disclosure. As Figure 9As shown, the interaction device 9 of this embodiment includes: an input device 91 configured to receive a first input from a user who controls a virtual character in interactive multimedia content; one or more processors 92 configured to: in response to the first input not matching the original plot of the interactive multimedia content, determine a first target character from one or more first-type characters and generate a temporary plot based on the first input and the original plot of the interactive multimedia content, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; and generate first interaction information of the first target character with respect to the first input based on the first input, the original plot, and the temporary plot; and a display 93 configured to display the first interaction information of the first target character with respect to the first input.

[0137] In some embodiments, the processor 92 may be configured to implement the interaction distribution of any of the foregoing embodiments of the present disclosure.

[0138] Figure 10 The structural schematic diagram of an interaction device according to some other embodiments of the present disclosure is shown. As Figure 10 As shown, the interaction device 10 of this embodiment includes: a receiving module 101 configured to receive a first input from a user who controls a virtual character in interactive multimedia content; a first generation module 102 configured to, in response to the first input not matching the original plot of the interactive multimedia content, determine a first target character from one or more first-type characters and generate a temporary plot based on the first input and the original plot of the interactive multimedia content, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; a second generation module 103 configured to generate first interaction information of the first target character with respect to the first input based on the first input, the original plot, and the temporary plot; and a first display module 104 configured to display the first interaction information of the first target character with respect to the first input.

[0139] In some embodiments, the first generation module 102 is further configured to: process the first input, the original plot, and first prompt information by using a machine learning model, where the first prompt information includes an indication for generating a temporary plot when the user's input does not match the original plot; and obtain the first target character and an interaction information generation indication output by the machine learning model, where the interaction information generation indication includes a temporary plot when the first input does not match the original plot.

[0140] In some embodiments, the first prompt information further includes role information of one or more first-type roles, and an indication of selecting a first target role based on the role information.

[0141] In some embodiments, the second generation module 103 is further configured to: process the first input, the original plot, the temporary plot, and the second prompt information using a machine learning model, where the second prompt information includes role information of the first target role and a memory summary; obtain first interaction information of the first target role with respect to the first input output by the machine learning model.

[0142] In some embodiments, the interaction device further includes a second display module, configured to: in response to the input of the user's consecutive specified times not matching the original plot, generate an indication to end the interactive multimedia content based on the first input and the original plot of the interactive multimedia content; generate second interaction information based on the first input, the original plot, and the indication to end the interactive multimedia content, where the second interaction information indicates the end of the interactive multimedia content; display the second interaction information.

[0143] In some embodiments, the interaction device further includes a third display module, configured to: in response to the first input matching the branch node plot in the original plot, determine a second target role from one or more first-type roles and generate a prompt plot based on the first input and the branch node plot, where the prompt plot is used to imply a specified option among multiple options of the branch node; generate third interaction information of the second target role with respect to the first input based on the first input, the original plot, and the prompt plot; display the third interaction information of the second target role for the first input; display multiple options.

[0144] In some embodiments, the interaction device further includes a fourth display module, configured to: in response to the first input matching the ending in the original plot, generate a transition plot based on the first input and the ending, where the transition plot is used to transition from the current plot to the ending; generate fourth interaction information based on the first input, the original plot, and the transition plot; display the fourth interaction information.

[0145] In some embodiments, the first generation module 102 is further configured to: in response to the first input not matching the original plot of the interactive multimedia content, determine a first target role from one or more first-type roles and generate a temporary plot based on the first input and the original plot of the interactive multimedia content through a first-type role or a second-type role, where the second-type role is not a role in the interactive multimedia content.

[0146] In some embodiments, the interactive multimedia content includes multiple chapters, and the original plot corresponds to one of the multiple chapters of the interactive multimedia content.

[0147] In some embodiments, the first input is natural language text or a selection result of multiple options; the first interaction information includes dialogue text or multiple options.

[0148] In some embodiments, the interaction device further includes a fifth display module configured to display the image of the first target character.

[0149] In some embodiments, the character information includes at least one of character setting, line style, and behavior guidance.

[0150] It should be noted that the above-mentioned respective units are only logical modules divided according to their specific functions implemented, rather than used to limit the specific implementation manners. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned respective units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (such as a CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned respective units are shown by dashed lines in the drawings to indicate that these units may not actually exist, and the operations / functions they implement can be implemented by the processing circuit itself.

[0151] In addition, although not shown, the device may also include a memory, which can store various information generated during the operation of the device and each unit included in the device, programs and data for operation, data to be sent by the communication unit, etc. The memory can be a volatile memory and / or a non-volatile memory. For example, the memory can include, but is not limited to, random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), flash memory. Of course, the memory can also be located outside the device. Optionally, although not shown, the device may also include a communication unit, which can be used to communicate with other devices. In one example, the communication unit can be implemented in a suitable manner known in the art, for example, including communication components such as antenna arrays and / or radio frequency links, various types of interfaces, communication units, etc. Details will not be described here. In addition, the device may also include other components not shown, such as radio frequency links, baseband processing units, network interfaces, processors, controllers, etc. Details will not be described here.

[0152] Some embodiments of the present disclosure also provide an electronic device. Figure 11A block diagram showing some embodiments of the electronic device of the present disclosure. For example, in some embodiments, the electronic device 11 can be various types of devices, such as mobile terminals including but not limited to mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 11 can include a display panel for displaying the data and / or execution results utilized in the solution according to the present disclosure. For example, the display panel can be of various shapes, such as a rectangular panel, an oval panel, or a polygonal panel, etc. Additionally, the display panel can be not only a flat panel but also a curved panel or even a spherical panel.

[0153] As Figure 11 shown, the electronic device 11 of this embodiment includes: a memory 111 and a processor 112 coupled to the memory 111. It should be noted that Figure 11 the components of the electronic device 11 shown are exemplary rather than restrictive. According to actual application requirements, the electronic device 11 can also have other components. The processor 112 can control other components in the electronic device 11 to perform desired functions.

[0154] In some embodiments, the memory 111 is used to store one or more computer-readable instructions. When the processor 112 is used to run the computer-readable instructions, the computer-readable instructions, when run by the processor 112, implement the method according to any of the above embodiments. For the specific implementation of each step of the method and the relevant explanatory content, reference can be made to the above embodiments, and the repeated parts will not be elaborated here.

[0155] For example, the processor 112 and the memory 111 can communicate with each other directly or indirectly. For example, the processor 112 and the memory 111 can communicate through a network. The network can include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 112 and the memory 111 can also communicate with each other through a system bus, and the present disclosure does not limit this.

[0156] For example, the processor 112 can be embodied as various suitable processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The central processing unit (CPU) can be of the X86 or ARM architecture, etc. For example, the memory 111 can include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 111 can, for example, include a system memory which stores, for example, an operating system, application programs, a boot loader, a database, and other programs. Various application programs and various data can also be stored in the storage media.

[0157] In addition, according to some embodiments of the present disclosure, when various operations / processes according to the present disclosure are implemented by software and / or firmware, they can be transferred from a storage medium or a network to a computer system having a dedicated hardware structure, such as Figure 12 the computer system 12 shown, and a program constituting the software is installed. When various programs are installed in the computer system, it can execute various functions, including the functions described above, etc. Figure 12 FIG. shows a schematic structural diagram of a computer system that can be adopted according to some embodiments of the present disclosure.

[0158] In Figure 12 the central processing unit (CPU) 1201 executes various processes according to a program stored in the read-only memory (ROM) 1202 or a program loaded from the storage section 1208 into the random access memory (RAM) 1203. In the RAM 1203, data required when the CPU 1201 executes various processes, etc. is also stored as needed. The central processing unit is merely exemplary, and it can also be other types of processors, such as the various processors described above. The ROM 1202, the RAM 1203, and the storage section 1208 can be various forms of computer-readable storage media, as described below. It should be noted that although Figure 12 the ROM 1202, the RAM 1203, and the storage device 1208 are shown separately in

[0159] one or more of them can be combined or located in the same or different memories or storage modules.

[0160] The following components are connected to the input / output interface 1205: an input section 1206, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output section 1207, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage section 1208, including a hard disk, a magnetic tape, etc.; and a communication section 1209, including a network interface card such as a LAN card, a modem, etc. The communication section 1209 allows communication processing to be performed via a network such as the Internet. It is easily understood that although Figure 12 each device or module in the electronic device 1200 shown in

[0161] communicates through the bus 1204, they may also communicate through a network or other means, where the network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0162] As needed, a driver 1210 is also connected to the input / output interface 1205. A removable medium 1211, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the driver 1210 as needed, so that a computer program read therefrom is installed in the storage section 1208 as needed.

[0163] In the case where the above series of processes are implemented by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 1211.

[0164] It should be noted that in the context of the present disclosure, a computer-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. A computer-readable storage medium can be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device. And in the present disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0165] The above computer-readable medium can be included in the above electronic device; or it can exist separately without being assembled into the electronic device.

[0166] In some embodiments, a computer program is also provided, including: instructions that, when executed by a processor, cause the processor to execute the method of any one of the above embodiments. For example, the instructions can be embodied as computer program code.

[0167] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The foregoing programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network (including a local area network (LAN) or a wide area network (WAN)), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0168] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions noted in the blocks may occur in an order different from that noted in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0169] The modules, components, or units described in the embodiments of the present disclosure may be implemented in software or in hardware. Among them, the names of the modules, components, or units do not, in some cases, constitute a limitation on the modules, components, or units themselves.

[0170] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, by way of non-limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and so on.

[0171] The above description is only some embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) having similar functions disclosed in the present disclosure.

[0172] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In other instances, well-known methods, structures, and techniques have not been shown in detail in order not to obscure the understanding of this description.

[0173] Furthermore, although the operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the present disclosure. Certain features described in the context of separate embodiments may also be implemented combinatorially in a single embodiment. Conversely, the various features described in the context of a single embodiment may also be implemented separately or in any suitable sub-combination in multiple embodiments.

[0174] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art should understand that the above examples are for illustrative purposes only and not for limiting the scope of the present disclosure. Those skilled in the art should understand that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. An interaction method, comprising: receiving a first input from a user, where the user controls a virtual character in interactive multimedia content; in response to the first input not matching the original plot of the interactive multimedia content, determining a first target character from one or more first-type characters and generating a temporary plot based on the first input and the original plot of the interactive multimedia content, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; generating first interaction information of the first target character for the first input based on the first input, the original plot, and the temporary plot; displaying the first interaction information of the first target character for the first input.

2. The interaction method according to claim 1, wherein, the step of, in response to the first input not matching the original plot of the interactive multimedia content, determining a first target character from one or more first-type characters and generating a temporary plot based on the first input and the original plot of the interactive multimedia content includes: processing the first input, the original plot, and first prompt information by using a machine learning model, where the first prompt information includes an indication for generating the temporary plot when the user's input does not match the original plot; obtaining the first target character output by the machine learning model and an indication for generating interaction information, where, when the first input does not match the original plot, the indication for generating interaction information includes the temporary plot.

3. The interaction method according to claim 2, wherein, the first prompt information further includes character information of the one or more first-type characters and an indication for selecting the first target character according to the character information.

4. The interaction method according to claim 1, wherein, the step of generating first interaction information of the first target character for the first input based on the first input, the original plot, and the temporary plot includes: processing the first input, the original plot, the temporary plot, and second prompt information by using a machine learning model, where the second prompt information includes character information and a memory summary of the first target character; obtaining the first interaction information of the first target character for the first input output by the machine learning model.

5. The interaction method according to claim 1, further comprising: in response to the user's input not matching the original plot for a consecutive specified number of times, generating an indication to end the interactive multimedia content based on the first input and the original plot of the interactive multimedia content; generating second interaction information based on the first input, the original plot, and the indication to end the interactive multimedia content, where the second interaction information indicates the end of the interactive multimedia content; displaying the second interaction information.

6. The interaction method according to claim 1, further comprising: In response to the first input matching a branch node plot in the original plot, based on the first input and the branch node plot, determine a second target character from the one or more first-type characters and generate a prompt plot, where the prompt plot is used to imply a specified option among multiple options of the branch node; Based on the first input, the original plot, and the prompt plot, generate third interaction information of the second target character with respect to the first input; Display the third interaction information of the second target character with respect to the first input; Display the multiple options.

7. The interaction method according to claim 1, further comprises: In response to the first input matching an ending in the original plot, based on the first input and the ending, generate a transition plot, where the transition plot is used to transition from the current plot to the ending; Based on the first input, the original plot, and the transition plot, generate fourth interaction information; Display the fourth interaction information.

8. The interaction method according to any one of claims 1 to 7, wherein, the determining a first target character from one or more first-type characters and generating a temporary plot in response to the first input not matching the original plot of the interactive multimedia content, based on the first input and the original plot of the interactive multimedia content includes: In response to the first input not matching the original plot of the interactive multimedia content, determine a first target character from one or more first-type characters and generate a temporary plot based on the first input and the original plot of the interactive multimedia content through a first-type character or a second-type character, where the second-type character is not a character in the interactive multimedia content.

9. The interaction method according to any one of claims 1 to 7, wherein, the interactive multimedia content includes multiple chapters, and the original plot corresponds to one of the multiple chapters of the interactive multimedia content.

10. The interaction method according to any one of claims 1 to 7, wherein: the first input is a natural language text or a selection result of multiple options; the first interaction information includes dialogue text or multiple options.

11. The interaction method according to any one of claims 1 to 7, further comprises: Display the image of the first target character.

12. The interaction method according to claim 3, wherein, the character information includes at least one of a character setting, a line style, and a behavior guide.

13. An interaction device, comprises: An input device configured to receive a first input from a user, where the user controls a virtual character of the interactive multimedia content; One or more processors configured to: In response to the first input not matching the original plot of the interactive multimedia content, based on the first input and the original plot of the interactive multimedia content, determine a first target character from one or more first-type characters and generate a temporary plot, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; and Generate first interaction information of the first target character with respect to the first input based on the first input, the original plot, and the temporary plot; and A display configured to display the first interaction information of the first target character with respect to the first input.

14. An interaction device, comprising: A receiving module configured to receive a first input from a user, where the user controls a virtual character of interactive multimedia content; A first generation module configured to, in response to the first input not matching the original plot of the interactive multimedia content, determine a first target character from one or more first-type characters and generate a temporary plot based on the first input and the original plot of the interactive multimedia content, where the first-type characters are non-user-controlled virtual characters in the interactive multimedia content, and the temporary plot is used to guide the user to provide a second input for triggering the original plot; A second generation module configured to generate first interaction information of the first target character with respect to the first input based on the first input, the original plot, and the temporary plot; A first display module configured to display the first interaction information of the first target character with respect to the first input.

15. An interaction device, comprising: A memory; and A processor coupled to the memory, the processor being configured to execute the interaction method according to any one of claims 1 to 12 based on instructions stored in the memory.

16. A computer-readable storage medium having stored thereon a computer program, which when executed by a processor, implements the interaction method according to any one of claims 1 to 12.

17. A computer program product, which when run on a computer, causes the computer to implement the interaction method according to any one of claims 1 to 12.

Images