Interaction method and apparatus, storage medium and computer program product

Abstract

The present disclosure relates to an interaction method and apparatus, a storage medium, and a computer program product, and relates to the technical field of computers. The interaction method comprises: on the basis of a first character of a first user in a story and a second character of a second user in the story, determining the story progress of the first character; on the basis of information from the first user and the story progress of the first character, generating a first plot image of the first character; and displaying the first plot image of the first character to the first user.

Description

Interaction method, device, storage medium and computer program product TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, in particular to an interaction method, device, storage medium and computer program product. BACKGROUND

[0002] Traditional stories are usually carried by text. In the process of reading various stories by users, various plots can be experienced. Many plots of stories are fascinating, so more and more stories are adapted into TV series, films, audio books and the like works to enhance the immersion of users through audio-visual means.

[0003] SUMMARY

[0004] This summary is provided to introduce a selection of concepts, which are further described below in the detailed description. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it used to limit the scope of the claimed subject matter's scope.

[0005] According to some embodiments of the present disclosure, an interaction method is provided, comprising: determining a story progress of a first role in a story according to the first role and a second role in the story of a second user; generating a first plot image of the first role according to information from the first user and the story progress of the first role; and displaying the first plot image of the first role to the first user.

[0006] According to some embodiments of the present disclosure, an interaction device is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to execute an interaction method of any one of the embodiments of the present disclosure based on instructions stored in the memory.

[0007] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, having stored thereon a computer program, which, when executed by a processor, performs an interaction method of any one of the embodiments of the present disclosure.

[0008] According to some embodiments of the present disclosure, a computer program product is provided, which, when running on a computer, causes the computer to implement a method of any one of the embodiments of the present disclosure.

[0009] According to some embodiments of the present disclosure, a computer program is provided, comprising: instructions which, when executed by a processor, cause the processor to perform a method of any one of the embodiments of the present disclosure.

[0010] Other features, aspects, and advantages of the present disclosure will become apparent from the following detailed description of the example embodiments of the present disclosure with reference made to the following accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0011] The preferred embodiments of the present disclosure will be described below with reference to the accompanying drawings. The drawings used herein are for the purpose of illustrating certain embodiments of the present disclosure and are not intended to limit the present disclosure. The drawings are as follows:

[0012] FIG. 1 shows an embodiment of an interaction method according to some embodiments of the present disclosure.

[0013] FIG. 2 shows a flowchart of a scenario image viewing method according to some embodiments of the present disclosure.

[0014] FIG. 3 shows a flowchart of an interaction method according to some other embodiments of the present disclosure.

[0015] FIG. 4 shows a flowchart of a scenario image generation method according to some embodiments of the present disclosure.

[0016] FIG. 5 shows a schematic diagram of a story selection interface of a user according to some embodiments of the present disclosure.

[0017] FIG. 6 shows a schematic diagram of a role selection interface according to some embodiments of the present disclosure.

[0018] FIG. 7 shows a schematic diagram of a display interface of a story selected by a first user according to some embodiments of the present disclosure.

[0019] FIG. 8 shows a schematic diagram of a scenario card according to some embodiments of the present disclosure.

[0020] FIG. 9 shows a structural schematic diagram of an interaction device according to some embodiments of the present disclosure.

[0021] FIG. 10 shows a structural schematic diagram of an electronic device according to some embodiments of the present disclosure.

[0022] FIG. 11 shows a structural schematic diagram of a computer system according to some embodiments of the present disclosure.

[0023] It should be understood that the dimensions of the various parts shown in the drawings are not necessarily to scale. Identical or similar components are denoted using the same or similar reference signs throughout the various figures. Therefore, once a component is defined in one figure, it can not be discussed further in subsequent figures. DETAILED DESCRIPTION

[0024] The technical solutions in the embodiments of the present disclosure will be clearly and completely described in combination with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, and not all the embodiments. The description of the embodiments below is actually only illustrative, and is by no means any limitation on the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms, and should not be interpreted as being limited to the embodiments set forth herein.

[0025] It should be understood that each of the steps recited in the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect. Unless otherwise specified, the relative arrangement of the components and steps set forth in these embodiments, numerical expressions, and numerical values should be interpreted as merely illustrative, not limiting the scope of the present disclosure.

[0026] The term "comprise" and variations of the term, such as "comprising," "comprises," and "comprised of" as used in the present disclosure, are to be construed as open-ended terms meaning "including, but not limited to," i.e., "including, but not limited to." In addition, the term "include" and variations of the term, such as "includes," "including," and "included," as used in the present disclosure, are to be construed as open-ended terms meaning "including, but not limited to," i.e., "including, but not limited to." Thus, including and comprising are synonymous. The term "based on" means "based, at least in part, on."

[0027] Reference throughout this specification to "an embodiment," "some embodiments," or "embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, although it can. Furthermore, the term "another embodiment" means "at least one additional embodiment" and not necessarily a different embodiment.

[0028] It should be noted that the terms "first", "second", and the like in the present disclosure are used only to distinguish different devices, modules, or units, and do not necessarily mean the order or the mutual dependency of the functions performed by these devices, modules, or units. Unless otherwise specified, the terms "first", "second", and the like are not intended to imply a given order or any other way of a given order.

[0029] It should be noted that the modification of "one", "multiple" mentioned in the present disclosure is illustrative rather than restrictive, and those skilled in the art should understand that "one or more" should be understood unless otherwise explicitly indicated in the context.

[0030] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are only for illustrative purposes, and are not used to limit the scope of the messages or information.

[0031] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined by any suitable means from the present disclosure that is clear to those skilled in the art.

[0032] When reading an exciting story, some users may imagine themselves as a character in the story and act out the story. Although the story carrying forms such as TV series, movies, and audio books can convey the content of the story to the user through more visual and auditory means, in such works, the user cannot substitute themselves into the story. Therefore, the immersion brought to the user is still limited.

[0033] The present disclosure provides an interactive method, device, storage medium and computer program product to solve the technical problem of how to improve user immersion when providing a story for a user.

[0034] The present disclosure supports multiple users participating in the same story and selecting different roles. FIG. 1 shows an embodiment of an interactive method according to some embodiments of the present disclosure. As shown in FIG. 1, the interactive method of this embodiment includes steps S102-S106. The interactive method of this embodiment can be executed by a user device, for example, a user device of a first user.

[0035] In step S102, the story progress of the first role is determined according to the first role of the first user in the story and the second role of the second user in the story.

[0036] The first user and the second user are different users participating in the same story, and each user can view the relevant information of his own role on his own user device. The first user and the second user are any users participating in the story. That is, the embodiments of the present disclosure are described from the perspective of the first user, but the method is also applicable to the second user. According to the needs, the number of users participating in a story can also include more, which is not limited by the present disclosure.

[0037] The story can also be referred to as a script, which describes the plot of a plurality of characters. The story can be carried in a text manner. Part or all of the story can be displayed to the user, or the story can not be displayed to the user. The application can provide one or more selectable stories to the user to determine the story progress of the first character according to the first user's character in the story selected by the first user.

[0038] The first character of the first user in the story can be a default setting or selected by the first user. In some embodiments, the first user selects a character for the second user as the second character with the authorization of the second user. That is, with authorization, a user participating in the story can select a character for another user participating in the story.

[0039] The story progress of a character refers to the plot content currently involved by the character, or the starting point of the plot currently involved by the character in the story, or the starting point and the ending point. For example, a story can include one or more story nodes, and each character in the story can also involve part or all of the nodes. Based on the story progress, it can be determined which plot images corresponding to the current story nodes need to be displayed. Since not all characters in some stories will appear in all story nodes, the current story node can be more accurately determined according to the first character of the first user. Further, the story content corresponding to the current story node can be determined.

[0040] When determining the story progress of the first character, the story progress of the second character is also referred to. The story progress of the two characters should be as corresponding as possible. In some cases, the two characters can currently involve different branches, and there is no mutual dependency between the story nodes in each branch before the plot converges to the same branch. At this time, the story progress of the two characters can be considered as corresponding, and each can be arbitrarily pushed forward. If the two characters are in the same branch, the progress of the two characters needs to be consistent or as consistent as possible to achieve correspondence.

[0041] The story progress of the first character is determined according to the two characters, for example, whether the corresponding story progress of the two characters of the plot that has occurred is corresponding. If corresponding, the story of the two characters is pushed forward at the same progress. If not corresponding, the story of the character who lags behind is pushed forward at a greater rate, or the other character does not push the story forward until the character who lags behind catches up with the progress of the other character.

[0042] In some embodiments, the story progress of the first role is determined according to the unlocked plot of the first role of the first user in the story and the unlocked plot of the second role of the second user in the story. The unlocked plot refers to the plot corresponding to the generated plot image. Based on the unlocked plot, the occurred plot of each role can be determined, and then the story progress of the first role is determined.

[0043] In step S104, the first plot image of the first role is generated according to the information from the first user and the story progress of the first role.

[0044] The information from the first user refers to the information input or specified by the first user. The information from the first user can include at least one of text and image. For example, the first user can upload, input or select the information.

[0045] The information from the first user is used to describe the characteristics of the role. In the story, according to the content of the story or the role setting of the story, the role is given certain characteristics. And the information from the first user can further add characteristics to the role. For example, a role is set as a female student, and the role has female dress and clothing, and the user's information can further determine its appearance, such as facial features, hairstyle, etc.

[0046] In some embodiments, the plot image of the role is generated according to the image of the first user and the story progress of the role. The image of the first user can be the image of himself, such as a photo, a cartoon image, etc., so that the generated plot image has the role, and the role appears in the image of the first user, realizing the effect similar to generating a digital avatar of the first user in the story. Thus, the user can have a more immersive story experience.

[0047] Of course, the above examples do not limit the scheme of the present disclosure. The first user can also use other types of information to represent the characteristics of the ideal role, to flexibly generate the plot image of the role.

[0048] When generating the plot image, the story progress of the role is also referred to. Thus, the generated plot image can also match the story progress. For example, the story progress describes the experience of the first user's role in the forest, and the generated image can be the image of the role in the forest, and the role in the image matches the information from the user.

[0049] In some embodiments, a plot image is generated by using a generative model for generating images. For example, information from the first user and the story progress can be input into the model, and the generated object is instructed. Thus, a plot image that matches the plot corresponding to the information from the user and the story progress is generated. The generative model can be a model for generating images based on text (text-to-image model), or a multi-modal model for generating images based on text and images. The generative model can be a Large Language Model (LLM) or a Foundation Model.

[0050] In step S106, the first user is displayed the first plot image of the first character.

[0051] After displaying the plot image, the story progress of the first character can be updated. Thus, subsequently, steps S102 to S106 can be executed again to generate a new plot image according to the updated story progress.

[0052] After displaying the plot, the first user can share the plot image with the third user. For example, an operation of the first user sharing the plot image with the third user can be received. In response to the operation, the first plot image can be sent to the third user. The shared content can include only the image itself, or can further carry other information, such as an access link to the story homepage of the first user, or an access link to the application, and so on.

[0053] Any one of steps S102 to S106 can be triggered based on a specified operation of the user. For example, the story progress can be determined based on a specified operation of the first user (i.e., step S102), and then steps S104 and S106 are executed in sequence; for another example, steps S102 are executed by default first, and then steps S104 and S106 are executed in response to a specified operation of the first user; for another example, steps S102 and S104 are executed by default first, and then step S106 is executed in response to a specified operation of the first user. The more steps that are executed by default, the more computing resources and storage resources can be occupied, because the user can not perform the specified operation for a long time. However, the more steps that are executed by default, the faster the response speed when the user performs the specified operation. Therefore, a person skilled in the art can make a choice according to needs.

[0054] For example, the specified operation is an unlocking operation, which can be triggered in response to the user logging into the application, in response to the user accessing a specified module in the application, or through a specified control. Thus, the current story to be unlocked (the story corresponding to the story progress of the character) can be determined according to the role of the user in the story, and the plot image of the character is generated according to the story to be unlocked. After displaying the plot image, the state of the story to be unlocked changes to unlocked.

[0055] In some embodiments, the user can also read the story content (e.g., story text). For example, the user can be shown the entire story, or a summary of the entire story, to understand the overall plot. For another example, the user can be shown the story content corresponding to the generated plot image (e.g., the unlocked plot image), while other story content is not shown. For another example, the user can be shown a portion of the story after the story content corresponding to the currently generated plot image, to guide the user to continue unlocking the remaining content while preserving the overall story suspense.

[0056] The above embodiments support multiple users participating in a story, and determine the story progress based on the corresponding role of each user. Then, the plot image is generated using the information from the user and the story progress of the role, so that the generated plot image can be flexibly set by the user on the premise of the story progress, improving the flexibility and immersion of the user experience story, thus improving the interactive experience and the interaction experience between users.

[0057] The first user and the second user can access each other's plot images in the story. Embodiments of a plot image viewing method are described below with reference to FIG. 2.

[0058] FIG. 2 shows a flowchart of a plot image viewing method according to some embodiments of the present disclosure. As shown in FIG. 2, the method of this embodiment includes steps S202 to S204.

[0059] In step S202, an operation of the first user requesting to view a second plot image of a second role is received.

[0060] The first user can request to view all plot images of the second role in the current story, or only a specified plot image. For example, the plot image of a certain day. The plot image requested to be viewed by the first user includes the second plot image.

[0061] In step S204, the second plot image is displayed in a case where the second plot image is unlocked by the second user, wherein the second plot image is generated according to information from the second user and the story progress of the second role.

[0062] In a case where the second plot image is unlocked by the second user, the second plot image is generated and has been browsed by the second user. At this time, the first user can be given the permission to view the image.

[0063] In some embodiments, in response to the operation of the first user requesting to view the second plot image, the second plot image is not displayed in a case where the second plot image is not unlocked by the second user.

[0064] Through the above embodiments, it can be avoided that the to-be-generated scenario image or scenario content of a user is viewed by other users in advance, and user experience is improved.

[0065] Since one story can have only one scenario branch or multiple scenario branches, the plot of the first role and the second role under their respective story progress can be completely independent or have some overlap. In some embodiments of the present disclosure, it can be determined whether the story progress of the first role and the story progress of the second role involve the same scene, and then the content in the scenario image is determined.

[0066] For example, in response to the story progress of the first role and the story progress of the second role involving the same scene, a first scenario image including the first role and the second role is generated according to the image of the first user, the image of the second user, and the story progress of the first role. Thus, in the case that the scenarios involving the current story progress of the first role and the second role have intersections, a “collaborative film” of the two roles can be generated.

[0067] According to needs, certain conditions can also be set for the “collaborative film”. For example, in the case that the operation performed by the first user meets the specified conditions, the “collaborative film” is generated. In the case that the operation performed by the first user does not meet the specified conditions, even if the scenarios of the two roles have intersections, the generated first scenario image only includes the first role and does not include the second role.

[0068] In some embodiments, before the first scenario image including the first role and the second role is generated, it is determined whether the second user has performed an unlocking operation on the scenario corresponding to the image. For example, after the second user performs the unlocking operation, in response to the unlocking operation of the first user, the first scenario image including the first role and the second role is displayed to the first user. Thus, in the case that the first user and the second user both unlock the current scenario, the first scenario image including the first role and the second role is generated again. In this way, it can be avoided that the first user browses the content that is not unlocked by the second user, and user experience is improved.

[0069] In some embodiments, in response to a request of the first user or the second user to regenerate the first scenario image, the first scenario image is regenerated, and the regenerated first scenario image is displayed. Since each generation result of the generative model has certain randomness, for the same input, the generation result can have some differences. Therefore, by regenerating the scenario image, the user can obtain a satisfactory generation result, and the interactive experience is improved.

[0070] The scenario image can be periodically generated, or the user is periodically provided with an entry to trigger generation. Embodiments of generating the scenario image in a period are described below with reference to FIG. 3.

[0071] FIG. 3 shows a flowchart of an interaction method according to some embodiments of the present disclosure. As shown in FIG. 3, the interaction method of this embodiment includes steps S302-S306.

[0072] In step S302, in each cycle, the story progress of the first character in the story in the cycle is determined according to the first character of the first user in the story and the second character of the second user in the story.

[0073] In each cycle, the story progress of the current cycle can be determined according to the first character of the first user in the story and the story progress that the first user has unlocked. For example, the story of the first character can be advanced based on the story nodes of the first character and the second character in the last cycle. The extent of the advancement can be a preset value, for example, both characters are advanced by a specified number of nodes. The extent of the advancement can also be determined according to the difference between the story nodes of the first character and the second character in the last cycle, for example, the character with the earlier progress is advanced by a smaller extent and the character with the later progress is advanced by a larger extent.

[0074] To extend the content consumption time of the user so that the user can fully understand the story information, the content amount in a cycle can be set, which represents how much story content needs to be presented corresponding to the plot image. The content amount corresponding to each cycle can be the same or different. In some embodiments, in each cycle, the story progress of the first character in the cycle is determined according to the first character of the first user in the story and the content amount corresponding to the cycle. The content amount can reflect the number of story nodes on which the current plot image is generated, the length of the story content, or it can also be represented by the number of generated plot images. By setting the content amount of each cycle, the time covered by the interaction between the user and the story can be maintained at a reasonable level.

[0075] The content amount corresponding to each cycle can be adjusted. To improve the interactivity between the first user and other users, in some embodiments, the content amount corresponding to the cycle or other cycles after the cycle is adjusted in response to a third user obtaining a plot image and performing a specified operation. For example, the first user can share the plot image with the third user, or, with the authorization of the first user, the third user can access the home page of the first user to view the plot image. The third user can perform operations associated with the plot image such as unlocking, liking, collecting, forwarding, etc. to obtain adjustment of the content amount. The adjustment of the content amount can affect the current cycle, a certain number of cycles after the current cycle, or all cycles after the current cycle. Thus, the plot image of the first user can be shown to more users, improving the propagation efficiency of the personalized plot image of the first user.

[0076] In step S304, a first plot image of the first character in the period is generated according to the information from the first user and the story progress of the first character.

[0077] In step S306, the first plot image of the first character in the period is displayed to the first user.

[0078] Steps S302, S304 or S306 can be executed by default or in response to a specified operation of the first user. If a certain step needs to be executed in response to a specified operation, the step is not executed if the first user does not perform the specified operation in a period. That is, the story progress of the first character in the period is not updated without determining the story progress in the period, or without generating the first plot image, or without displaying the first plot image.

[0079] An application scenario of periodic unlocking is described below as an example. The first user can log in to the application every day and unlock a first number of plot images every day. If the first user has unlocked the first number of plot images on a certain day, no new plot image is generated on the day. However, the first user can unlock an additional second number of plot images on the day after the first user forwards the plot images to the third user and the third user performs the unlocking operation.

[0080] The above embodiments can support the user to periodically obtain plot images, so as to control the total time length involved in the interaction process between the user and the story within a certain range, and improve the interaction effect of the user.

[0081] In some generated plot images, a character image and an environment image can be included. Therefore, the features of the character and the features of the environment can be determined respectively, and the plot image is generated. An embodiment of a method for generating a plot image is described below with reference to FIG. 4.

[0082] FIG. 4 shows a flowchart of a method for generating a plot image according to some embodiments of the present disclosure. As shown in FIG. 4, the generating method of this embodiment includes steps S402 to S406.

[0083] In step S402, the features of the first character are determined by using the information from the first user.

[0084] The features of the character can be description information of the character (which can be carried by text, image, etc.) or image features of the character (such as color, texture, corner point, etc.). Alternatively, the image features of the character can be further generated by using the description information of the character.

[0085] In step S404, the features of the first environment are determined by using the story progress of the first character.

[0086] Similar to the character features, the environment features can also be description information of the environment, or image features of the environment.

[0087] In step S406, a first plot image is generated according to the first character features and the first environment features.

[0088] In generating the plot image, an image generation model can be utilized. For example, the information from the first user and the story progress are input into the model, and the role of each part of information is indicated. The model can be instructed to generate a character using the information from the first user, generate an environment using the story progress, and fuse the generated contents to display in the same image.

[0089] The generation method of the second plot image is also similar, that is, the information from the second user is utilized to determine the second character features, the story progress of the second character is utilized to determine the second environment features, and the second plot image is generated according to the second character features and the second environment features.

[0090] Through the above embodiments, various types of contents in the plot image can be indicated according to various types of information, so as to generate a plot image that is more matched with the information and the story of the user.

[0091] Next, an interactive process is exemplarily described with reference to FIGS. 5 to 8.

[0092] FIG. 5 exemplarily shows a schematic diagram of a story selection interface of a user. The user in this embodiment can be any one of the first user or the second user, and for the convenience of description, the first user is taken as an example here. As shown in FIG. 5, the story selection interface 5 of this embodiment includes story selection controls 51 and 52, each of which corresponds to a different story. According to the triggering operation of the first user on the story selection control, the story selected by the first user can be determined.

[0093] After the first user selects the story, the first user can invite the second user to join the story. For example, a link of the selected story is sent to the second user, so that the second user determines whether to join the story.

[0094] FIG. 6 exemplarily shows a schematic diagram of a character selection interface. As shown in FIG. 6, the character selection interface 6 of this embodiment includes one or more character selection controls 61, 62, 63, each of which corresponds to a different character. According to the triggering operation of the first user on the character selection control, the character selected by the first user can be determined. In addition, the interface 6 can also include story cover 64, story probability 65 and the like, so as to enable the first user to understand the information of the story. The interface 6 can also include a confirmation control 66. In response to the triggering of the confirmation control 66, the character selected by the user is determined.

[0095] In some embodiments, if the second user has joined the story and selected a role, the interface 6 can also display this information. For example, the selection control corresponding to the role is marked, and when the first user selects the role, the selection control corresponding to the role selected by the second user is set to an unavailable state.

[0096] FIG. 7 schematically shows a display interface of a story selected by the first user. As shown in FIG. 7, the display interface 7 includes controls 71 and 72 corresponding to one or more stories selected by the user. Taking the story corresponding to the control 71 as an example, the story is a two-person story, and the interface 7 can display a story cover 711, a role image selected by the first user 712, a role image selected by the second user 713, a current story progress 714, and the like. The role images 712 and 713 selected by the user can be original role images or images regenerated according to information from the user and setting information of the role (e.g., original setting images or description text). The current story progress 714 is exemplarily represented by the current node and all nodes of the story, for example, in FIG. 7, “3 / 7” indicates that the current progress is to the third story node, and the first role has a total of 7 story nodes in the story.

[0097] In response to the triggering operation of the control 71 or 72 by the first user, a page corresponding to the story can be entered. For example, generation and display of a new plot image can be triggered, or the first user can be shown a generated plot image under the story.

[0098] The plot image can be carried in the form of a card. In some embodiments, a first plot card is displayed, the first plot card including a first plot image and a first plot description generated according to the story progress of the first role. The first plot card can also include more information or more controls as needed. A second plot card of the second user can also be implemented in a similar manner, which is not described here again.

[0099] FIG. 8 shows a schematic view of a plot card according to some embodiments of the present disclosure. As shown in FIG. 8, the plot card 8 includes a plot image 81 and a plot description 82. The plot image 81 is generated according to information from the user and the story progress. The plot description can be the original text in the story or generated according to information from the user and a story outline provided by the story to produce a more personalized and richer plot card.

[0100] In some embodiments, after displaying the first plot image, the first plot image is re-generated in response to the first user triggering a specified control. For example, a refresh control 83 can be displayed on the first plot card or on the interface where the first plot card is located to trigger the re-generation of the first plot image. Since each generation result of the generative model has a certain randomness, the generation result may differ for the same input. Therefore, by re-generating the plot image, the user can obtain a satisfactory generation result, improving the interactive experience.

[0101] In the process of interaction of the user in a certain story, in addition to generating plot images, more interactive means can also be provided to further improve the diversity of the generated plot images.

[0102] In some embodiments, the user can switch roles. For example, the role of the first user in the story is a first role, and the story also includes a second role. In response to the first user switching from the first role to a third role, the story progress of the third role is determined according to the story progress of the first role and the second role of the second user. According to the story progress of the first role, the overall progress of the story can be determined, and then the story progress of the third role is determined according to the overall progress of the story, so that the story progress of the third role matches the overall progress of the story. For example, the story nodes of each role and the dependency or sequence between the story nodes of different roles can be pre-set to determine the story nodes of the third role corresponding to the story nodes of the first role and the second role.

[0103] In this way, the user can freely switch between different selectable roles, and after switching the role, the plot can continue to be advanced according to the original overall story progress, reducing the probability of the user receiving repeated information and improving the diversity of the user's information acquisition.

[0104] In some embodiments, the story includes multiple branches, and the story progress of the first role can be determined according to the first role of the first user in the story, the second role of the second user, and the branch selected by the first user. For example, when the story advances to a certain node, and at this node, the first user selects the first role to decide whether to go to location A or location B, different choices will affect the subsequent plot, i.e., leading to different plot branches, at which time the first user can make a choice. Therefore, the user can participate in the decision-making of the story advancement, improving the user's interactivity.

[0105] The user can make a selection through the interactive control. For example, in response to there being multiple branches after the current story progress of the first role, display selection controls of the multiple branches. The selection controls can be displayed before the generation of the scenario image to affect the scenario image currently being generated; or, the selection controls can also be displayed after the generation of the scenario image to affect the image generated next time. Taking the first user triggering the generation of the scenario image through the unlocking operation as an example, the selection controls can be displayed after the first user performs the unlocking operation, and the story progress of the first role is determined through the operation result of the first user on the selection controls, and the scenario image of the current unlocking is generated according to the determined story progress; or, the selection controls can be displayed after the generation of the scenario image of the current unlocking, so as to determine the story progress referred to when generating the scenario image next time according to the operation result of the first user on the selection controls.

[0106] To further improve the interactivity of the story, embodiments of the present disclosure also support adding a spectator. In some embodiments, a first user receives an invitation operation of a third user, and after the third user accepts the invitation, the third user has the permission to view the scenario image of the first user. The first user can invite the third user by sending an invitation link to the third user, and the invitation link can be sent to the third user explicitly or implicitly, specifically, the link can be directly displayed or a control (such as a picture, a button, etc.) containing the link can be displayed to the third user. Thus, the third user can view the scenario image already generated for the first user to understand the visualized story content personalized generated for the first user.

[0107] The third user can also have the permission to modify the story. The permission can be the permission that the third user has by default after accepting the invitation, the permission that the third user has after meeting certain conditions, or the permission authorized by the first user and the second user. In the case that the third user has the permission to modify, in some embodiments, in response to a modification operation of the third user on the story, the story is modified. After the third user modifies the story participated by the first user and the second user, the story progress of the first role and the second role is determined according to the story modified by the second user. Thus, the interactivity between users is improved, and the diversity of the generated scenario image is also improved.

[0108] When the third user modifies the story, the third user can modify the text of the story in detail or can only modify the summary of the story. In some embodiments, a modified story is generated according to the prompt word input by the third user and the story. For example, the prompt word input by the third user and the story can be input into a generative model, and a modification instruction is input into the generative model. The modification instruction can indicate that the story is modified according to the prompt word. Then, the modified story output by the generative model is obtained. The generative model is, for example, a large language model or a base model. Through the strong natural language understanding capability of the generative model, the complexity of the modification operation of the second user can be simplified.

[0109] After generating one or more plot images, the user can view the images one by one. In some embodiments, multimedia content can also be generated according to one or more plot images of the first user. Considering that the first user and the second user jointly participate in the same story but can experience different branches, multimedia content can also be generated according to the plot images corresponding to the story of the first user and the second user. For example, multimedia content can be generated according to the plot images corresponding to a certain story of the first user and the second user, so that the plot images of a certain story can be integrated to form a complete story conveyed by images. Of course, the multimedia content can also be accompanied by text, such as story content or plot description in a plot card. The multimedia content can be generated after the entire story is unlocked, or can be generated in response to a request of the user.

[0110] The multimedia content can be a video or an e-book, or can also be other forms of files. In the process of generating a video, the user can manually or automatically add background music, story dialogue, sound effects, and the like. The e-book can be presented in the form of a comic book, for example, each page includes one or more plot images to improve the reading experience of the user.

[0111] By generating multimedia content, the user can more efficiently browse the generated plot images, improving the interactive experience of the user.

[0112] The above describes the method of each embodiment of the present disclosure in an exemplary manner. The device and equipment for executing the method of each embodiment described above are further described below.

[0113] FIG. 9 shows a structural schematic diagram of an interaction device according to some embodiments of the present disclosure. As shown in FIG. 9, the interaction device 9 of this embodiment includes: a determination module 901 configured to determine a story progress of a first role in a story according to the first role of the first user in the story and a second role of the second user in the story; a generation module 902 configured to generate a first plot image of the first role according to information from the first user and the story progress of the first role; and a display module 903 configured to display the first plot image of the first role to the first user.

[0114] In some embodiments, the determination module 901 is further configured to determine the story progress of the first role according to an unlocked plot of the first role of the first user in the story and an unlocked plot of the second role of the second user in the story.

[0115] In some embodiments, the generation module 902 is further configured to generate the first plot image including the first role and the second role according to the image of the first user, the image of the second user and the story progress of the first role in response to the story progress of the first role and the story progress of the second role involving the same scene.

[0116] In some embodiments, the display module 903 is further configured to display the first plot image including the first role and the second role to the first user in response to the unlocking operation of the first user after the second user performs the unlocking operation.

[0117] In some embodiments, the display module 903 is further configured to re-generate the first plot image in response to the first user or the second user requesting to re-generate the first plot image, and display the re-generated first plot image.

[0118] In some embodiments, the display module 903 is further configured to display the second plot image in response to the first user requesting to view the second plot image of the second role in the case that the second user has unlocked the second plot image, wherein the second plot image is generated according to information from the second user and the story progress of the second role.

[0119] In some embodiments, the display module 903 is further configured to not display the second plot image in response to the first user requesting to view the second plot image of the second role in the case that the second user has not unlocked the second plot image.

[0120] In some embodiments, the determining module 901 is further configured to determine, in each period, a story progress of the first role in the period according to the first role of the first user in the story and a second role of the second user in the story; and the displaying module 903 is further configured to display the first plot image of the first role to the first user comprises: display the first plot image of the first role in the period to the first user.

[0121] In some embodiments, the determining module 901 is further configured to determine the role selected by the first user for the second user as the second role in the case that the second user authorizes.

[0122] In some embodiments, the interaction apparatus 9 further comprises a receiving module 904 configured to receive an invitation operation of the first user to the third user, wherein the third user has the permission to view the plot image of the first user after accepting the invitation.

[0123] In some embodiments, the interaction apparatus 9 further comprises a modifying module 905 configured to modify the story in response to a modification operation of the third user to the story.

[0124] In some embodiments, the generating module 902 is further configured to determine the first role feature by using the information from the first user, and determine the first environment feature by using the story progress of the first role, and generate the first plot image according to the first role feature and the first environment feature.

[0125] In some embodiments, the displaying module 903 is further configured to display a first plot card, the first plot card comprising the first plot image and a first plot description, the first plot description being generated according to the story progress of the first role.

[0126] In some embodiments, the information of the first user comprises at least one of a text and an image.

[0127] In some embodiments, the generating module 902 is further configured to generate a multimedia content according to the plot image corresponding to the story of the first user and the second user, the multimedia content being a video or an electronic book.

[0128] It should be noted that the above-mentioned various units are only logical modules according to the specific functions they implement, and are not used to limit the specific implementation manner, for example, they can be implemented in software, hardware or a combination of software and hardware. In actual implementation, the above-mentioned various units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned various units are indicated by dashed lines in the drawings, indicating that these units can not actually exist, and the operations / functions they implement can be implemented by the processing circuit itself.

[0129] Further, although not shown, the device can also include a memory that can store various information generated by the device, the various units included in the device in operation, programs and data for operation, data to be transmitted by the communication unit, and the like. The memory can be a volatile memory and / or a non-volatile memory. For example, the memory can include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read only memory (ROM), a flash memory. Of course, the memory can also be located outside the device. Alternatively, although not shown, the device can also include a communication unit that can be used to communicate with other devices. In one example, the communication unit can be implemented in an appropriate manner known in the art, for example, including a communication component such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, and the like. Here will not be described in detail. In addition, the device can also include other components not shown, such as radio frequency links, baseband processing units, network interfaces, processors, controllers, and the like. Here will not be described in detail.

[0130] Some embodiments of the present disclosure also provide an electronic device. FIG. 10 shows a structural schematic diagram of an electronic device according to some embodiments of the present disclosure. For example, in some embodiments, the electronic device 10 can be various types of devices, for example, can include but is not limited to various types of mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), and the like, and various types of fixed terminals such as digital TVs, desktop computers, and the like. For example, the electronic device 10 can include a display panel for displaying data and / or execution results utilized in the schemes according to the present disclosure. For example, the display panel can be various shapes, such as a rectangular panel, an oval panel, or a polygonal panel, and the like. In addition, the display panel can not only be a flat panel, but also a curved panel, or even a spherical panel.

[0131] As shown in FIG. 10, the electronic device 10 of this embodiment includes a memory 101 and a processor 102 coupled to the memory 101. It should be noted that the components of the electronic device 10 shown in FIG. 10 are only exemplary and are not limiting, and the electronic device 10 can also have other components according to actual application needs. The processor 102 can control other components in the electronic device 10 to perform desired functions.

[0132] In some embodiments, the memory 101 is configured to store one or more computer readable instructions. When the processor 102 is configured to execute the computer readable instructions, the computer readable instructions are executed by the processor 102 to implement the method according to any of the above embodiments. For the specific implementation of each step of the method and related explanations, please refer to the above embodiments, and the repeated parts will not be described here.

[0133] For example, the processor 102 and the memory 101 can communicate with each other directly or indirectly. For example, the processor 102 and the memory 101 can communicate through a network. The network can include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 102 and the memory 101 can also communicate with each other through a system bus, and the present disclosure does not limit the processor 102 and the memory 101.

[0134] For example, the processor 102 can be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processing unit (NP), etc.; and can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. The central processing unit (CPU) can be X86 or ARM architecture, etc. For example, the memory 101 can include any combination of various forms of computer readable storage media, such as volatile memory and / or non-volatile memory. The memory 101 may, for example, include system memory, which may, for example, store an operating system, application programs, a boot loader, a database, and other programs, etc. Various application programs and various data, etc. can also be stored in the storage medium.

[0135] In addition, according to some embodiments of the present disclosure, various operations / processes according to the present disclosure, when implemented by software and / or firmware, can install programs constituting the software from a storage medium or a network to a computer system with a dedicated hardware structure, such as the computer system 110 shown in FIG. 11, which, when various programs are installed, can perform various functions, including functions such as those described above, etc. FIG. 11 shows a structural schematic diagram of a computer system according to some embodiments of the present disclosure.

[0136] In FIG. 11, a central processing unit (CPU) 1101 performs various processes in accordance with a program stored in a read only memory (ROM) 1102 or a program loaded from a storage section 1108 to a random access memory (RAM) 1103. In the RAM 1103, data required when the CPU 1101 performs various processes and the like is also stored as necessary. The central processing unit is merely exemplary, and can also be other types of processors, such as the various processors described above. The ROM 1102, the RAM 1103, and the storage section 1108 can be various forms of computer readable storage media, as described below. Note that, although the ROM 1102, the RAM 1103, and the storage 1108 are shown separately in FIG. 11, one or more of them can be combined or located in the same or different memory or storage modules.

[0137] The CPU 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output interface 1105 is also connected to the bus 1104.

[0138] The following components are connected to the input / output interface 1105: an input section 1106, such as a touch panel, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, and the like; an output section 1107, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, and the like; a storage section 1108, including a hard disk, a magnetic tape, and the like; and a communication section 1109, including a network interface card, such as a LAN card, a modem, and the like. The communication section 1109 allows communication processing to be performed via a network, such as the Internet. It is readily understood that, although the various devices or modules in the computer system 110 are shown in FIG. 11 as communicating through the bus 1104, they can also communicate through a network or other means, where the network can include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0139] A drive 1110 is also connected to the input / output interface 1105 as necessary. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like, is mounted on the drive 1110 as necessary, so that a computer program read therefrom is installed in the storage section 1108 as necessary.

[0140] In the case where the above series of processes are implemented by software, the program constituting the software can be installed from a network, such as the Internet, or a storage medium, such as the removable medium 1111.

[0141] According to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer readable medium, the computer program comprising program code for performing the methods illustrated by the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the CPU 601, the above-described functions defined in the methods of the embodiments of the present disclosure are performed.

[0142] It should be noted that, in the context of the present disclosure, a computer readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable medium can be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the above. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer readable storage medium can be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, the computer readable signal medium can include a data signal carried in a baseband or as part of a carrier wave, in which the computer readable program code is carried. Such a propagated data signal can take any of a variety of forms, including but not limited to electro-magnetic, optical, or any suitable combination thereof. The computer readable signal medium can also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer readable medium can be transmitted by any suitable medium, including but not limited to wire, cable, RF (radio frequency), or any suitable combination thereof.

[0143] The above computer readable medium can be included in the above electronic device; or can exist separately, without being assembled into the electronic device.

[0144] In some embodiments, a computer program including instructions which, when executed by a processor, causes the processor to carry out the method of any of the above embodiments is also provided. For example, the instructions can be embodied in a computer program code.

[0145] In an embodiment of the disclosure, computer program code to carry out operations of the disclosure can be written in one or more programming languages, or combinations thereof, including object oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0146] The flow diagrams and the block diagrams in the drawings are illustrations of possible architectures, functions, and operations for systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0147] The modules, components or units described in the embodiments of the present disclosure can be implemented by software or by hardware. In some cases, the name of the module, component or unit does not constitute a limitation on the module, component or unit itself.

[0148] The functionality described above in this document can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, non- transitory machine-readable media can include RAM, ROM, programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, compact disk read-only memory (CD-ROM), digital versatile disk (DVD), Blu-ray, or another non-transitory medium suitable for storing non-transitory program code, wherein the above aforementioned media can be read and written by, for example, a machine- readable media reader and a machine-readable media recording device, respectively. In this document, the terms "non-transitory machine- readable storage medium" and "non-transitory machine-readable storage media" mean the above-described media except for a transitory signal per se.

[0149] The above description is merely exemplary of some embodiments of the disclosure and of the technology principle employed. It is understood that the scope of the disclosure is not limited to the specific combinations of technical features disclosed above, but rather covers any other technical solution that falls within the scope of the disclosure, which is defined by the appended claims, and which is derived from the technical features disclosed above or their equivalent features. For example, technical solutions formed by replacing the above-described features with technical features having similar functions disclosed in the disclosure (but not limited to) with each other.

[0150] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application can be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

[0151] In addition, while operations are depicted in a particular, chronological sequence, this should not be understood as requiring such order unless otherwise specifically indicated, and one or more additional operations being performed and / or operations being performed in different sequences can be appropriate. In some instances, details and other implementations can vary considerably from those described in the foregoing detailed description without departing from the scope of the present disclosure. The sole and exclusive judge of the scope of the described disclosure is the appended claims. Other implementations, objects and advantages of the disclosure will be or become apparent to the reader herein based upon the foregoing description.

[0152] While some particular embodiments of the present disclosure have been described in detail, it is to be understood that the examples are for illustrative purposes only and are not meant to limit the scope of the present disclosure. Those skilled in the art should understand that modifications can be made to the above-described embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. An interaction method, comprising: determining a story progress of a first role in a story according to the first role and a second role in the story; generating a first scenario image of the first role according to information from the first user and the story progress of the first role; displaying the first scenario image of the first role to the first user.

2. The interaction method of claim 1, wherein, The determining a story progress of a first role in a story according to the first role and a second role in the story comprises: determining a story progress of a first role in a story according to an unlocked scenario of the first role and an unlocked scenario of a second role in the story.

3. The interaction method according to claim 1 or 2, wherein, The generating a first scenario image of the first role comprises: in response to the story progress of the first role and the story progress of the second role involving a same scene, generating the first scenario image including the first role and the second role according to an image of the first user, an image of the second user and the story progress of the first role.

4. The interaction method of claim 3, wherein, The displaying the first scenario image of the first role to the first user comprises: in response to an unlocking operation of the first user after the second user performs an unlocking operation, displaying the first scenario image including the first role and the second role to the first user. 5.The interaction method of claim 3 or 4, further comprising: in response to a request of the first user or the second user to regenerate the first scenario image, regenerating the first scenario image; displaying the regenerated first scenario image. 6.The interaction method of any one of claims 1 to 5, further comprising: in response to an operation of the first user requesting to view a second scenario image of the second role, displaying the second scenario image in a case that the second user has unlocked the second scenario image, wherein the second scenario image is generated according to information from the second user and a story progress of the second role. 7.The interaction method of claim 6, further comprising: in response to the operation of the first user requesting to view the second scenario image, not displaying the second scenario image in a case that the second user has not unlocked the second scenario image. 8.The interaction method of any one of claims 1 to 7, wherein: The determining a story progress of a first role in a story according to the first role and a second role in the story comprises: in each period, determining a story progress of the first role in the period according to the first role and the second role in the story; The displaying the first scenario image of the first role to the first user comprises: displaying the first scenario image of the first role in the period to the first user. 9.The interaction method of any one of claims 1 to 8, further comprising: In the case that the second user authorizes, determining the role selected by the first user for the second user as the second role. 10.The interaction method of any one of claims 1 to 9, further comprising: receiving an invitation operation of the first user to a third user, wherein the third user has a permission to view a scenario image of the first user after accepting the invitation. 11.The interaction method of claim 10, further comprising: in response to a modification operation of the third user to the story, modifying the story.

12. The interaction method of any one of claims 1 to 11, wherein, generating the first scenario image of the first role according to information from the first user and a story progress of the first role comprises: determining a first role feature using the information from the first user; determining a first environment feature using the story progress of the first role; generating the first scenario image according to the first role feature and the first environment feature.

13. The interaction method of any one of claims 1 to 12, wherein, displaying the first scenario image comprises: displaying a first scenario card, the first scenario card including the first scenario image and a first scenario description generated according to the story progress of the first role.

14. The interaction method of any one of claims 1 to 13, wherein, The information of the first user includes at least one of text, image. 15.The interaction method of any one of claims 1 to 14, further comprising: generating a multimedia content according to scenario images of the first user and the second user corresponding to the story, the multimedia content being a video or an electronic book. 16.An interaction apparatus comprising: a memory; and a processor coupled to the memory, the processor configured to perform the interaction method of any one of claims 1 to 15 based on instructions stored in the memory. 17.A computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the interaction method of any one of claims 1 to 15. 18.A computer program product which, when run on a computer, causes the computer to implement the interaction method of any one of claims 1 to 15. 19.A computer program comprising: instructions which, when executed by a processor, cause the processor to perform the interaction method of any one of claims 1 to 15.

Images