Interaction method and device, storage medium, and computer program product
By using generative models to generate narrative images based on user information and story progress, the problem of insufficient user immersion in traditional story formats is solved, achieving higher interactivity and immersion, providing multimedia content display, and enhancing the user experience.
Patent Information
- Application Number
- PCT/CN2024/110168
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-06
- Publication Date
- 2026-02-12
AI Technical Summary
Traditional storytelling formats cannot fully enhance user immersion, as users cannot identify with the story and the immersion is limited.
By generating narrative images based on the user's role and progress in the story, and using a generative model to combine user information and story progress, narrative images that match the user's information are generated. Interactive means such as role switching, branch selection, and user interaction are provided to enhance the user's sense of participation and immersion.
It enhances the flexibility and immersion of the user's story experience, strengthens the interactivity between the user and the story, improves the dissemination efficiency of personalized plot images, and provides richer ways to display multimedia content.
Smart Images

Figure CN2024110168_12022026_PF_FP_ABST
Abstract
Description
Interaction method, device, storage medium and computer program product TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of computer, in particular to an interaction method, device, storage medium and computer program product. BACKGROUND
[0002] Traditional stories are usually carried by text. In the process of reading various stories by users, various plots can be experienced. Many plots of stories are fascinating, so more and more stories are adapted into TV series, films, audio books and the like works to enhance the immersion of users through audio-visual means.
[0003] SUMMARY
[0004] This summary is provided to introduce a selection of concepts, which are further described below in the detailed description. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used in limiting the scope of the claimed subject matter.
[0005] According to some embodiments of the present disclosure, an interaction method is provided, comprising: determining a story progress of a role according to a role of a first user in a story; generating a plot image of the role according to information from the first user and the story progress of the role; and displaying the plot image.
[0006] According to some embodiments of the present disclosure, an interaction device is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to execute an interaction method of any of the embodiments of the present disclosure based on instructions stored in the memory.
[0007] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, having stored thereon a computer program, which, when executed by a processor, performs the method of any of the embodiments of the present disclosure.
[0008] According to some embodiments of the present disclosure, a computer program product is provided, which, when running on a computer, causes the computer to implement the method of any of the embodiments of the present disclosure.
[0009] According to some embodiments of the present disclosure, a computer program is provided, comprising: instructions which, when executed by a processor, cause the processor to perform the method of any of the embodiments of the present disclosure.
[0010] Other features, aspects, and advantages of the present disclosure will become apparent from the following detailed description of the example embodiments of the present disclosure with reference made to the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS
[0011] Preferred embodiments of the present disclosure are described herein with reference to the accompanying drawings. The accompanying drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the present disclosure and, together with the description, serve to explain the present disclosure. It should be understood that the drawings are only illustrative of some embodiments of the present disclosure and are, therefore, not to be considered limiting of the disclosure. In the drawings:
[0012] FIG. 1 shows an embodiment of an interaction method according to some embodiments of the present disclosure.
[0013] FIG. 2 shows a flowchart of an interaction method according to some embodiments of the present disclosure.
[0014] FIG. 3 shows a flowchart of a method for generating a scenario image according to some embodiments of the present disclosure.
[0015] FIG. 4 shows a schematic diagram of a story selection interface.
[0016] FIG. 5 shows a schematic diagram of a character selection interface.
[0017] FIG. 6 shows a schematic diagram of a display interface of a story selected by a user.
[0018] FIG. 7 shows a schematic diagram of a scenario card according to some embodiments of the present disclosure.
[0019] FIG. 8 shows a schematic diagram of a structure of an interaction device according to some embodiments of the present disclosure.
[0020] FIG. 9 shows a schematic diagram of a structure of an electronic device according to some embodiments of the present disclosure.
[0021] FIG. 10 shows a schematic diagram of a structure of a computer system according to some embodiments of the present disclosure.
[0022] It should be understood that the dimensions of the various portions shown in the drawings are not necessarily to scale. Identical or similar reference numerals are used throughout the various drawings to refer to identical or similar parts. Thus, once a component is defined in one drawing, it can not be discussed further in subsequent drawings. DETAILED DESCRIPTION
[0023] The technical solutions in the embodiments of the present disclosure will be described clearly and completely below with reference to the drawings in the embodiments of the present disclosure. However, it is obvious that the described embodiments are only some of the embodiments of the present disclosure, but not all the embodiments. The description of the embodiments below is actually only illustrative, and should not be considered as any limitation on the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms, and should not be interpreted as being limited to the embodiments described herein.
[0024] It is understood that various steps recited in the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit performing the steps shown. The scope of the present disclosure is not limited in this regard. The relative arrangement of components and steps, numerical expressions, and numerical values set forth in these examples are to be interpreted as merely exemplary, and not limiting of the scope of the present disclosure, unless otherwise specifically stated.
[0025] The term "include," and derivations thereof, means the term "comprise" or "contain," and derivatives thereof, as an open-ended term that does not exclude additional elements or features. In addition, the term "comprise" and derivations thereof, as used in the present disclosure, means the term "include" or "contain," and derivatives thereof, as an open-ended term that does not exclude additional elements or features. Thus, include and comprise are synonymous. The term "based on" means "based, at least in part, on."
[0026] Reference throughout this specification to "one embodiment," "some embodiments" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrase "in one embodiment" or "in some embodiments" in various places in the specification are not necessarily all referring to the same embodiment, although it can. Furthermore, the terms "a" or "an," as used herein, mean "one or more" or "at least one."
[0027] It should be noted that the terms "first", "second", and so on used in the present disclosure are merely used to distinguish different devices, modules or units, and do not imply the order or sequence of the functions performed by the devices, modules or units. Unless otherwise specified, the terms "first", "second", and so on are not intended to imply a given order or sequence of the objects described.
[0028] It should be noted that the terms "one", "multiple", and the like used in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise explicitly specified in the context, they should be understood as "one or more".
[0029] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are merely used for illustrative purposes, and are not intended to limit the scope of the messages or information.
[0030] Embodiments of the present disclosure are described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to the specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described in some embodiments. In addition, in one or more embodiments, specific features, structures, or characteristics can be combined by any suitable means from the present disclosure that will be clear to those of ordinary skill in the art.
[0031] When reading an exciting story, some users may imagine themselves as a character in the story and act out the story. Although television dramas, movies, and audio books can convey the content of the story to users through more visual and auditory means, users cannot immerse themselves in such works. Therefore, the immersion of users is still limited.
[0032] The present disclosure provides an interactive method, device, storage medium and computer program product to solve the technical problem of how to improve user immersion when providing a story for a user.
[0033] FIG. 1 shows an embodiment of an interactive method according to some embodiments of the present disclosure. As shown in FIG. 1, the interactive method of this embodiment includes steps S102-S106. The interactive method of this embodiment can be executed by a user device, for example, a user device of a first user.
[0034] In step S102, the story progress of the character is determined according to the character of the first user in the story.
[0035] The story can also be referred to as a script, which describes the plot of one or more characters. It can be carried in a text manner. Part or all of the content of the story can be displayed to the user, or the story can not be displayed to the user. The application can provide one or more selectable stories to the user to determine the story progress of the character according to the character of the first user in the story selected by the first user.
[0036] The character of the first user in the story can be a default setting or a selection of the first user.
[0037] The story progress of the character refers to the plot content currently involved by the character, or the starting point of the plot currently involved by the character in the story, or the starting point and the ending point. For example, a story can include one or more story nodes, and each character in the story can also be involved in part or all of the nodes. Based on the story progress, it can be determined which story nodes corresponding to the plot images need to be displayed at present. Since not all characters in some stories will appear in all story nodes, the current story node can be more accurately determined according to the character of the first user. Further, the story content corresponding to the current story node can be determined.
[0038] In step S104, a plot image of the role is generated according to the information from the first user and the story progress of the role.
[0039] The information from the first user refers to information input or specified by the first user. The information from the first user can include at least one of text, image, etc. For example, the user can upload, input or select the information.
[0040] The information from the first user is used to describe the characteristics of the role. In a story, a role is endowed with certain characteristics according to the content of the story or the role setting of the story. The information from the first user can further add characteristics to the role. For example, a role is set as a female student, and the role has female dress and clothing, and the user's information can further determine its appearance, such as facial features, hairstyle, etc.
[0041] In some embodiments, a plot image of the role is generated according to the image of the first user and the story progress of the role. The image of the first user can be an image of oneself, such as a photo, a cartoon image, etc. In this way, the generated plot image has the role, and the role appears in the image of the first user, realizing an effect similar to generating a digital avatar of the first user in the story. Thus, the user can have a more immersive story experience.
[0042] Of course, the above examples do not limit the solutions of the present disclosure. The first user can also use other types of information to represent the characteristics of the ideal role, to flexibly generate the plot image of the role.
[0043] When generating the plot image, the story progress of the role is also referred to. Thus, the generated plot image can also match the story progress. For example, the story progress describes the experience of the role of the first user in the forest, and the generated image can be an image of the role in the forest, and the role in the image matches the information from the user.
[0044] In some embodiments, a generative model for generating images is used to generate the plot image. For example, the information from the first user and the story progress can be input into the model, and the generated object is instructed. Thus, a plot image that matches the plot corresponding to the information from the user and the story progress is generated. The generative model can be a model for generating images based on text (text-to-image model), or a multi-modal model for generating images based on text and image. The generative model can be a large language model (LLM) or a foundation model.
[0045] In step S106, the plot image is displayed. Thus, the first user can see the image that is generated based on the information provided by the first user and that matches the current story.
[0046] After the plot image is displayed, the story progress of the first user's character in the story can be updated. Thus, steps S102 to S106 can be executed again to generate a new plot image based on the updated story progress.
[0047] After the plot is displayed, the first user can share the plot image with the second user. For example, an operation of the first user to share the plot image with the second user can be received. In response to the operation, the plot image can be sent to the second user. The shared content can include only the image itself, or can further carry other information, such as a link to access the story homepage of the first user, or a link to access the application, and so on.
[0048] Any of steps S102 to S106 can be triggered based on a specified operation of the user. For example, the story progress can be determined based on the specified operation of the user (i.e., step S102), and then steps S104 and S106 are executed in sequence; for another example, steps S102 are executed by default first, and then steps S104 and S106 are executed in response to the specified operation of the user; for another example, steps S102 and S104 are executed by default first, and then step S106 is executed in response to the specified operation of the user. The more steps that are executed by default, the more computing resources and storage resources can be occupied, because the user can not perform the specified operation for a long time. However, the more steps that are executed by default, the faster the response speed when the user performs the specified operation. Therefore, a person skilled in the art can make a choice as needed.
[0049] For example, the specified operation is an unlocking operation, which can be triggered in response to the user logging into the application, in response to the user accessing a specified module in the application, or through a specified control. Thus, the current story to be unlocked (the story corresponding to the story progress of the character) can be determined according to the character of the first user in the story, and the plot image of the character can be generated according to the story to be unlocked. After the plot image is displayed, the state of the story to be unlocked changes to unlocked.
[0050] In some embodiments, the user can also read the story content (e.g., story text). For example, the user can be shown all of the story or an outline of all of the story to enable the user to understand the overall plot. For another example, the user can be shown the story content corresponding to the generated plot image (e.g., the unlocked plot image), and other story content is not shown. For another example, the user can be shown a part of the story after the story content corresponding to the currently generated plot image, to guide the user to continue unlocking the remaining content on the basis of preserving the overall story suspense.
[0051] The above embodiments generate a plot image based on the information from the user and the story progress of the role, so that the generated plot image can be flexibly set by the user on the premise of the story progress, improving the flexibility and immersion of the user experience story, and thus improving the interactive experience.
[0052] The plot image can be generated periodically, or the user can be provided with an entry to trigger the generation periodically. The embodiments of generating the plot image in a period are described below with reference to FIG. 2.
[0053] FIG. 2 shows a flowchart of an interactive method according to some other embodiments of the present disclosure. As shown in FIG. 2, the interactive method of this embodiment includes steps S202 to S206.
[0054] In step S202, in each period, the story progress of the role in the period is determined according to the role of the first user in the story.
[0055] In each period, the story progress of the current period can be determined according to the role of the first user in the story and the story progress that has been unlocked. For example, the story progress of the current period can be determined by advancing one story node based on the story node of the role in the last period.
[0056] To prolong the content consumption time of the user so that the user can fully understand the story information, the content amount in a period can be set, which indicates how many plot images corresponding to the story content need to be presented. The content amount corresponding to each period can be the same or different. In some embodiments, in each period, the story progress of the role in the period is determined according to the role of the first user in the story and the content amount corresponding to the period. The content amount can reflect the number of story nodes on which the currently generated plot image is based, the length of the story content, or can also be represented by the number of generated plot images. By setting the content amount of each period, the time covered by the interaction between the user and the story can be maintained at a reasonable level.
[0057] The content amount corresponding to each cycle can be adjusted. In order to improve the interactivity of the first user with other users, in some embodiments, the content amount corresponding to the cycle or other cycles after the cycle is adjusted in response to the second user obtaining the plot image and performing a specified operation. For example, the first user can share the plot image with the second user, or, with the authorization of the first user, the second user can access the homepage of the first user to view the plot image. The second user can perform operations associated with the plot image, such as unlocking, liking, collecting, forwarding, etc., to obtain adjustment of the content amount. The adjustment of the content amount can affect the current cycle, a certain number of cycles after the current cycle, or all cycles after the current cycle. Thus, the plot image of the first user can be displayed to more users, improving the propagation efficiency of the personalized plot image of the first user.
[0058] In step S204, a plot image of the cycle of the role is generated according to the information from the first user and the story progress of the role.
[0059] In step S206, the plot image of the cycle is displayed.
[0060] Steps S202, S204 or S206 can be executed by default or in response to a specified operation of the user. If a certain step needs to be executed in response to a specified operation, if the user does not perform the specified operation within a cycle, the step is not executed. That is, the story progress of the cycle is not determined, or the plot image is not generated, or the plot image is not displayed, and the story progress of the cycle is not updated.
[0061] An application scenario of periodically unlocking is exemplarily described below. The first user can log in to the application every day and unlock a first number of plot images every day. If the first user has unlocked the first number of plot images on a certain day, no new plot image is generated on that day. However, after the first user forwards the plot image to the second user and the second user performs the unlocking operation, the first user can unlock an additional second number of plot images on that day.
[0062] The above embodiments can support users to periodically obtain plot images, thereby controlling the total time length involved in the interaction process between the user and the story within a certain range, and improving the interaction effect of the user.
[0063] In some generated plot images, a role image and an environment image can be included. Therefore, the characteristics of the role and the characteristics of the environment can be determined respectively, and the plot image can be generated. Embodiments of the method of generating the plot image are described below with reference to FIG. 3.
[0064] FIG. 3 shows a flowchart of a method for generating a scenario image according to some embodiments of the present disclosure. As shown in FIG. 3, the method according to this embodiment includes steps S302-S306.
[0065] In step S302, the character feature is determined using the information from the first user.
[0066] The character feature can be the description information of the character (which can be carried by text, image, etc.), or the image feature of the character (such as color, texture, corner point, etc.). Alternatively, the image feature of the character can be further generated using the description information of the character.
[0067] In step S304, the environment feature is determined using the story progress.
[0068] Similar to the character feature, the environment feature can also be the description information of the environment, or the image feature of the environment.
[0069] In step S306, the scenario image is generated according to the character feature and the environment feature.
[0070] In generating the scenario image, an image generation model can be used. For example, the information from the first user and the story progress are input into the model, and the role of each part of the information is indicated. The model can be instructed to generate the character using the information from the first user, generate the environment using the story progress, and fuse the generated contents to display in the same image.
[0071] Through the above embodiments, various types of contents in the scenario image can be indicated according to various types of information, so as to generate a scenario image that is more matched with the information of the first user and the story.
[0072] Next, an interactive process is exemplarily described with reference to FIGS. 4-7.
[0073] FIG. 4 exemplarily shows a schematic diagram of a story selection interface. As shown in FIG. 4, the story selection interface 4 according to this embodiment includes story selection controls 41 and 42, each of which corresponds to a different story. According to the triggering operation of the user on the story selection control, the story selected by the user can be determined.
[0074] Fig. 5 shows a schematic diagram of an example of a role selection interface. As shown in Fig. 5, the role selection interface 5 of this embodiment includes one or more role selection controls 51, 52, 53, each of which corresponds to a different role. According to a triggering operation of a role selection control by a user, the role selected by the user can be determined. In addition, the interface 5 can also include a story cover 54, a story summary 55, etc. to enable the user to understand the information of the story. The interface 5 can also include a confirmation control 56. In response to a triggering of the confirmation control 56, the role selected by the user is determined.
[0075] Fig. 6 shows a schematic diagram of an example of a display interface of a story selected by a user. As shown in Fig. 6, the display interface 6 includes controls 61 and 62 corresponding to one or more stories selected by the user. Taking the story corresponding to the control 61 as an example, the interface 6 can display a story cover 611, a user-selected role image 612, a current story progress 613, etc. The user-selected role image 612 can be an original role image, or an image regenerated according to information from the user and setting information of the role (e.g. an original setting image, or a description text). The current story progress 613 is exemplarily represented by a current node and all nodes of the story, e.g. in Fig. 6, “3 / 7” indicates that the current progress is at the 3rd story node, and the user-selected role has a total of 7 story nodes in this story.
[0076] In response to a triggering operation of the control 61 or 62 by the user, a page corresponding to the story can be entered. For example, generation and display of a new scenario image can be triggered, or a generated scenario image under this story can be displayed to the user.
[0077] The scenario image can be carried in the form of a card. In some embodiments, a scenario card is displayed, which includes a scenario image and a scenario description generated according to the story progress of the role. According to needs, the scenario card can also include more information, or more controls.
[0078] Fig. 7 shows a schematic diagram of a scenario card according to some embodiments of the present disclosure. As shown in Fig. 7, the scenario card 7 includes a scenario image 71 and a scenario description 72. The scenario image 71 is generated according to information from the user and the story progress. The scenario description can be the original text in the story, or can be generated according to information from the user and a story summary provided by the story, to produce a scenario card with more personalized and richer content.
[0079] In some embodiments, after displaying the plot image, the plot image is regenerated in response to the first user triggering a specified control. For example, a refresh control 73 can be displayed on the plot card or on the interface where the plot card is located, to trigger the regeneration of the plot image. Since each generation result of the generative model has a certain randomness, for the same input, the generation result can be different. Therefore, by regenerating the plot image, the user can obtain a satisfactory generation result, and the interactive experience is improved.
[0080] During the interaction of the user in a certain story, in addition to generating plot images, more interactive means can also be provided to further improve the diversity of the generated plot images.
[0081] In some embodiments, the user can switch roles. For example, the role of the first user in the story is a first role, and the story also includes a second role. In response to the first user switching from the first role to the second role, the story progress of the second role is determined according to the story progress of the first role. According to the story progress of the first role, the overall progress of the story can be determined, and then the story progress of the second role is determined according to the overall progress of the story, so that the story progress of the second role matches the overall progress of the story. For example, the story nodes of each role and the dependency or sequence between the story nodes of different roles can be pre-set, so as to determine the story node of the second role corresponding to the story node of the first role.
[0082] In this way, the user can freely switch between different selectable roles, and after switching the role, the plot can continue to be pushed forward according to the original overall story progress, reducing the probability of the user receiving repeated information and improving the diversity of the user's information acquisition.
[0083] In some embodiments, the story includes multiple branches. According to the role of the first user in the story, determining the story progress of the role includes: determining the story progress of the role according to the role of the first user in the story and the branch selected by the first user. For example, when the story advances to a certain node, and in this node, the user's selected role needs to decide whether to go to location A or location B, different choices will affect the subsequent plot, that is, go to different plot branches, at this time the user can make a choice. Therefore, the user can participate in the decision of the story advancement, and the user's interactivity is improved.
[0084] The user can make a selection through the interactive control. For example, in response to there being multiple branches after the current story progress of the role, display selection controls of the multiple branches. The selection controls can be displayed before the generation of the scenario image to affect the scenario image currently being generated; or, the selection controls can also be displayed after the generation of the scenario image to affect the image generated next time. Taking the example of the user triggering the generation of the scenario image through an unlocking operation, the selection controls can be displayed after the user performs the unlocking operation, and the story progress of the role is determined through the operation result of the user on the selection controls, and the scenario image of the current unlocking is generated according to the determined story progress; or, the selection controls can be displayed after the generation of the scenario image of the current unlocking, so as to determine the story progress referred to when generating the scenario image of the next unlocking according to the operation result of the user on the selection controls.
[0085] In some embodiments, other users can modify the story of the first user. In some embodiments, in response to a modification operation of a second user on the story, the story is modified; and the story progress of the role is determined according to the modified story. The second user can obtain the modification permission when a specified condition is met, for example, viewing the scenario card shared by the first user, viewing the home page of the first user, opening the story of the second user, and the like. After the second user modifies the story of the first user, the story progress is determined according to the story modified by the second user. Thus, the interactivity between users is improved, and the diversity of the generated scenario image is also improved.
[0086] When the second user modifies the story, the second user can modify the text of the story in detail, or can only modify the outline of the story. In some embodiments, the modified story is generated according to the prompt word input by the second user and the story. For example, the prompt word input by the second user and the story are input into a generative model, and a modification instruction is input into the generative model. The modification instruction can indicate that the story is modified according to the prompt word. Then, the modified story output by the generative model is obtained. The generative model is, for example, a large language model (LLM) or a foundation model. Through the strong natural language understanding capability of the generative model, the complexity of the modification operation of the second user can be simplified.
[0087] After generating one or more story images, the user can view the images one by one. In some embodiments, multimedia content can also be generated according to one or more story images. For example, multimedia content can be generated according to the story images of the first user corresponding to a certain story, so that the story images of a certain story can be collected to form a complete story conveyed by images. Of course, the multimedia content can also be accompanied by text, such as story content or a description of the story card. The multimedia content can be generated after the entire story is unlocked, or can be generated in response to a user request.
[0088] The multimedia content can be a video or an e-book, or can also be other forms of files. In the process of generating a video, the user can manually or automatically add background music, story dialogue, sound effects, etc. The e-book can be presented in the form of a comic book, for example, each page including one or more story images to improve the user's reading experience.
[0089] By generating multimedia content, the user can more efficiently browse the generated story images, improving the user's interactive experience.
[0090] The above describes exemplary methods of various embodiments of the present disclosure. The following further describes devices and apparatuses for performing the methods of the above embodiments.
[0091] FIG. 8 shows a structural schematic diagram of an interactive device according to some embodiments of the present disclosure. As shown in FIG. 8, the interactive device 8 of this embodiment includes a determination module 801 configured to determine the story progress of the role according to the role of the first user in the story; a generation module 802 configured to generate the story image of the role according to the information from the first user and the story progress of the role; and a display module 803 configured to display the story image.
[0092] In some embodiments, the determination module 801 is further configured to determine the story progress of the role in each period according to the role of the first user in the story; and the display module 803 is further configured to display the story image of the period.
[0093] In some embodiments, the determination module 801 is further configured to determine the story progress of the role in each period according to the role of the first user in the story and the amount of content corresponding to the period.
[0094] In some embodiments, the interactive device 8 further includes an adjustment module 804 configured to adjust the amount of content corresponding to the period or other periods after the period in response to the second user obtaining the story image and performing the specified operation.
[0095] In some embodiments, the role of the first user in the story is a first role, and the story further includes a second role, and the determining module 801 is further configured to: in response to the first user switching from the first role to the second role, determine the story progress of the second role according to the story progress of the first role.
[0096] In some embodiments, the story includes a plurality of branches, and the determining module 801 is further configured to: determine the story progress of the role according to the role of the first user in the story and the branch selected by the first user.
[0097] In some embodiments, the display module 803 is further configured to: in response to there being a plurality of branches after the current story progress of the role, display selection controls of the plurality of branches.
[0098] In some embodiments, the determining module 801 is further configured to: in response to a modification operation of the second user on the story, modify the story; and determine the story progress of the role according to the modified story.
[0099] In some embodiments, in response to the modification operation of the second user on the story, the determining module 801 is further configured to: generate a modified story according to the prompt word input by the second user and the story.
[0100] In some embodiments, the interaction device 8 further includes a receiving module 805 configured to: receive an operation of the first user sharing the plot image to the second user.
[0101] In some embodiments, the generating module 802 is further configured to: determine the role feature by using the information from the first user; determine the environment feature by using the story progress of the role; and generate the plot image according to the role feature and the environment feature.
[0102] In some embodiments, the display module 803 is further configured to: display a plot card, the plot card including the plot image and a plot description, the plot description being generated according to the story progress of the role.
[0103] In some embodiments, the information from the first user includes at least one of a text and an image.
[0104] In some embodiments, the generating module 802 is further configured to: after displaying the plot image, in response to the first user triggering a specified control, regenerate the plot image.
[0105] In some embodiments, the generating module 802 is further configured to: generate a multimedia content according to the plot image corresponding to the story of the first user, the multimedia content being a video or an e-book.
[0106] It should be noted that the above-described various units are only logical modules according to the specific functions implemented by them, and are not intended to limit the specific implementation manners, for example, they can be implemented in software, hardware or a combination of software and hardware. In actual implementation, the above-described various units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-described various units are indicated by dashed lines in the drawings, indicating that these units can not actually exist, and the operations / functions implemented by them can be implemented by the processing circuit itself.
[0107] In addition, although not shown, the device can also include a memory, which can store various information generated by the device, the various units included in the device in operation, programs and data for operation, data to be transmitted by the communication unit, etc. The memory can be a volatile memory and / or a non-volatile memory. For example, the memory can include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read-only memory (ROM), a flash memory. Of course, the memory can also be located outside the device. Alternatively, although not shown, the device can also include a communication unit, which can be used for communication with other devices. In one example, the communication unit can be implemented in a suitable manner known in the art, for example, including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. Here will not be described in detail. In addition, the device can also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. Here will not be described in detail.
[0108] Some embodiments of the present disclosure also provide an electronic device. FIG. 9 shows a structural schematic diagram of an electronic device according to some embodiments of the present disclosure. For example, in some embodiments, the electronic device 9 can be various types of devices, for example, can include but is not limited to various types of mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), etc., and various types of fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 9 can include a display panel for displaying data and / or execution results utilized in the scheme according to the present disclosure. For example, the display panel can be various shapes, such as a rectangular panel, an oval panel, or a polygonal panel, etc. In addition, the display panel can not only be a flat panel, but also a curved panel, or even a spherical panel.
[0109] As shown in FIG. 9, the electronic device 9 of this embodiment includes a memory 91 and a processor 92 coupled to the memory 91. It should be noted that the components of the electronic device 9 shown in FIG. 9 are merely exemplary and non-limiting, and the electronic device 9 can also have other components according to actual application needs. The processor 92 can control other components in the electronic device 9 to perform desired functions.
[0110] In some embodiments, the memory 91 is configured to store one or more computer readable instructions. When the processor 92 executes the computer readable instructions, the computer readable instructions are executed by the processor 92 to implement the method according to any of the above embodiments. For specific implementation of each step of the method and related explanations, please refer to the above embodiments, and the repeated parts will not be described here.
[0111] For example, the processor 92 and the memory 91 can directly or indirectly communicate with each other. For example, the processor 92 and the memory 91 can communicate through a network. The network can include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 92 and the memory 91 can also communicate with each other through a system bus, and the present disclosure does not limit the processor 92 and the memory 91.
[0112] For example, the processor 92 can be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processing unit (NP), etc.; and can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic component, a discrete hardware component. The central processing unit (CPU) can be X86 or ARM architecture, etc. For example, the memory 91 can include any combination of various forms of computer readable storage media, such as volatile memory and / or non-volatile memory. The memory 91 may, for example, include system memory, which stores, for example, an operating system, application programs, a boot loader, a database, and other programs, etc. Various application programs and various data, etc. can also be stored in the storage medium.
[0113] In addition, according to some embodiments of the present disclosure, various operations / processes according to the present disclosure, when implemented by software and / or firmware, can be installed from a storage medium or a network to a computer system with a dedicated hardware structure, such as the computer system 100 shown in FIG. 10, which, when various programs are installed, can perform various functions, including functions such as those described above, etc. FIG. 10 shows a structural schematic diagram of a computer system according to some embodiments of the present disclosure.
[0114] In FIG. 10, a central processing unit (CPU) 1001 performs various processing in accordance with a program stored in a read only memory (ROM) 1002 or a program loaded from a storage section 1008 to a random access memory (RAM) 1003. In the RAM 1003, data required when the CPU 1001 performs various processing and the like is also stored as necessary. The central processing unit is merely exemplary, and can also be other types of processors, such as the various processors described above. The ROM 1002, the RAM 1003, and the storage section 1008 can be various forms of computer readable storage media, as described below. Note that, although the ROM 1002, the RAM 1003, and the storage 1008 are shown separately in FIG. 10, one or more of them can be combined or located in the same or different memory or storage modules.
[0115] The CPU 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output interface 1005 is also connected to the bus 1004.
[0116] The following components are connected to the input / output interface 1005: an input section 1006, such as a touch panel, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, and the like; an output section 1007, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, and the like; a storage section 1008, including a hard disk, a magnetic tape, and the like; and a communication section 1009, including a network interface card, such as a LAN card, a modem, and the like. The communication section 1009 allows communication processing to be performed via a network, such as the Internet. It is readily understood that, although the various devices or modules in the computer system 100 are shown in FIG. 10 as communicating via the bus 1004, they can also communicate through a network or other means, where the network can include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.
[0117] A drive 1010 is also connected to the input / output interface 1005 as necessary. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like, is attached to the drive 1010 as necessary, so that a computer program read therefrom is installed in the storage section 1008 as necessary.
[0118] In the case where the above-described series of processing is implemented by software, the program constituting the software can be installed from a network, such as the Internet, or a storage medium, such as the removable medium 1011.
[0119] According to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for executing the methods illustrated by the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network by the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the CPU 1001, the above-described functions defined in the methods of the embodiments of the present disclosure are executed.
[0120] Note that, in the context of the present disclosure, a computer-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium can include a data signal carried in a baseband or as part of a carrier wave, in which the computer-readable program code is carried. Such a propagated data signal can take any of a variety of forms, including but not limited to electro-magnetic, optical, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium that is not a computer-readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wire, cable, fiber optic, RF (radio frequency), or any suitable combination of the above.
[0121] The above-described computer-readable medium can be included in the above-described electronic device; or can exist separately from the electronic device without being incorporated into the electronic device.
[0122] In some embodiments, a computer program including instructions which, when executed by a processor, causes the processor to carry out the method of any of the above embodiments is also provided. For example, the instructions can be embodied in a computer program code.
[0123] In an embodiment of the disclosure, computer program code to carry out operations of the disclosure can be written in one or more programming languages, or combinations thereof, including object oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).
[0124] The flow diagrams and the block diagrams in the drawings are illustrations of possible architectures, functions, and operations for systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may
[0125] The modules, components or units described in the embodiments of the present disclosure can be implemented by software or by hardware. In some cases, the name of the module, component or unit does not constitute a limitation on the module, component or unit itself.
[0126] The functionality described above in this document can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, non- transitory machine-readable media can include RAM, ROM, programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, compact disk read-only memory (CD-ROM), digital versatile disk (DVD), Blu-ray, or another non-transitory medium suitable for storing non-transitory program code, wherein the above aforementioned media can be read and written by, for example, a machine- readable media reader and a machine-readable media recording device, respectively. In this document, the terms "non-transitory machine- readable storage medium" and "non-transitory machine-readable storage media" mean the above-described media except for a transitory signal per se.
[0127] The above description is merely exemplary of some embodiments of the disclosure and of the technology principle employed. It is understood that the scope of the disclosure is not limited to the specific combinations of technical features disclosed above, but rather covers any other technical solution that falls within the scope of the disclosure, which is defined by the appended claims, and which is derived from the technical features disclosed above or their equivalent features. For example, technical solutions formed by replacing the above-described features with technical features having similar functions disclosed in the disclosure (but not limited to) with each other.
[0128] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application can be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.
[0129] In addition, while operations are depicted in a particular, chronological sequence, this should not be understood as requiring such order unless otherwise specifically indicated, and one or more additional operations being performed and / or operations being performed in different sequences can be appropriate. In addition, certain features can also be implemented using software including but not limited to as plugins, add-ons, in extensions, on the fly, etc. Also, it is understood that the use of specifically named exemplary approaches or devices should in no way be read as limiting, and that one of ordinary skill in the art will be able to make and use other similar approaches falling within the scope of the present disclosure. Moreover, it is not necessarily expected that all additional possible features will be, or be described in, every embodiment of the application, and not all combinations of features are necessarily available as embodiments of the application. In general, the scope of the disclosure encompasses all combinations of features implementing the functions described herein and their equivalents.
[0130] While certain features of the disclosure have been illustrated and described, many modifications, substitutions, changes, and equivalents will now occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true scope of the disclosure. The disclosure is not limited to the illustrative embodiments set forth herein but encompasses all changes and modifications that come within the scope and spirit of the disclosure.
Claims
1. An interaction method, comprising: determining a story progress of a role in a story according to the role of a first user in the story; generating a scenario image of the role according to information from the first user and the story progress of the role; displaying the scenario image. 2.The interaction method of claim 1, wherein: the determining the story progress of the role according to the role of the first user in the story comprises: determining the story progress of the role in each cycle according to the role of the first user in the story in the cycle; the displaying the scenario image comprises: displaying the scenario image of the cycle.
3. The interaction method of claim 2, wherein, the determining the story progress of the role in each cycle according to the role of the first user in the story comprises: determining the story progress of the role in each cycle according to the role of the first user in the story and a content amount corresponding to the cycle. 4.The interaction method of claim 3, further comprising: adjusting the content amount corresponding to the cycle or other cycles after the cycle in response to a second user obtaining the scenario image and performing a specified operation.
5. The interaction method according to any one of claims 1 to 4, wherein, the role of the first user in the story is a first role, the story further comprises a second role, and the determining the story progress of the role according to the role of the first user in the story comprises: determining the story progress of the second role according to the story progress of the first role in response to the first user switching from the first role to the second role.
6. The interaction method according to any one of claims 1 to 5, wherein, the story comprises a plurality of branches, and the determining the story progress of the role according to the role of the first user in the story comprises: determining the story progress of the role according to the role of the first user in the story and a branch selected by the first user. 7.The interaction method of any one of claims 1 to 6, further comprising: displaying selection controls of a plurality of branches in response to the plurality of branches existing after a current story progress of the role. the determining the story progress of the role according to the role of the first user in the story comprises:
8. The interaction method according to any one of claims 1 to 7, wherein, modifying the story in response to a modification operation of a second user on the story; determining the story progress of the role according to the modified story. the modifying the story in response to the modification operation of the second user on the story comprises:
9. The interaction method of claim 8, wherein, generating a modified story according to a prompt word input by the second user and the story. 10.The interaction method of claim 4 or 8, further comprising: receiving an operation of the first user sharing the scenario image with the second user. the generating the scenario image of the role according to the information from the first user and the story progress of the role comprises:
11. The interaction method according to any one of claims 1 to 10, wherein, determining a role feature by using the information from the first user; determining an environment feature by using the story progress of the role; generating the scenario image according to the role feature and the environment feature. the displaying the scenario image comprises:
12. The interaction method of any one of claims 1 to 11, wherein, display a scenario card, the scenario card including the scenario image and a scenario description, the scenario description being generated according to a story progress of the role.
13. The interaction method of any one of claims 1 to 12, wherein, The information from the first user includes at least one of a text, an image.
14. The interaction method of any one of claims 1-13, further comprising: after displaying the scenario image, in response to a trigger of a designated control by the first user, re-generating the scenario image.
15. The interaction method of any one of claims 1-14, further comprising: generating a multimedia content according to the scenario image corresponding to the story of the first user, the multimedia content being a video or an e-book.
16. An interaction apparatus, comprising: a memory; and a processor coupled to the memory, the processor configured to execute an interaction method as claimed in any one of claims 1-15 based on instructions stored in the memory.
17. A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the interaction method of any one of claims 1-15.
18. A computer program product which, when running on a computer, causes the computer to implement the interaction method of any one of claims 1-15.
19. A computer program comprising: instructions which, when executed by a processor, cause the processor to perform the interaction method of any one of claims 1-16.
Citation Information
Patent Citations
Video generation method and device and storage medium
CN110162667A
Generation method and device of interactive multimedia content and computer readable storage medium
CN117633259A
Interaction method and device, computer readable storage medium and computer program product
CN117959703A
Method and apparatus for producing and delivering customized education and entertainment
US20120322041A1
Computer architecture for customizing the content of publications and multimedia
US20200285799A1