Interaction method and device, equipment and storage medium

Abstract

The invention provides an interaction method and device, equipment and a storage medium. The method provided herein includes: receiving a generation request, the generation request being associated with a session with a virtual object; and presenting a play interface of media content, the media content being generated based on the generation request, the media content comprising a first audio content, a first text content corresponding to the first audio content being related to a session message in the session. In this way, the media content related to the session message in the session of the virtual object can be automatically generated when the generation request is received, the generation efficiency of the media content is effectively improved, the matching degree of the media content and the session message can be improved, and therefore the quality of the media content is improved.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, and computer-readable storage media for interaction. Background Technology

[0002] With the development of computer technology, various forms of electronic devices have greatly enriched people's daily lives. For example, people can use electronic devices to interact, such as generating or playing media content. How to improve interaction efficiency is a key concern. Summary of the Invention

[0003] In a first aspect, an interactive method is provided. The method includes: receiving a generation request associated with a session with a virtual object; and presenting a playback interface for media content generated based on the generation request, the media content including first audio content and first text content corresponding to the first audio content associated with session messages in the session.

[0004] In a second aspect, an apparatus for interaction is provided. The apparatus includes: a receiving module configured to receive a generation request associated with a session with a virtual object; and a first presentation module configured to present a playback interface for media content generated based on the generation request, the media content including first audio content, and first text content corresponding to the first audio content associated with session messages in the session.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0008] In this way, media content related to the session messages in the virtual object's session can be automatically generated when a generation request is received, which effectively improves the efficiency of media content generation and the matching degree between media content and session messages, thereby improving the quality of media content.

[0009] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this paper, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2J Example interfaces for some scenarios are shown; Figure 3 The flowcharts show example processes of interactions in some scenarios; Figure 4 Schematic block diagrams of example devices for interaction in several scenarios are shown; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0011] The examples in the text will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0012] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0013] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0014] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and provisions. In the examples presented herein, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0015] In this manual and the sample solutions, any processing of personal information will be conducted only on a legal basis (such as with the consent of the data subject or as necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0016] In related technologies, when generating media content including audio, it is generally necessary to create text content first, and then have the user record audio content based on the text content. However, this method results in low efficiency in media content generation. In addition, after the media content is published, the interactive media content is often the same when it is shown to different users.

[0017] An interactive scheme is proposed. The scheme includes: receiving a generation request, which is associated with a session with a virtual object; and presenting a playback interface for media content, which is generated based on the generation request. The media content includes first audio content and first text content corresponding to the first audio content, which is associated with session messages in the session.

[0018] In this way, media content related to the session messages in the virtual object's session can be automatically generated when a generation request is received, which effectively improves the efficiency of media content generation and the matching degree between media content and session messages, thereby improving the quality of media content.

[0019] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0020] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0021] In this example environment 100, electronic device 110 may run an application 120 that supports interaction. Application 120 may be any suitable type of application for interaction, including but not limited to: radio drama applications, novel applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0022] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can present an interface 150 for supporting interaction through application 120. In some cases, electronic device 110 communicates with server 130 to provide services to application 120.

[0023] In other cases, the interface 150 used to support interaction may also be presented by a browser based on the electronic device 110, which will not be elaborated here.

[0024] In some cases, electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 may also support any type of user-facing interface (such as "wearable" circuitry).

[0025] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for interactive applications 120 in electronic devices 110.

[0026] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0027] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0028] The following description of the example will continue with reference to the accompanying drawings.

[0029] Example Interaction Figures 2A-2J Example interfaces 200A to 200J are shown, illustrating interactions under various scenarios. Interfaces 200A to 200J can, for example, be provided by... Figure 1 The electronic device 110 shown is provided.

[0030] In some situations, electronic devices can exhibit the following characteristics: Figure 2A The session interface 200A shown is a session interface associated with a virtual object.

[0031] In some cases, virtual objects can also be any suitable processing entity, such as an agent or a bot. As an example, virtual objects can be implemented based on any suitable machine learning model, such as a generative model like a language model.

[0032] In some scenarios, users can interact with virtual objects through the conversational interface 200A. For example, users can input messages using input controls in the conversational interface 200A, and the virtual object can generate a reply message based on the user's message, or the virtual object can proactively output messages to the user. In some scenarios, messages associated with the virtual object and / or messages associated with the user can be any appropriate type of message, such as including, but not limited to, at least one of the following: text messages, audio messages, video messages, image messages, document messages, etc.

[0033] by Figure 2A As an example, the session interface 200A can display messages 202-1, 202-3, and 202-5 associated with virtual objects, and messages 202-2 and 202-4 associated with users.

[0034] It should be noted that, due to the limited amount of content that the conversation interface 200A can display at one time, the messages 202-1, 202-3, 202-5, 202-2, and 202-4 currently displayed by the conversation interface 200A are only a portion of the conversation messages between the user and the virtual object. Other conversation messages that are currently not visible can be updated and displayed in the conversation interface 200A based on preset operations associated with the conversation interface. The preset operations can be any appropriate operation, such as a screen swipe operation (vertical swipe) received by the conversation interface 200A, or a message search operation received by the conversation interface 200A, etc., which will not be elaborated here.

[0035] In some cases, virtual objects can be associated with any appropriate configuration information, which may include, but is not limited to, the virtual object's identification information, visual appearance information, character information, voice information, etc., which will not be elaborated here.

[0036] In some scenarios, virtual objects can interact with users through conversations based on their own configuration information. As an example, a user can input messages related to the plot or story using the input components of the conversational interface 200A. The virtual object can then output a response message related to the plot or story based on the message and its own configuration information. Of course, users can also input other types of messages, such as knowledge-based inquiries or casual conversation, which will not be elaborated upon here.

[0037] To improve information transmission efficiency, electronic devices can present the identification information of virtual objects in the session interface 200A. This identification information can represent the name of the virtual object, etc. Taking the generation scenario of a radio drama as an example, the identification information of this virtual object can be the name of a character corresponding to the radio drama to be generated, such as character 1 (the first character), and the various messages presented in the session interface 200A can be messages about the plot, which are related to the radio drama to be generated. In some cases, a radio drama is a type of media content that allows listeners to create characters, scenes, and a complete story in their minds through the comprehensive use of character dialogue, narration, sound effects, and background music.

[0038] To improve the matching degree between the media content to be generated and the user, thereby improving the quality of the generated media content, in some cases, the electronic device may present a configuration entry 201-6 associated with the virtual object in the session interface 200A. Furthermore, in response to receiving a selection of the configuration entry 201-6, the electronic device may present a configuration interface associated with the virtual object. Furthermore, the electronic device may configure or update the configuration information associated with the virtual object via the configuration interface.

[0039] To improve interaction efficiency, in some cases, electronic devices can display a generation control for generating media content within the session interface 200A, allowing users to quickly trigger the generation of media content. This generation control can be configured to appear in any appropriate location.

[0040] As an example, the electronic device can present an expand control 202-1 in the input component of the session interface 200A. Further, the electronic device can adjust the input component as follows in response to receiving a selection of the expand control 202-1. Figure 2B As shown in the image, this input component can be configured to present multiple functional controls, such as the generation control 202-2 for generating media content.

[0041] Furthermore, the electronic device can receive a generation request in response to receiving a selection of the generation control 202-2, which is associated with the session with the virtual object.

[0042] To improve information transmission efficiency, electronic devices can respond to the first selection of control 202-2, displaying an image as shown below. Figure 2C The functional introduction interface 200C is shown. In some cases, the electronic device may present functional description information 202-3 related to the generation of media content in the functional introduction interface 200C. In some cases, the functional description information 202-3 may include, but is not limited to, at least one of the following: a description of the source of materials required to generate media content, a description of the composition related to the media content, an update description related to the media content, and the type of media content generated.

[0043] As an example, description information 202-3 could indicate that media content is generated based on session messages between the user and the virtual object. As another example, description information 202-3 could also indicate that the type of generated media content is a radio drama. As yet another example, the generated media content could be updated as session messages are updated, and so on.

[0044] In some cases, electronic devices may also display images or videos, such as visual representations of virtual objects, in the function introduction interface 200C.

[0045] In some cases, the electronic device may also present information about the generation control 202-4 in the function introduction interface 200C. Furthermore, the electronic device may receive a generation request in response to receiving a selection of the generation control 202-4.

[0046] It should be noted that the media content generated based on the generation request can be any appropriate type of content, such as radio dramas, audiobooks, etc. This media content can include first audio content, and the first text content corresponding to the first audio content is related to the session messages in the session. The first text content can be visible to the user or not, which will not be elaborated here.

[0047] In some cases, media content can be in the form of pure audio, or it can be in the form of a combination of audio and text.

[0048] The following example illustrates the media content generation process using a server-generated media content. It should be noted that media content can be generated by any suitable device, such as electronic devices or other devices, which will not be elaborated upon here.

[0049] In some scenarios, a server can determine multiple parts based on all the session text corresponding to the session messages in a session. These multiple parts constitute a complete session message. Furthermore, the server can provide these multiple parts to a predetermined model to obtain multiple media content segments corresponding to these multiple parts.

[0050] As an example, the server can sequentially provide a predetermined number of dialogue texts to a predetermined model in ascending order of output time to obtain at least one media content fragment output by the predetermined model. The predetermined number can be any suitable value, such as 60 rounds of dialogue or others. The predetermined model can be any suitable machine learning model, such as a generative model. It should be noted that if this at least one media content fragment includes multiple fragments, the predetermined model can output not only the at least one media content fragment but also the order of these at least one media content fragments.

[0051] Because the conversation text corresponding to the conversation message is input into a predetermined model in batches to generate media content fragments, the media content is not generated all at once, but rather in portions. To improve interaction efficiency and avoid excessive user waiting time, electronic devices can respond to at least a portion of the media content being generated, presenting it as follows: Figure 2D The content viewing interface shown is 200D.

[0052] In some cases, electronic devices may display descriptive information associated with media content in the content viewing interface 200D. This descriptive information may include, but is not limited to, the cover content of the media content, and related prompts. The cover content of the media content may be an image or video containing a visual representation of a virtual object. The prompts associated with the media content may indicate that the media content is generated based on conversational messages from the user's interaction with the virtual object.

[0053] In some cases, the electronic device may display a playback control 203 for the media content in the content viewing interface 200D. Furthermore, in response to receiving a selection of the playback control 203, the electronic device may play at least a portion of the generated media content.

[0054] In some cases, electronic devices may also display multiple content items on the content viewing interface 200D. In some cases, these multiple content items are associated with multiple media content segments corresponding to the media content, that is, each content item is associated with a part of the media content.

[0055] by Figure 2D As an example, an electronic device can display content item 230, content item 231, etc. in the content viewing interface 200D.

[0056] Furthermore, the electronic device can, in response to receiving a selection of a first content item from a plurality of content items, present a playback interface for a first media content segment corresponding to the first content item. In some cases, the electronic device can, in response to receiving a selection of playback controls included in the first content item from a plurality of content items, receive a selection of the first content item. The first content item can be any appropriate content item selected by the user from the plurality of content items.

[0057] Taking content item 230 as the first content item, the electronic device can respond to the selection of the playback control 230-1 in content item 230 and present the playback interface of the first media content segment corresponding to content item 230.

[0058] In some cases, the first content item may include at least one of the following: time information associated with the first media content segment, text content associated with the first media content segment, identification information associated with the first media content segment, and status information associated with the first media content segment.

[0059] In some cases, the time information associated with the first media content segment may include, but is not limited to, at least one of the following: the duration information corresponding to the first media content segment, the timestamp of the start time of the first media content segment in the media content, etc.

[0060] In some cases, the text content associated with the first media content segment may include, but is not limited to, at least one of the following: text or part of the text corresponding to a sentence of audio content (such as the first sentence of audio) in the first media content segment, summary text or part of the summary text corresponding to the first media content segment, etc.

[0061] In some cases, the identification information associated with the first media content segment may include, but is not limited to, at least one of the following: the content name corresponding to the first media content segment, the issue number corresponding to the first media content segment, wherein the issue number indicates which segment in the media content the first media content segment is, and the issue number may also indicate the generation order of the segment.

[0062] In some cases, the status information associated with the first media content segment may include, but is not limited to, at least one of the following: generation status information, authorization status information, etc.

[0063] Since media content segments correspond to a predetermined generation order, and different media content segments may have different generation states, to improve information transmission efficiency and avoid redundant interactions with users, for the content items corresponding to media content segments that are not yet fully generated, the description information of these content items can present information about the generation status of the media content segment. The generation status information can indicate the generation progress of the media content segment at the current time. Generation status information can include, but is not limited to: generating, not generated, generated, etc.

[0064] In some cases, the authorization status information can also be called the unlock status information. This authorization status information can be updated based on any appropriate related operation with respect to the first media content fragment. This related operation can be any appropriate operation, such as an operation that can be associated with a virtual resource, etc.

[0065] In some cases, authorization status information can be displayed on the playback control associated with the content item. For example, if the playback control is displayed in the first style, it can indicate that the authorization status is authorized. If the playback control is displayed in the second style, it can indicate that the authorization status is unauthorized. The first and second styles can be any appropriate ones and correspond to different styles. As an example, the first and second styles can correspond to different display styles (e.g., different colors, different background colors, different background patterns, different fonts, different visual elements, etc.).

[0066] by Figure 2DAs an example, content item 230 can be associated with the first episode of the media content (episode number "1"), that is, the media content segment corresponding to content item 230 is the first media content segment in the media content, and content item 231 can be associated with the third episode of the media content (episode number "3"), that is, the media content segment corresponding to content item 230 is the third media content segment in the media content.

[0067] Again Figure 2D As an example, the playback control 230-1 in content item 230 can indicate that the first episode of content item 230 is in an authorized state, and the playback control 231-1 in content item 231 can indicate that the third episode of content item 231 is in an unauthorized state.

[0068] In some cases, in response to receiving a selection of a content item corresponding to a media content segment that indicates an unauthorized authorization status information, the electronic device may present the text content of the media content segment corresponding to the selected content item in a first mode on the playback interface. In other cases, the text content corresponding to the media content segment presented in the first mode may be invisible on the playback interface. The first mode can be any appropriate mode, such as an obscuring mode, a blurring mode, etc., which will not be elaborated here.

[0069] by Figure 2D and Figure 2E As an example, an electronic device may, in response to receiving a selection of content item 231, present as follows: Figure 2E The playback interface 200E is shown. The electronic device can display text content 220-1 in the first mode on the playback interface 200E. The text content 220-1 is the text corresponding to the media content segment corresponding to the content item 231, and the text content 220-1 is invisible at this time.

[0070] To improve interaction efficiency, the electronic device can also associate with the text content 220-1 presented in the first mode to display an authorization control 220-2. Furthermore, the electronic device can update the authorization status information of this media content segment to "authorized" via the authorization control 220-2. Furthermore, the electronic device can display, as... Figure 2F The interface shown is 200F. At this time, the text content 220-1 corresponding to the media content segment is visible.

[0071] In other cases, the electronic device may, in response to receiving a selection of a content item corresponding to an authorized media content segment, present the text content of the media content segment corresponding to the content item in a second mode on the playback interface. In some cases, the text content corresponding to the media content segment presented in the second mode is visible on the playback interface.

[0072] by Figure 2D and Figure 2F As an example, if the authorization status information corresponding to the media content segment corresponding to content item 231 indicates that it has been authorized, the electronic device can respond to receiving the selection of content item 231 by presenting, as shown below. Figure 2F The playback interface 200F is shown. The electronic device can display text content 220-1 in the second mode on the playback interface 200F. The text content 220-1 is the text corresponding to the media content segment corresponding to content item 231, and the text content 220-1 is visible at this time.

[0073] In some cases, the electronic device may also display overview information 220-3 associated with the media content segment on the playback interface 200E and / or playback interface 200F. Taking a radio drama as an example, this overview information 220-3 can be a summary of the plot of the media content segment.

[0074] In some cases, an electronic device may, in response to receiving a message viewing request, present the first part of a session message in a session interface with a virtual object, the first part of the session message being related to a first media content fragment.

[0075] As an example, an electronic device may receive a message viewing request in response to a selection of a message viewing control received via a playback interface.

[0076] by Figure 2G As an example, an electronic device may, in response to receiving a selection of the viewing entry 232, present as follows: Figure 2G The function panel 240 shown may include a message viewing control 240-1. Furthermore, the electronic device may receive a message viewing request in response to a selection of the message viewing control 240-1.

[0077] In some cases, the electronic device can also display an edit / rewrite control 240-2 in the function panel 240. This edit / rewrite control 240-2 is configured to trigger the regeneration of the current content. For example, in response to receiving a selection of the edit / rewrite control 240-2, the electronic device can update the media content segment corresponding to the current content segment, which includes updated audio information, or includes updated audio information and updated text content, and this updated text content is updated and displayed in the playback interface 200G.

[0078] As another example, the electronic device can also receive preset operations on the text content corresponding to the first media content segment via the playback interface, and receive message viewing requests. The preset operations can be any appropriate selection, such as a click operation, a selection operation, etc., which will not be elaborated here.

[0079] by Figure 2H As an example, an electronic device may, in response to receiving a message viewing request, present the first part of a session message in a session interface 200H with a virtual object. This first part includes messages 250-1, 250-4, and 250-6 associated with the virtual object, and messages 250-2, 250-3, and 250-5, etc., corresponding to the user associated with the session.

[0080] In some cases, this first part is the portion of the session message used to generate the first media content fragment.

[0081] Back Figure 2F ,by Figure 2F Taking the media playback interface as an example, the relevant interactions of the playback interface will be explained. It should be noted that whether the playback interface displays the complete media content or a segment of the media content, the corresponding interaction process is the same, and will not be elaborated here.

[0082] For ease of description, Figure 2F This explanation uses the complete media content as an example. In some cases, electronic devices may display the first text content in the playback interface. This first text content can include the first dialogue text and the second dialogue text.

[0083] In some cases, the first dialogue text can be associated with the first role in the media content, and the first role is associated with a virtual object. The content corresponding to the first dialogue text can match the configuration information of the virtual object.

[0084] by Figure 2F As an example, text content 220-1 may include dialogue text 250-1, dialogue text 250-2, and dialogue text 250-3 corresponding to character 1, which is associated with a virtual object.

[0085] In some cases, the second dialogue text can be associated with a second persona within the media content, and this second persona is linked to the user associated with the conversation. The second dialogue text can also include descriptive information associated with the user, which may indicate the user's personality, interests, historical interactions, etc. It should be noted that the use of user-associated descriptive information is authorized and permitted by the user, and will not be elaborated upon here.

[0086] by Figure 2F As an example, text content 220-1 may include dialogue text 250-4, dialogue text 250-5, and dialogue text 250-6 corresponding to role 2, which is associated with the user associated with the conversation.

[0087] In some situations, users can use such a playback interface to control the playback status and progress of media content. For example, such as... Figure 2F As shown, the user can trigger control 211 to switch the playback state of the media content, thereby triggering the playback of the media content or triggering the stopping of media content playback. Alternatively or additionally, the user can trigger control 212 or control 213 to switch the media content segments in the playback interface. For example, the user can trigger control 212 or control 213 to switch the interface 200F from playing the first media content segment to playing the next media content segment or the previous media content segment.

[0088] Alternatively or additionally, a user can trigger entry 214 to select a media content segment to be played. For example, in response to triggering entry 214, the electronic device can present, as follows: Figure 2I The interface 200I shown can display multiple content items corresponding to multiple media content segments, such as content item 215-1 and content item 215-2.

[0089] In some cases, these multiple content items may include corresponding selection controls to support switching between media content segments. For example, a user can click the selection control in content item 215-1 to trigger the playback of the media content segment corresponding to content item 215-1 in the playback interface 200F.

[0090] In other cases, the electronic device may also respond to receiving a drag on the progress bar to adjust the playback progress of the text and audio content displayed on the playback interface 200F, which is associated with the first media content segment.

[0091] In some cases, the text content corresponding to the first media content segment may also include non-dialogue text, which can be any appropriate text, such as narration text, bullet screen text, etc.

[0092] In some cases, non-dialogue text can be used to explain the plot, describe the scene, provide background information, transition between scenes, or reveal the inner thoughts of the characters. The corresponding audio for this text is often not output in the form of dialogue by the characters.

[0093] As an example, non-dialogue text can be associated with any one or more dialogue texts in the first text content, for example, to explain a further deeper meaning of one or more dialogue texts.

[0094] by Figure 2JAs an example, the electronic device can display non-dialogue text 280 in the interface 200J, which can be narration text associated with dialogue text 281 corresponding to character 2.

[0095] In some cases, the first audio content may also include sound effects that are related to the sound of the non-dialogue text. For example, if the dialogue text indicates "clothes are rubbing", then the first audio content may include the sound effect of rubbing clothes, and this sound effect may be played together with the dialogue text.

[0096] Again Figure 2J As an example, in response to the playback progress information indicating dialogue text 283 of the media content, the electronic device 110 can switch the display style of the dialogue text 283 in the playback interface from a first style to a second style. As an example, the first style and the second style can correspond to different display styles (e.g., different colors, different background colors, different background patterns, different fonts, etc.). It should be understood that the specific display styles mentioned herein are for illustrative purposes only and are not intended to limit the specific color or form of the display style.

[0097] like Figure 2J As shown, the electronic device 110 can switch the display style of the dialogue text 283 in the playback interface 200J from a backgroundless style to a background style in response to the playback progress information instruction dialogue text 283.

[0098] In some cases, electronic device 110 may respond to the playback progress information of media content indicating a first audio segment in the first audio content, and present second text content associated with the first text segment in the playback interface, the first text segment corresponding to the first audio segment.

[0099] by Figure 2J As an example, the electronic device may respond to the playback progress information of the media content indicating the first audio segment corresponding to the first text segment 283, and present the second text content 284 associated with the first text segment 283 in the playback interface 200J.

[0100] Alternatively or additionally, the electronic device 110 may also update the second text content 284 indicating the first audio segment to be displayed in the playback interface 200J in response to the playback progress information of the media content being triggered. For example, the user can update the playback progress information of the media content by sliding the text display area in the playback interface 200J. Alternatively, the user can also update the playback progress information of the media content by sliding a progress bar component.

[0101] As an example, such as Figure 2JAs shown, a progress bar component 232-1 can be displayed in the playback interface 200J. This progress component 232-1 can indicate the playback progress information of the media content; it can also be called a playback progress bar, for example. Therefore, the user can also update the playback progress information of the media content by interacting with the progress component 232-1 (e.g., dragging the progress component 232-1, clicking a specific position in the progress component 232-1, etc.). Alternatively or additionally, the user can also trigger the update of the playback progress information of the media content through other interaction methods with the electronic device 110, such as gesture control, remote control, etc. Thus, some examples in this paper can improve the efficiency of interface interaction.

[0102] As an example, the second text content can correspond to at least one character, and such at least one character is associated with the media content. In some examples, such as Figure 2J As shown, the second text content 284 may correspond to, for example, role 1, which may be a role associated with the first text fragment 283. In other examples, the second text content may correspond to multiple roles. For example, media content may also be associated with role 3 (not shown in the figure), such second text content may correspond to role 3, which may be independent of the first text fragment.

[0103] As an example, unlike character dialogue or narration, second text content can represent text content not provided in the media content. For instance, second text content could indicate monologue content of at least one character, commentary content associated with at least one character (e.g., commentary on character 1, commentary on character 1, commentary on the first text content corresponding to character 1, etc.). Such second text content can, for example, serve as supplementary content to the first text segment to help users understand the media content more efficiently.

[0104] In some cases, electronic devices can update media content in response to updates to session messages within a session. In some cases, the updated media content includes at least a second audio content related to the updated session message. The specific composition of the updated and unupdated media content, as well as the playback interaction process, are similar and will not be elaborated upon here.

[0105] In some cases, electronic devices can generate additional media content based on the updated second part of information in an updated session message. The second part of information can be new information added compared to the original session message. This new information can include, but is not limited to, at least one of the following: messages associated with virtual objects, or messages associated with the user of the session. Specifically, the process of generating additional media content based on the new messages is similar to the process of generating media content based on the original session messages, and will not be elaborated upon here. Furthermore, electronic devices can update the media content based on the additional media content.

[0106] by Figure 2D As an example, electronic devices can respond to media content being updated, such as... Figure 2D The content viewing interface 200D shown here adds at least one content item corresponding to the supplementary media content. This at least one content item is associated with at least one media content segment corresponding to the supplementary media content.

[0107] To ensure that high-quality media content can be generated based on sufficient contextual information, electronic devices can determine whether the number of new messages meets a quantity constraint. The quantity constraint can indicate when the number of messages reaches a threshold, which can be any appropriate value, such as 60.

[0108] In some cases, the electronic device can generate additional media content based on the newly added message if the quantity constraint is met. In other cases, the electronic device can display a prompt message on the content viewing interface if the newly added message does not meet the quantity constraint, indicating that additional session messages should be entered.

[0109] by Figure 2D As an example, the electronic device can display a prompt message 255 in the content viewing interface 200D, indicating that the chat should continue to trigger a content update. Of course, this prompt message can also be displayed continuously in the content viewing interface, which will not be elaborated on here.

[0110] In some cases, the electronic device may also present an entry point 256 for entering a session in the content viewing interface 200D. Furthermore, the electronic device may, in response to receiving a selection of the session entry point 256, return a response such as... Figure 2A The session interface 200A shown allows users to continue entering messages based on the input components in the session interface 200A.

[0111] In this way, media content related to the session messages in the virtual object's session can be automatically generated when a generation request is received, which effectively improves the efficiency of media content generation and the matching degree between media content and session messages, thereby improving the quality of media content.

[0112] Example process Figure 3 A flowchart of an example process 300 for interaction under certain conditions is shown. Process 300 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 300.

[0113] In box 310, electronic device 110 receives a generation request, which is associated with a session with a virtual object.

[0114] In box 320, electronic device 110 presents a media content playback interface. The media content is generated based on a generation request and includes first audio content and first text content corresponding to the first audio content, which is related to the session message in the session.

[0115] In this way, media content related to the session messages in the virtual object's session can be automatically generated when a generation request is received, which effectively improves the efficiency of media content generation and the matching degree between media content and session messages, thereby improving the quality of media content.

[0116] In some cases, the playback interface for presenting media content includes: in response to at least a portion of the media content being generated, presenting a content viewing interface, the content viewing interface presenting multiple content items, the multiple content items being associated with multiple media content segments, the media content including multiple media content segments; and in response to receiving a selection of a first content item among the multiple content items, presenting a playback interface for a first media content segment, the first content item being associated with the first media content segment.

[0117] In this way, multiple content items can be presented first to allow users to quickly preview the overview information corresponding to each media content segment, which can effectively improve the efficiency of information transmission.

[0118] In some cases, process 300 further includes: in response to receiving a message viewing request, presenting a first part of a session message in a session interface, the first part of the session message being associated with a first media content fragment, and the session interface being associated with a virtual object.

[0119] This method provides a quick way to jump to the conversation interface to view the conversation content, improving the efficiency of interaction.

[0120] In some cases, receiving a generation request includes: presenting a session interface, which is associated with a virtual object; and receiving the generation request via the session interface.

[0121] In this way, a quick way to trigger the generation of media content can be provided in the conversation interface, improving the efficiency of interaction and the efficiency of media content generation.

[0122] In some cases, the playback interface for presenting media content includes: presenting first text content in the playback interface, the first text content including: first dialogue text, the first dialogue text being associated with a first role of the media content, the first role being associated with a virtual object; and second dialogue text, the second dialogue text being associated with a second role of the media content, the second role being associated with a user associated with the session.

[0123] In this way, the text content corresponding to the media content can be presented in the form of a dialogue, thereby improving the quality of the media content.

[0124] In some cases, the first text content also includes non-dialogue text, and the first audio content also includes sound effects content, which are related to the sounds corresponding to the non-dialogue text.

[0125] In this way, corresponding sound effects can be added to media content based on non-dialogue text, thereby improving the quality of the media content.

[0126] In some cases, process 300 further includes: in response to playback progress information indicating the first dialogue text of the media content, switching the display style of the first dialogue text in the playback interface from a first style to a second style.

[0127] In this way, audio and text synchronization can be achieved, effectively reducing the user's understanding and recall costs and improving the efficiency of information transmission.

[0128] In some cases, process 300 further includes: in response to playback progress information of media content indicating a first audio segment in the first audio content, presenting second text content in the playback interface, the second text content being related to the first text segment, the first text segment corresponding to the first audio segment.

[0129] In this way, by presenting the second text content, users can more efficiently understand the first audio segment and the first text segment corresponding to the first audio segment, thereby increasing the richness of the content on the playback interface and improving the efficiency of interface interaction.

[0130] In some cases, the second text content corresponds to at least one character, and at least one character is related to the media content.

[0131] In this way, the role of the second text content can be associated with the media content, thereby improving the efficiency of information transmission.

[0132] In some cases, process 300 further includes: updating media content in response to an update of the session message, wherein the updated media content includes at least second audio content that is related to the updated session message.

[0133] In this way, media content can be automatically updated when the session content is updated, which improves the quality of media content and increases the efficiency of media content updates.

[0134] In some cases, updating media content includes: generating additional media content based on the second part of the information, where the second part of the information is the updated information in the updated session message; and updating the media content based on the additional media content.

[0135] This method enables incremental updates of media content, improving the efficiency of media content updates.

[0136] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 4 A schematic structural block diagram of an example device 400 for interaction under certain scenarios is shown. Device 400 may be implemented as or included in electronic device 110. The various modules / components in device 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0137] like Figure 4 As shown, the device 400 includes: a receiving module 410 configured to receive a generation request associated with a session with a virtual object; and a first presentation module 420 configured to present a playback interface for media content generated based on the generation request, the media content including first audio content, and first text content corresponding to the first audio content associated with session messages in the session.

[0138] In some cases, the first presentation module 420 is further configured to: in response to at least a portion of the media content being generated, present a content viewing interface, the content viewing interface presenting multiple content items, the multiple content items being associated with multiple media content segments, the media content including multiple media content segments; and in response to receiving a selection of a first content item among the multiple content items, present a playback interface for a first media content segment, the first content item being associated with the first media content segment.

[0139] In some cases, device 400 also includes a second presentation module configured to: in response to receiving a message viewing request, present a first part of a session message in a session interface, the first part of the session message being associated with a first media content fragment, and the session interface being associated with a virtual object.

[0140] In some cases, the receiving module 410 is also configured to: present a session interface associated with the virtual object; and receive a generation request via the session interface.

[0141] In some cases, the first presentation module 420 is also configured to: present first text content in the playback interface, the first text content including: first dialogue text, the first dialogue text being associated with a first role of the media content, the first role being associated with a virtual object; and second dialogue text, the second dialogue text being associated with a second role of the media content, the second role being associated with a user associated with the session.

[0142] In some cases, the first text content also includes non-dialogue text, and the first audio content also includes sound effects content, which are related to the sounds corresponding to the non-dialogue text.

[0143] In some cases, the device 400 also includes a switching module configured to: in response to playback progress information of the media content indicating the first dialogue text, switch the display style of the first dialogue text in the playback interface from a first style to a second style.

[0144] In some cases, the device 400 also includes a third presentation module configured to: in response to playback progress information of the media content indicating a first audio segment in the first audio content, present second text content in the playback interface, the second text content being related to the first text segment, the first text segment corresponding to the first audio segment.

[0145] In some cases, the second text content corresponds to at least one character, and at least one character is related to the media content.

[0146] In some cases, device 400 also includes an update module configured to update media content in response to a session message being updated, the updated media content including at least second audio content related to the updated session message.

[0147] In some cases, the update module is also configured to: generate additional media content based on the second part of the information, where the second part of the information is the updated information in the updated session message; and update the media content based on the additional media content.

[0148] In this way, media content related to the session messages in the virtual object's session can be automatically generated when a generation request is received, which effectively improves the efficiency of media content generation and the matching degree between media content and session messages, thereby improving the quality of media content.

[0149] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on. Figure 5 A block diagram of an electronic device 500 in which one or more examples may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.

[0150] In this way, media content related to the session messages in the virtual object's session can be automatically generated when a generation request is received, which effectively improves the efficiency of media content generation and the matching degree between media content and session messages, thereby improving the quality of media content.

[0151] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0152] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0153] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.

[0154] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0155] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0156] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0157] In this way, media content related to the session messages in the virtual object's session can be automatically generated when a generation request is received, which effectively improves the efficiency of media content generation and the matching degree between media content and session messages, thereby improving the quality of media content.

[0158] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0159] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0160] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0161] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0162] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An interactive method, comprising: Receive a generation request, which is associated with a session with a virtual object; as well as A playback interface for media content is presented. The media content is generated based on the generation request. The media content includes first audio content and first text content corresponding to the first audio content, which is related to the session messages in the session.

2. The method according to claim 1, wherein the playback interface for presenting media content comprises: In response to at least a portion of the media content being generated, a content viewing interface is presented, the content viewing interface presenting multiple content items, the multiple content items being associated with multiple media content fragments, the media content including the multiple media content fragments; as well as In response to receiving a selection of a first content item among the plurality of content items, the playback interface of a first media content segment is presented, wherein the first content item is associated with the first media content segment.

3. The method according to claim 2, further comprising: In response to receiving a message viewing request, the first part of the session message is presented in the session interface, the first part of the session message being related to the first media content fragment, and the session interface being related to the virtual object.

4. The method of claim 1, wherein receiving the generation request comprises: A session interface is presented, which is related to the virtual object; as well as The generation request is received via the session interface.

5. The method of claim 1, wherein the playback interface for presenting media content comprises: The first text content is presented in the playback interface, and the first text content includes: A first dialogue text, the first dialogue text being associated with a first character in the media content, the first character being associated with the virtual object; and A second dialogue text, which is related to a second role in the media content, and the second role is associated with a user associated with the session.

6. The method according to claim 5, wherein the first text content further includes non-dialogue text, and the first audio content further includes sound effect content, the sound effect content being related to the sound corresponding to the non-dialogue text.

7. The method according to claim 5, further comprising: In response to the playback progress information of the media content indicating the first dialogue text, the display style of the first dialogue text in the playback interface is switched from the first style to the second style.

8. The method according to claim 1, further comprising: In response to the playback progress information of the media content indicating a first audio segment in the first audio content, second text content is presented in the playback interface, the second text content being related to the first text segment, and the first text segment corresponding to the first audio segment.

9. The method of claim 8, wherein the second text content corresponds to at least one character, and the at least one character is associated with the media content.

10. The method according to claim 1, further comprising: In response to the update of the session message, the media content is updated, and the updated media content includes at least second audio content, which is related to the updated session message.

11. The method of claim 10, wherein updating the media content comprises: Based on the second part of the information, additional media content is generated, wherein the second part of the information is the updated information in the updated session message; Update the media content based on the additional media content.

12. A device for interaction, comprising: A receiving module is configured to receive generation requests associated with a session with a virtual object; as well as The first presentation module is configured to present a playback interface for media content, which is generated based on the generation request. The media content includes first audio content and first text content corresponding to the first audio content, which is related to the session messages in the session.

13. An electronic device, comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 11 when executed by the at least one processor.

14. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 11.

15. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 11.

Images