Interface interaction method and device, equipment and storage medium

Abstract

The embodiment of the invention relates to an interface interaction method and device, equipment and a storage medium. The method provided herein comprises: presenting at least one item of media content associated with a user in an interactive interface associated with a virtual object, the user being associated with the virtual object; and in response to receiving input content via the interactive interface, providing response content from the virtual object, the response content being generated based on the input content and the at least one media content. In this way, the interface interaction efficiency can be improved through the embodiment of the invention.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for interface interaction. Background Art

[0002] With the development of computer technology, more and more platforms and applications are providing intelligent dialogue services for users, such as intelligent dialogue systems and digital assistants. Users can ask questions to virtual objects such as these intelligent dialogue systems and digital assistants, and the virtual objects can respond to the users' questions, thus realizing dialogue interaction with the users. Summary of the Invention

[0003] In a first aspect of the present disclosure, a method for interface interaction is provided. The method comprises: presenting at least one item of media content associated with a user in an interactive interface associated with a virtual object, the user being associated with the virtual object; and providing response content from the virtual object in response to receiving input content via the interactive interface, the response content being generated based on the input content and the at least one item of media content.

[0004] In a second aspect of the present disclosure, a device for interface interaction is provided. The device includes: a first presentation module configured to present at least one media content associated with a user in an interactive interface associated with a virtual object, where the user is associated with the virtual object; and a providing module configured to provide response content from the virtual object in response to input content received via the interactive interface, where the response content is generated based on the input content and the at least one media content.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram illustrating an example environment in which embodiments according to the present disclosure may be implemented;

[0010] Figures 2A to 2G shows an example interface according to some embodiments of the present disclosure;

[0011] Figure 3 A flowchart illustrating an example process of interface interaction according to some embodiments of the present disclosure is shown;

[0012] Figure 4 A schematic structural block diagram showing an example device for interface interaction according to some embodiments of the present disclosure; and

[0013] Figure 5 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0014] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0015] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0016] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0017] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects shall comply with the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms them. Accordingly, when implementing the various embodiments of the present disclosure, the types, scope of use, and usage scenarios of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method may vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0018] If this specification and the solutions in the examples involve the processing of personal information, such processing will be done only with a legitimate basis (such as with the consent of the subject of personal information or as necessary for the performance of a contract) and only within the prescribed or agreed scope. A user's refusal to process personal information other than that required for basic functions will not affect the user's use of basic functions.

[0019] As mentioned above, with the development of computer technology, more and more platforms and applications are providing intelligent conversational services, such as intelligent conversational systems and digital assistants. Users can ask questions to virtual objects in these intelligent conversational systems and digital assistants, and the virtual objects can respond to these questions, thus achieving conversational interaction with the users.

[0020] Embodiments of the present disclosure provide an interface interaction solution. According to this solution, at least one piece of media content associated with a user can be presented in an interactive interface associated with a virtual object, where the user is associated with the virtual object. Furthermore, in response to receiving input content via the interactive interface, response content from the virtual object can be provided, where the response content is generated based on the input content and the at least one piece of media content.

[0021] Based on this approach, the embodiments of the present disclosure can present at least one media content associated with the user in an interactive interface associated with a virtual object, thereby enriching the information provided by the interactive interface and improving interface interaction efficiency.

[0022] Therefore, the embodiments of the present disclosure can improve the efficiency of interface interaction.

[0023] Various example implementations of this solution are described in detail below in conjunction with the accompanying drawings.

[0024] Sample Environment

[0025] Figure 1 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. Figure 1As shown, example environment 100 may include electronic device 110 .

[0026] In this example environment 100, electronic device 110 may run an application 120 that supports interface interaction. Application 120 may be any suitable type of application for interface interaction, examples of which may include, but are not limited to, media applications, social applications, or other suitable applications. Current user 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0027] exist Figure 1 In the environment 100 , if the application 120 is in an active state, the electronic device 110 may present an interface 150 for supporting interface interaction through the application 120 .

[0028] In some embodiments, the electronic device 110 communicates with the server 130 to enable the provision of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0029] The server 130 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server 130 may include, for example, a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 may provide background services for the application 120 that supports content presentation in the electronic device 110.

[0030] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired or wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0031] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0032] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0033] Example Interaction

[0034] The following will refer to Figures 2A to 2G To describe some example interaction processes according to embodiments of the present disclosure. Figures 2A to 2G Example interfaces 200A to 200G according to some embodiments of the present disclosure are shown. Interfaces 200A to 200G may be, for example, Figure 1 The electronic device 110 is provided as shown.

[0035] In some embodiments, the electronic device 110 may present Figure 2A As shown, interface 200A may include an interface for interface interaction. For example, interface 200A may be an interactive interface associated with a virtual object, which may, for example, support conversational interaction between the current user 140 (e.g., user B) and the virtual object. For example, interactive interface 200A may provide a virtual space for one-on-one interaction between the current user 140 and the virtual object.

[0036] In some scenarios, a virtual object can be a virtual assistant or digital assistant of a user (also referred to as a target user, e.g., anchor A). In some embodiments, a virtual object can have an interactive avatar. Furthermore, a virtual object can utilize an appropriate model to drive its interactive behavior. Such a model can include any appropriate machine learning model, such as a generative model. In the present disclosure, the various interactive processes and / or generative operations performed by a virtual object can be actually executed using an appropriate model corresponding to the virtual object.

[0037] like Figure 2AAs shown, the electronic device 110 can present at least one media content associated with the target user in the interface 200A. As an example, such at least one media content may include multiple forms of media content, such as images, videos, etc. In some examples, such at least one media content may include at least one media segment. Such at least one media content and / or such at least one media segment may be determined based on the historical live content of the target user. In some embodiments, the acquisition and use of such historical live content is performed with the user's authorized access. As an example, according to Figure 2A In the interface 200A shown, the media content 211 may include a video clip associated with the product object "Speaker Y", and such a video clip may be derived from the historical live broadcast content associated with "Speaker Y".

[0038] Furthermore, electronic device 110 may receive input content via interface 200A to support conversational interaction between current user 140 and the virtual object. For example, such input content may be input by current user 140 by triggering an input component, and examples thereof include, but are not limited to, text content, graphic content, audio content, and the like. For example, such input content may include "Good afternoon" input by the current user.

[0039] In some embodiments, in response to receiving input content via the interactive interface, the electronic device 110 may provide response content from the virtual object. Such response content may be generated based on the input content and at least one item of media content presented by the interactive interface. For example, such response content may include audio content associated with the virtual object, text content associated with the virtual object, response animation associated with the virtual object, and the like.

[0040] Therefore, the embodiments of the present disclosure can present at least one media content in an interactive interface associated with a virtual object, thereby enriching the information provided by the interactive interface and improving the interface interaction efficiency.

[0041] In some embodiments, at least one such media content may correspond to a media content set. For example, the electronic device may currently present media content 211 in the media content set. In some examples, such a media content set may be configured by the target user. In yet other examples, such a media content set may be a plurality of media contents determined by the electronic device 110 from a group of reference media resources associated with the target user based on the theme configured by the target user. In other examples, such a media content set may be a plurality of media contents further configured by the target user after the electronic device 110 determines a plurality of initial media contents from a group of reference media resources associated with the target user based on the theme configured by the target user.

[0042] As an example, the set of reference media resources associated with the target user may include a set of reference media resources that the target user is authorized to access, examples of which include but are not limited to historical media resources published by the target user, media content materials specified by the target user, historical live broadcast content of the target user, etc. In some examples, such historical live broadcast content may be associated with one or more live broadcast activities initiated by the target user.

[0043] In some examples, the theme configured by the target user may indicate at least one commodity object associated with the target user, thereby enabling the electronic device 110 to determine multiple media content items associated with the at least one commodity object. In yet other examples, the theme configured by the target user may indicate at least one commodity attribute of the at least one commodity object, which may, for example, describe object information of the at least one commodity object in at least one information dimension. Such commodity attributes may include, for example, the size, color, function, performance, composition, and the like of the commodity object.

[0044] To improve the quality of the media content collection, electronic device 110 may determine at least one piece of media content by segmenting a set of reference media resources associated with the target user. Specifically, electronic device 110 may determine multiple candidate media segments based on the set of reference media resources. Furthermore, electronic device 110 may determine multiple target media segments associated with the theme from the multiple candidate media segments. Furthermore, electronic device 110 may determine at least one piece of media content by sorting the multiple target media segments. Furthermore, electronic device 110 may construct a media content collection based on the at least one piece of media content.

[0045] In some examples, the electronic device 110 may segment a set of reference media resources using any suitable media segmentation method to obtain multiple candidate media segments. In some examples, the electronic device 110 may segment a set of reference media resources based on semantic information of the set of reference media resources. For example, the electronic device 110 may utilize a generative model to segment such a set of reference media resources, which may, for example, segment an input reference media resource into multiple media segments. In some embodiments, different media segments may be associated with different segment themes, for example, different media segments may describe different aspects of attributes of a commodity object.

[0046] In yet other examples, electronic device 110 may segment a set of reference media resources based on information such as tags of the set of reference media resources. Such tags may, for example, indicate associated merchandise objects, merchandise attributes of the merchandise objects, and so on. The embodiments of this disclosure are not intended to limit the specific basis for determining the segmentation of multiple media segments based on a set of reference media resources.

[0047] In some examples, electronic device 110 may determine multiple target media segments associated with the topic from multiple candidate media segments based on any appropriate matching method. For example, electronic device 110 may determine multiple target media segments whose correlations exceed a threshold from the multiple candidate media segments based on the correlations between the multiple candidate media segments and the topic. Alternatively, electronic device 110 may determine the top N (a positive integer appropriately set as needed) candidate media segments in the correlation ranking as the multiple target media segments, and so on.

[0048] In order to improve the story coherence of at least one media content presented by the electronic device 110, the electronic device 110 may generate text content associated with the theme, which may, for example, indicate descriptive content for at least one commodity object, live broadcast copy for at least one commodity object, and the like. Such text content may include multiple text segments, and different text segments may indicate different commodity objects and / or attributes of commodity objects in different aspects. Furthermore, the electronic device 110 may determine multiple target media segments corresponding to multiple text segments, respectively, from multiple candidate media segments. As an example, the electronic device 110 may match such multiple candidate media segments and multiple text segments through any appropriate text-to-media segment matching scheme to obtain such multiple target media segments. For example, such matching schemes may include vector matching, matching using generative models, and the like, which will not be described in detail in the embodiments of the present disclosure.

[0049] In some examples, the electronic device 110 can sort the multiple target media segments using a suitable sorting method to determine at least one media content, thereby improving the quality of the at least one media content. For example, the electronic device 110 can sort the multiple target media segments based on the text content. For another example, the electronic device 110 can sort the multiple target media segments based on their scores. Such scoring can be implemented using any appropriate scoring tool, such as a scoring model, which can score the input media segments according to a preset scoring standard.

[0050] Based on this, embodiments of the present disclosure can determine at least one media content with higher quality and more reasonable presentation order. Furthermore, the electronic device 110 can present at least one media content based on a preset order in the interactive interface with the virtual object. Such a preset order can, for example, indicate sequential presentation of media content in a media content collection, cyclic presentation of at least one media content, and so on.

[0051] In some embodiments, according to Figure 2BIn the illustrated interface 200B, after presenting the interactive interface with the virtual object, the electronic device 110 may provide a message proactively sent by the virtual object, such as message 243. Such message 243 may include, for example, an introduction such as "Good afternoon, XXXX." Thus, embodiments of the present disclosure may help the current user 140 more quickly understand the virtual object.

[0052] In other embodiments, in response to receiving input content via the interactive interface, the electronic device 110 may provide response content from the virtual object. Such response content may be generated based on the input content. For example, providing such response content may include at least one of the following: playing audio content associated with the virtual object; presenting text content associated with the virtual object in the interactive interface; or presenting a response animation associated with the virtual object in the interactive interface. For example, the audio content associated with the virtual object may have audio attributes associated with the virtual object, such as timbre, speech rate, etc.

[0053] In some examples, after receiving the input content, the electronic device 110 may first present a message 241 indicating a preset visual element (e.g., an image, text, animation, etc.) until the response content is generated. Such a preset visual element may indicate a state of waiting for the response content to be generated. In some examples, the electronic device 110 may adjust the style of an identification element (e.g., an avatar, a name, etc.) associated with the virtual object during the process of providing a message from the virtual object. For example, the electronic device 110 may adjust the size of the identification element, etc.

[0054] In some examples, after receiving the input content, the electronic device 110 can present a response animation associated with the virtual object. Such a response animation can indicate that the source of the audio content and / or text content is a virtual object. As an example, such a response animation can include an image animation of the virtual object, a broadcast animation associated with the virtual object, and the like. In some examples, such a response animation can be played at any appropriate position on the interactive interface. Alternatively or additionally, such a response animation can have a preset positional relationship with other content presented by the interactive interface. For example, such a response animation can cover the media content presented by the interactive interface, and the like.

[0055] In some examples, according to Figure 2C In the interface 200C shown, the electronic device 110 can present a message 242 from the virtual object. Such a message 242 can include text content associated with the virtual object, and such text content can include reply content to the input content.

[0056] As an example, the electronic device 110 can play audio content associated with such a message 242, such as reading content for text content, etc. As an example, the message from the virtual object can be presented in a variety of suitable locations, including, for example, the conversation area 251, the bullet screen area 252, a pop-up display, etc.

[0057] In some examples, before the text content is generated, the electronic device 110 may present a message indicating a preset visual element in the bullet screen area 252. Furthermore, after the text content is generated, the electronic device 110 may stop displaying such a message indicating a preset visual element and present the generated text content in the conversation area 251.

[0058] Alternatively, after the text content is generated, the electronic device 110 can provide messages from the virtual object in the conversation area 251 and the bullet screen area 252 based on the generated text content. The messages presented in the conversation area 251 and the bullet screen area 252 can include the same text (e.g., the generated text content) or different text generated based on the text content. Thus, embodiments of the present disclosure can make conversations with virtual objects more realistic.

[0059] In some embodiments, the electronic device 110 may adjust the playback volume of the media content currently being presented in the virtual object interaction interface while providing the response content to reduce the impact of the audio of the media content on the provided response content. For example, the electronic device 110 may adjust the playback volume of the media content to a preset percentage, etc.

[0060] In some embodiments, the electronic device 110 may adjust the display style of the media content currently being presented in the virtual object interaction interface while providing the response content to help the current user 140 view the text content included in the provided response content. For example, the electronic device 110 may pause the media content, reduce the brightness of the media content, etc.

[0061] In some embodiments, if the current user 140 further inputs content before the electronic device 110 provides the response content, the electronic device 110 can provide the response content in combination with the content further input by the current user 140. Specifically, taking the previous input content of the current user 140 as the first input content as an example, before providing the response content for the first input content, the electronic device 110 can receive the second input content via the interactive interface. Furthermore, the electronic device 110 can trigger the stop of generating the response content specific to the first input content, and trigger the generation of the response content based on the first input content and the second input content. Thus, the embodiments of the present disclosure can improve the speed of the response and can ensure the integrity of the response that fully responds to the input content of the current user.

[0062] Furthermore, the electronic device 110 may switch the interactive interface to present second media content associated with the input content in the media content collection. Thus, such response content may include at least a first part and a second part, wherein the first part includes reply content to the input content, and the second part includes guidance content associated with such second media content. As an example, such guidance content may be preset or generated based on the subject or tag corresponding to the second media content.

[0063] In order to improve the accuracy of the virtual object's response to the input content, the electronic device 110 may determine whether the media content set includes media content associated with the input content. As an example, the electronic device 110 may determine whether the input content is associated with the media content based on the correlation between the input content and the media content. For example, the electronic device 110k may determine the media content whose correlation with the input content exceeds a preset correlation as the media content associated with the input content. As an example, such correlation may be determined by any appropriate determination method, for example, based on the degree of matching between the text content corresponding to the input content and the media content, based on the degree of matching between the reply content corresponding to the input content and the text content, based on the similarity between the input content and the media content, and so on.

[0064] Furthermore, if the media content set does not include media content associated with the input content, the electronic device 110 may continue to present the media content in the media content set based on a preset order. Furthermore, the response content from the virtual object may not include such a second portion. However, if the media content set includes second media content associated with the input content, the electronic device 110 may switch to the associated second media content.

[0065] As an example, according to Figure 2D In the interface 200D shown, the current input content of the user 140 may include "how is the performance of the audio Y?" Figure 2E In the interface 200E shown, the virtual object may provide a message 244 and / or a message 245 as a response content to the input content. As an example, when providing the message 244 and / or the message 245, the electronic device 110 may play the corresponding audio content associated with the virtual object. Figure 2F In the illustrated interface 200F, the electronic device 110 may present media content 212 (also referred to as second media content) from the media content collection. Such media content 212 may be a video clip introducing the performance of speaker Y. This allows the current user 140 to more conveniently understand the performance of speaker Y, thereby improving interface interaction efficiency and the user's efficiency in obtaining information.

[0066] In some embodiments, if the electronic device 110 does not receive input content before the second media content is finished playing, the electronic device 110 can present the next media content in the media content collection starting from the second media content based on a preset order to avoid the electronic device 110 repeatedly presenting the same media content in a short period of time, thereby improving the quality of the media content presented by the interactive interface.

[0067] In some embodiments, the electronic device 110 may present an access portal in an interactive interface with a virtual object, and such an access portal may be configured to trigger access to a viewing interface of a specified object (e.g., a specified commodity object). In some examples, such a specified object may be an object associated with media content presented in the interactive interface, thereby allowing the current user 140 to more conveniently understand the specified object through the presented media content and the access portal of the specified object.

[0068] In some examples, the first media content may be associated with a first object, and the second media content may be associated with a second object. Furthermore, in response to the first media content being presented in the interactive interface, the electronic device 110 may present a first access entry associated with the first object. And in response to the second media content being presented in the interactive interface, the electronic device 110 may present a second access entry associated with the first object. Thus, the electronic device 110 can ensure the consistency of the content presented in the interactive interface, thereby further improving the efficiency with which users obtain information from the interactive interface.

[0069] As an example, return to Figure 2A , the media content 211 is associated with the product object "audio Y". When the media content 211 is presented in the interface 200A, the electronic device 110 may present an access entry 231 (e.g., a product card indicating the product object "audio Y") or an access entry 232 (e.g., a product viewing entry indicating the product associated with the virtual object) associated with the product object "audio Y" in the interface 200A. Figure 2G In the interface 200G, the current user 140 can trigger the access entry 231 (or access entry 232) to trigger the viewing interface 200G of the product object "Speaker Y". In this way, the embodiments of the present disclosure can help users more conveniently view more information about the product object and improve the efficiency of interface interaction.

[0070] As an example, Figure 2GAs shown, current user 140 can further understand the product object "Speaker Y" by viewing interface 200G. For example, electronic device 110 can view interface 200G, which may present various object information indicating the product object "Speaker Y", including, for example, object information 261 (e.g., the display content of the product object "Speaker Y"), object information 262 (e.g., the description content of the product object "Speaker Y"), and so on. Thus, embodiments of the present disclosure can improve the efficiency with which users obtain information related to objects.

[0071] Based on this approach, the embodiments of the present disclosure can present at least one media content associated with the user in an interactive interface associated with a virtual object, thereby enriching the information provided by the interactive interface and improving interface interaction efficiency.

[0072] Therefore, the embodiments of the present disclosure can improve the efficiency of interface interaction.

[0073] Example Process

[0074] Figure 3 FIG. 3 is a flow chart showing an example interface interaction process 300 according to some embodiments of the present disclosure. The process 300 may be implemented at the electronic device 110. Figure 1 Process 300 is described.

[0075] like Figure 3 As shown, at box 310, at least one media content associated with a user is presented in an interactive interface associated with the virtual object, and the user is associated with the virtual object.

[0076] At box 320, the electronic device 110 provides response content from the virtual object in response to receiving the input content via the interactive interface, where the response content is generated based on the input content and at least one media content.

[0077] In some embodiments, the at least one media content item corresponds to a media content set, and process 300 further includes switching the interactive interface from presenting a first media content item in the media content set to presenting a second media content item in the media content set that is associated with the input content.

[0078] In some embodiments, switching the interactive interface from presenting first media content in a media content set to presenting second media content in the media content set that is associated with input content includes: determining whether the media content set includes media content associated with the input content; and in response to the media content set including the second media content associated with the input content, switching the interactive interface to presenting the second media content.

[0079] In this way, the embodiments of the present disclosure can ensure that the switched second media content is associated with the input content of the current user, thereby improving the efficiency of the current user in obtaining information from the interactive interface.

[0080] In some embodiments, process 300 further includes: in response to determining that the media content set does not include media content associated with the input content, presenting the media content in the media content set based on a preset order in the interactive interface.

[0081] In this way, the embodiments of the present disclosure can continue to present the media content in the media content set based on the preset order when the media content set does not include the media content associated with the input content, thereby ensuring the continuity of the media content presented by the interactive interface.

[0082] In some embodiments, the response content includes: a first part including reply content to the input content; and a second part including guidance content associated with the second media content.

[0083] In this way, embodiments of the present disclosure make the response content more realistic, thereby improving the quality of the conversation provided by the virtual object.

[0084] In some embodiments, the first media content is associated with a first object and the second media content is associated with a second object, and process 300 further includes: in response to the first media content being presented in the interactive interface, presenting a first access entry associated with the first object; and / or in response to the second media content being presented in the interactive interface, presenting a second access entry associated with the first object.

[0085] In this way, the embodiments of the present disclosure can help the current user to more conveniently understand the objects associated with the media content presented on the interactive interface, and can improve the efficiency of interface interaction.

[0086] In some embodiments, the first object or the second object is a commodity object, and the first access portal or the second access portal is configured to trigger access to a viewing interface of the commodity object.

[0087] In this way, the embodiments of the present disclosure can help the current user to learn more information about the object more conveniently, thereby improving the efficiency of the current user in acquiring information.

[0088] In some embodiments, providing response content from the virtual object includes at least one of the following: playing audio content associated with the virtual object; presenting text content associated with the virtual object in an interactive interface; and presenting a response animation associated with the virtual object in an interactive interface.

[0089] In this way, the embodiments of the present disclosure can respond to the current user's input content in multiple dimensions, thereby further improving the efficiency of the user in obtaining information.

[0090] In some embodiments, process 300 also includes: adjusting the playback volume of the media content currently presented in the interactive interface during the provision of the response content; and / or adjusting the display style of the media content currently presented in the interactive interface during the provision of the response content.

[0091] In this way, the embodiments of the present disclosure can reduce the interference of the media content presented by the interactive interface on the response content, thereby improving the efficiency of the user in obtaining information in the response content.

[0092] In some embodiments, the at least one item of media content includes a plurality of media content items determined from a set of reference media resources associated with a user based on a theme configured by the user, the user being associated with the virtual object.

[0093] In this way, embodiments of the present disclosure can improve the quality of media content presented by the interactive interface by associating the media content presented by the interactive interface with the theme configured by the user, thereby improving the quality of the media content presented by the interactive interface.

[0094] In some embodiments, at least one item of media content is determined based on the following process: determining multiple candidate media segments based on a set of reference media resources; determining multiple target media segments associated with the topic from the multiple candidate media segments; and determining at least one item of media content by sorting the multiple target media segments.

[0095] In this way, embodiments of the present disclosure can improve the quality of media content presented by the interactive interface by associating the media content presented by the interactive interface with the theme configured by the user, thereby improving the quality of the media content presented by the interactive interface.

[0096] In some embodiments, determining multiple target media segments associated with a topic from multiple candidate media segments includes: generating text content associated with the topic, the text content including multiple text segments; and determining multiple target media segments corresponding to the multiple text segments respectively from the multiple candidate media segments.

[0097] In this way, the embodiments of the present disclosure can improve the matching of each media content in the media content set with the text content, thereby making the switching between the media content presented in the interactive interface smoother.

[0098] In some embodiments, the topic indicates at least one merchandise object associated with the user.

[0099] In this way, embodiments of the present disclosure can present media content related to at least one commodity object in an interactive interface, thereby helping users to more conveniently understand the at least one commodity object through the presented media content.

[0100] In some embodiments, a set of reference media resources includes at least one of the following: historical live broadcast content of a user; and historical media resources released by the user.

[0101] In this way, embodiments of the present disclosure can improve the quality of at least one item of media content determined based on a set of reference media resources.

[0102] In some embodiments, the input content is first input content, and process 300 further includes: receiving second input content via the interactive interface before providing response content for the first input content; and triggering stopping the generation of response content specific to the first input content, and triggering the generation of response content based on the first input content and the second input content.

[0103] In this way, the embodiments of the present disclosure can improve the quality of the response content while ensuring the integrity of the response content, and increase the speed of providing the response content.

[0104] Example devices and equipment

[0105] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 4 1 shows a schematic structural block diagram of an example apparatus 400 for interface interaction according to certain embodiments of the present disclosure. Apparatus 400 may be implemented as or included in electronic device 110. Each module / component in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0106] like Figure 4 As shown, the device 400 includes a first presentation module 410, which is configured to present at least one media content associated with a user in an interactive interface associated with a virtual object, where the user is associated with the virtual object; and a providing module 420, which is configured to provide response content from the virtual object in response to input content received via the interactive interface, where the response content is generated based on the input content and at least one media content.

[0107] In some embodiments, at least one media content corresponds to a media content set, and the device 400 further includes a switching module configured to switch the interactive interface from presenting a first media content in the media content set to presenting a second media content in the media content set associated with the input content.

[0108] In some embodiments, the switching module is further configured to: in response to determining that the media content set does not include media content associated with the input content, present the media content in the media content set based on a preset order in the interactive interface.

[0109] In some embodiments, the response content includes: a first part including reply content to the input content; and a second part including guidance content associated with the second media content.

[0110] In some embodiments, the first media content is associated with a first object, and the second media content is associated with a second object. The device 400 also includes a third presentation module, which is configured to: present a first access entry associated with the first object in response to the first media content being presented in the interactive interface; and / or present a second access entry associated with the first object in response to the second media content being presented in the interactive interface.

[0111] In some embodiments, the first object or the second object is a commodity object, and the first access portal or the second access portal is configured to trigger access to a viewing interface of the commodity object.

[0112] In some embodiments, the providing module 420 is further configured to perform at least one of the following: playing audio content associated with the virtual object; presenting text content associated with the virtual object in the interactive interface; and presenting a response animation associated with the virtual object in the interactive interface.

[0113] In some embodiments, the device 400 also includes an adjustment module configured to: adjust the playback volume of the media content currently presented in the interactive interface during the provision of response content; and / or adjust the display style of the media content currently presented in the interactive interface during the provision of response content.

[0114] In some embodiments, the at least one item of media content includes a plurality of media content items determined from a set of reference media resources associated with a user based on a theme configured by the user, the user being associated with the virtual object.

[0115] In some embodiments, the device 400 also includes a determination module configured to: determine multiple candidate media segments based on a set of reference media resources; determine multiple target media segments associated with the topic from the multiple candidate media segments; and determine at least one media content by sorting the multiple target media segments.

[0116] In some embodiments, the determination module is further configured to: generate text content associated with the topic, the text content including multiple text segments; and determine multiple target media segments corresponding to the multiple text segments respectively from the multiple candidate media segments.

[0117] In some embodiments, the topic indicates at least one merchandise object associated with the user.

[0118] In some embodiments, a set of reference media resources includes at least one of the following: historical live broadcast content of a user; and historical media resources released by the user.

[0119] In some embodiments, the input content is first input content, and the device 400 also includes a trigger generation module, which is configured to: receive second input content via the interactive interface before providing response content for the first input content; and trigger the stop of generating response content specific to the first input content, and trigger the generation of response content based on the first input content and the second input content.

[0120] The modules included in the device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the modules in the device 400 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0121] Figure 5 1 shows a block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented. Figure 5 The illustrated electronic device 500 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 5 The electronic device 500 shown can be used to implement Figure 1 electronic device 110 or Figure 4 device 400.

[0122] like Figure 5 As shown, electronic device 500 is in the form of a general electronic device. Components of electronic device 500 may include, but are not limited to, one or more processors or processing units 510, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processing unit 510 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device 500.

[0123] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 500.

[0124] The electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 5 As shown in FIG, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. Memory 520 may include a computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0125] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 500 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0126] Input device 550 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 560 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 500 may also communicate with one or more external devices (not shown) via communication unit 540 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with electronic device 500, or with any device that allows electronic device 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (H / O) interface (not shown).

[0127] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0128] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0129] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0130] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0131] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0132] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: Presenting, in an interactive interface associated with a virtual object, at least one item of media content associated with a user associated with the virtual object; as well as In response to receiving input content via the interactive interface, providing response content from the virtual object, the response content being generated based on the input content and the at least one item of media content.

2. The method according to claim 1, wherein the at least one item of media content corresponds to a media content collection, the method further comprising: The interactive interface is switched from presenting a first media content in the media content set to presenting a second media content in the media content set that is associated with the input content.

3. The method according to claim 2, wherein switching the interactive interface from presenting a first media content in the media content set to presenting a second media content in the media content set associated with the input content comprises: determining whether the media content set includes media content associated with the input content; as well as In response to the media content collection including the second media content associated with the input content, the interactive interface is switched to presenting the second media content.

4. The method according to claim 3, further comprising: In response to determining that the media content set does not include media content associated with the input content, media content in the media content set is presented in the interactive interface based on a preset order.

5. The method according to claim 2, wherein the response content comprises: A first part, the first part including reply content to the input content; as well as A second portion includes introductory content associated with the second media content.

6. The method according to claim 2, wherein the first media content is associated with a first object, and the second media content is associated with a second object, the method further comprising: In response to the first media content being presented in the interactive interface, presenting a first access entry associated with the first object; and / or In response to the second media content being presented in the interactive interface, a second access entry associated with the first object is presented.

7. The method according to claim 6, wherein the first object or the second object is a commodity object, and the first access portal or the second access portal is configured to trigger access to a viewing interface of the commodity object.

8. The method of claim 1 , wherein providing responsive content from the virtual object comprises at least one of: playing audio content associated with the virtual object; Presenting text content associated with the virtual object in the interactive interface; Presenting a response animation associated with the virtual object in the interactive interface.

9. The method according to claim 1, further comprising: During the provision of the response content, adjusting the playback volume of the media content currently presented in the interactive interface; and / or During the provision of the response content, the display style of the media content currently presented in the interactive interface is adjusted.

10. The method of claim 1, wherein the at least one item of media content comprises a plurality of media content items determined from a set of reference media resources associated with a user based on a theme configured by the user, the user being associated with the virtual object.

11. The method of claim 10, wherein the at least one item of media content is determined based on the following process: determining a plurality of candidate media segments based on the set of reference media resources; determining a plurality of target media segments associated with the subject from the plurality of candidate media segments; and The at least one media content is determined by sorting the multiple target media segments.

12. The method according to claim 11, wherein determining a plurality of target media segments associated with the topic from the plurality of candidate media segments comprises: generating text content associated with the topic, wherein the text content includes a plurality of text segments; as well as The multiple target media segments respectively corresponding to the multiple text segments are determined from the multiple candidate media segments. The method of claim 10 , wherein the subject indicates at least one merchandise object associated with the user.

14. The method of claim 10, wherein the set of reference media resources comprises at least one of the following: The user's historical live broadcast content; Historical media resources published by the user.

15. The method according to claim 1, wherein the input content is first input content, the method further comprising: Before providing a response to the first input content, receiving a second input content via the interactive interface; as well as The method triggers stopping the generation of response content specific to the first input content and triggering the generation of response content based on the first input content and the second input content.

16. A device for interface interaction, comprising: a first presentation module configured to present at least one media content associated with a user associated with the virtual object in an interactive interface associated with the virtual object; A providing module is configured to provide response content from the virtual object in response to receiving input content via the interactive interface, where the response content is generated based on the input content and the at least one media content.

17. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 15 when executed by the at least one processing unit.

18. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the method according to any one of claims 1 to 15 is implemented.

Images