Interface interaction method and device, equipment and storage medium

Abstract

The embodiment of the invention relates to an interface interaction method and device, equipment and a storage medium. The method provided by the invention comprises the following steps: presenting an interaction entrance in a viewing interface of media content; and in response to the triggering of the interaction entrance, presenting an interaction content generated by the model based on the media content, the theme of the interaction content being determined from a plurality of preset themes based on the reference information of the media content. In this way, the information obtaining efficiency of the user can be improved.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein relate generally to the field of computers, and more particularly to methods, apparatuses, devices, and computer-readable storage media for interface interaction. Background Technology

[0002] With the increasing maturity of internet technology, more and more users are engaging in interactive activities on online platforms. For example, users can browse or publish media content through these platforms. Users obtain information by browsing media content. Therefore, improving the efficiency of information acquisition for users during their media browsing process is a matter of great concern. Summary of the Invention

[0003] In a first aspect of this disclosure, a method for interface interaction is provided. The method includes: presenting an interactive entry point in a media content viewing interface; and, in response to triggering the interactive entry point, presenting interactive content generated by a model based on the media content, wherein the theme of the interactive content is determined from a plurality of preset themes based on reference information of the media content.

[0004] In a second aspect of this disclosure, an apparatus for interface interaction is provided. The apparatus includes: a first presentation module configured to present an interactive entry point in a media content viewing interface; and a second presentation module configured to, in response to triggering the interactive entry point, present interactive content generated by a model based on the media content, wherein the theme of the interactive content is determined from a plurality of preset themes based on reference information of the media content.

[0005] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0008] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram is shown of an example environment in which embodiments of the present disclosure may be implemented;

[0010] Figures 2A to 2G Example interfaces according to some embodiments of this disclosure are shown;

[0011] Figure 3 A flowchart illustrating an example process of interface interaction according to some embodiments of the present disclosure is shown;

[0012] Figure 4 A schematic structural block diagram of an example device for interface interaction according to some embodiments of the present disclosure is shown; and

[0013] Figure 5 A block diagram of an electronic device capable of implementing several embodiments of the present disclosure is shown. Detailed Implementation

[0014] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0015] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0016] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0017] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0018] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0019] As mentioned above, with the increasing maturity of internet technology, more and more users are engaging in interactive activities on online platforms. For example, users can browse or publish media content through these platforms. Users can obtain information by browsing media content. Therefore, improving the efficiency of information acquisition for users during their media browsing process is a matter of concern.

[0020] Embodiments of this disclosure propose a scheme for interface interaction. According to this scheme, this disclosure can present an interactive entry point in a media content viewing interface. Furthermore, in response to triggering the interactive entry point, this disclosure can present interactive content generated by a model based on the media content. The theme of the interactive content is determined from multiple preset themes based on reference information from the media content.

[0021] In this way, embodiments of this disclosure can provide users with interactive entry points in the media content viewing interface, thereby enriching the ways users interact with media content. Furthermore, embodiments of this disclosure can respond to user triggering of the interactive entry point, presenting interactive content generated by the model based on the media content, thereby improving the efficiency of users obtaining information and the efficiency of interaction between users and the model. Moreover, embodiments of this disclosure can determine the theme of the interactive content from multiple preset topics based on reference information of the media content. Thus, embodiments of this disclosure can enrich the presentation information of the interactive content through multiple preset topics. Furthermore, embodiments of this disclosure can determine the theme of the interactive content based on reference information of the media content, thereby improving the correlation between the interactive content and the media content, which is beneficial to improving the presentation efficiency of information related to the media content.

[0022] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings.

[0023] Example Environment

[0024] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. For example... Figure 1 As shown, example environment 100 may include electronic device 110.

[0025] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, examples of which may include, but are not limited to, media applications, live streaming applications, social applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0026] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0027] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0028] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0029] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0030] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0031] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0032] Example Interaction

[0033] Figures 2A to 2G Example interfaces 200A to 200G according to some embodiments of the present disclosure are shown. Example interfaces 200A to 200G may, for example, be provided by... Figure 1 Provided by the electronic device shown.

[0034] In some embodiments, such as Figure 2A As shown, the electronic device 110 can present an interface 200A. For example, the interface 200A can be implemented as a media content viewing interface (or playback interface). As an example, such a viewing interface can be a content stream viewing interface. In some embodiments, the content stream can include a set of media content and can support the user to switch to other media content in the playback content stream based on preset operations (e.g., up and down swiping operations) in the viewing interface. For example, such media content can include video content, text and image content, image gallery content, and / or audio content, etc.

[0035] As an example, electronic device 110 can present media content 202 in interface 200A. Electronic device 110 can also present interactive entry points associated with media content 202 in interface 200A, such as interactive entry point 204. Furthermore, electronic device 110 can present interactive content generated by a model based on the media content in response to triggering interactive entry point 204. For example, electronic device 110 can present interactive content in an interactive panel of media content 202.

[0036] In some embodiments, such a model may be a generative model. Alternatively, such a model may also be associated with virtual objects. Virtual objects may include any suitable processing entity that supports interaction via prompts or similar means. In some scenarios, virtual objects may also be referred to as virtual entities, examples of which may include, but are not limited to, agents, bots, or other objects that support interaction via dialogue (e.g., text or voice dialogue). It should be understood that, on the one hand, virtual objects may have a virtual avatar for interaction. On the other hand, virtual objects may also utilize appropriate models to drive their interactive behavior, such models may include any suitable machine learning model, for example, a generative model. This disclosure is not intended to limit the specific construction of virtual objects.

[0037] In some embodiments, such as Figure 2B As shown, electronic device 110 can present interface 200B. Interface 200B can be implemented as a media content viewing interface. Electronic device 110 can present an interactive panel 206 of media content 202 in interface 200B. Electronic device 110 can present interactive content in interactive panel 206. Alternatively, electronic device 110 can present at least a portion of the interactive content in a preset area (e.g., area 208) of interactive panel 206. Further, electronic device 110 can present interactive content in response to receiving a first operation associated with the preset area. As an example, the first operation may include a click operation or a swipe operation associated with the preset area. Alternatively, electronic device 110 can provide viewing controls 210 in the preset area. Further, electronic device 110 can present interactive content in response to triggering the viewing controls 210.

[0038] As an example, such as Figure 2CAs shown, the electronic device 110 can present an interface 200C. The interface 200C can, for example, be implemented as a media content viewing interface. The electronic device 110 can present an interactive panel 206 on the interface 200C. The electronic device 110 can present interactive content in a preset area (e.g., area 212) of the interactive panel 206. Alternatively, in some cases, due to limitations in interface size, the electronic device 110 can only present at least a portion of the interactive content in the preset area of ​​the interactive panel. Furthermore, the electronic device 110 can support additional portions of the interactive content in the preset area of ​​the interactive panel 206 based on a swipe operation (e.g., an up swipe operation) associated with the preset area of ​​the interactive panel 206.

[0039] In some embodiments, continue to refer to Figure 2B The electronic device 110 can also display media content 202 on the interface 200B. Alternatively, the electronic device 110 can stop playing media content 202 in response to the display of the interactive panel 206. In another embodiment, the electronic device 110 can continue playing media content 202 based on the current playback progress of media content 202 in response to the display of the interactive panel 206.

[0040] Alternatively or additionally, interactive panel 206 may be a first interactive panel, and electronic device 110 may, in response to receiving a first operation associated with a preset area (e.g., area 208), present interactive content in a second interactive panel. For example, the second interactive panel may differ from the first interactive panel. As an example, electronic device 110 may, in response to the presentation of the second interactive panel, stop presenting media content 202 on the interface, so that the user can view the interactive content more intuitively and clearly, thereby improving the efficiency of the user's viewing of the interactive content.

[0041] Additionally or alternatively, the electronic device 110 may also present a set of media content associated with the media content on the interactive panel 206, such as media content 214-1 and media content 214-2, etc. As an example, such a set of media content may include at least one piece of media content associated with the publisher of media content 202. Alternatively, such a set of media content may include at least one piece of media content associated with contextual information of media content 202. As an example, such contextual information may indicate content mentioned in media content 202 (e.g., XX attraction, XX person, XX event), etc.

[0042] Alternatively, the electronic device 110 may also display publishing information associated with the media content 202 in the interactive panel 206. For example, such publishing information could be descriptive text added by the publisher of the media content 202 when publishing the media content 202. Alternatively, the electronic device 110 may also display tags associated with the media content 202 in the interactive panel 206. Such tags could be added by the publisher of the media content 202 when publishing the media content 202. Alternatively, such tags could be matched by the server 130 based on the context information of the media content 202. Alternatively, the electronic device 110 may also display identification information (e.g., avatar and / or name) of the user (e.g., publisher) associated with the media content 202 in the interactive panel.

[0043] In some embodiments, the theme of the interactive content generated by the model based on media content is determined from multiple preset themes based on reference information of the media content. As an example, different preset themes may correspond to different content generation modes. For instance, the theme of the interactive content determined from multiple preset themes may be used to indicate the type (e.g., content composition) of the interactive content to be generated. As an example, the interactive content generated by the model based on different media content may correspond to different themes. Thus, embodiments of this disclosure can improve the correlation between interactive content and media content, thereby improving the efficiency of information display associated with media content.

[0044] In some embodiments, multiple preset topics may include a first preset topic. As an example, the first preset topic may instruct the generation of summary text for the media content. As an example, such summary text may be a general descriptive text of the media content. Such summary text may instruct a refined summary of the media content.

[0045] As an example, such summary text could include a first summary text and a second summary text. As an example, the model could determine that the interactive content generated based on the media content corresponds to the first summary text based on the media content's length being less than a preset threshold (e.g., the media content's length is less than 10 seconds). This first summary text could be a summary description of the media content's main theme. For example, the first summary text could include a descriptive text describing the main theme of the media content.

[0046] Alternatively, the model can determine that the interactive content generated based on the media content corresponds to a second summary text based on the media content's content length (e.g., media content duration) not being less than a preset threshold (e.g., media content length greater than or equal to 10 seconds). The second summary text can be a detailed description of the media content. For example, such a second summary text may include multiple descriptive texts organized based on a structured style. Such a structured style can instruct the multiple descriptive texts to be presented in segments to describe the media content in multiple fragments. For example, such multiple fragments are split based on the semantic or logical integrity of the media content.

[0047] As an example, such as Figure 2D As shown, the electronic device 110 can present interactive content corresponding to the summary text in the interface 200D, such as interactive content 216. As an example, interactive content 216 can correspond to the aforementioned second summary text. For example, the interactive content can include multiple text contents presented in segments, such as text content 218-1 and text content 218-2, etc. Alternatively, interactive content 216 can also include multiple titles corresponding to the multiple text contents, such as title 220 corresponding to text content 218-1.

[0048] Alternatively, multiple preset topics may include a second preset topic. As an example, the second preset topic may indicate chapter description information for generating media content. As an example, the model may split the media content into multiple segments. Such a model can be implemented as a machine learning model capable of splitting media content into multiple segments. For example, such a model may split media content into multiple segments based on its plot development, storyline, or character appearance information. This disclosure is not intended to limit the training process or implementation of this machine learning model. Furthermore, the generative model may generate multiple chapter descriptions corresponding to the multiple segments as chapter description information. As an example, multiple chapter descriptions may include multiple descriptive texts and multiple chapter titles corresponding to the multiple segments.

[0049] In some embodiments, the electronic device 110 may, in response to interactive content including descriptive information corresponding to multiple segments of media content, present multiple content items corresponding to the multiple segments of media content in a preset area. When the interactive content corresponds to second summary text, the descriptive information corresponding to the multiple segments of media content may include multiple descriptive texts corresponding to multiple paragraphs. Alternatively, when the interactive content corresponds to chapter description information, the descriptive information corresponding to the multiple segments of media content may include multiple descriptive texts corresponding to multiple chapters. Alternatively, when the interactive content corresponds to the graphic summary information described later, the descriptive information corresponding to the multiple segments of media content may include multiple descriptive texts corresponding to steps (or processes). Alternatively, such descriptive information and multiple descriptive texts corresponding to multiple segments may also include image content (e.g., video frames captured from media content or image content generated based on descriptive text).

[0050] Taking interactive content associated with chapter description information as an example, we will provide an exemplary description of multiple content items corresponding to multiple segments. For example... Figure 2E As shown, electronic device 110 can present interface 200E. Electronic device 110 can present interactive panel 222 in interface 200E. For example, electronic device 110 can present interactive content 224 associated with chapter description information in a preset area of ​​interactive panel 222. As an example, electronic device 110 can present multiple content items corresponding to multiple segments of media content in the preset area, such as content item 226-1 and content item 226-2, etc. Content item 226-1 may include descriptive text and chapter title of the corresponding segment. As an example, content item can indicate identification information of the corresponding segment. Such identification information may include the chapter title of the corresponding segment. Content item can also indicate descriptive text of the corresponding segment. Alternatively, such content item can also indicate time information of the corresponding segment. Taking content item 226-1 as an example, content item 226-1 can indicate the chapter title 228 of the corresponding segment (e.g., Chapter 1·XXXX). Content item 226-1 can indicate descriptive text 230 of the corresponding segment. Alternatively, content item 226-1 may also present a time indicator element 232 to indicate the time information of the corresponding segment (e.g., the start time of the corresponding segment is 00:07).

[0051] In some embodiments, electronic device 110 may play a first segment of media content in response to the selection of a first content item among a plurality of content items. The first segment corresponds to the first content item. For example, electronic device 110 may play a segment of media content corresponding to content item 226-1 (e.g., such a segment has a start time of 00:07) in response to the selection of content item 226-1. As an example, electronic device 110 may receive a selection of content item 226-1 in response to a click operation on the area where content item 226-1 is located. Alternatively, electronic device 110 may receive a selection of content item 226-1 in response to a click operation on time indicator element 232.

[0052] Alternatively, the interactive content 224 may also include summary text 234 for the media content 202. That is, the interactive content may include summary text associated with the first preset topic, as well as chapter description information associated with the second preset topic.

[0053] Additionally or alternatively, multiple preset topics may include a third preset topic. The third preset topic may instruct the generation of a textual and graphic summary of the media content. This summary may include descriptive text about the media content and corresponding image content. Such image content may be video frames captured from the media content.

[0054] As an example, a text generation model can generate multiple descriptive texts associated with media content. These multiple descriptive texts can correspond to multiple segments of the media content. For example, these multiple segments can correspond to multiple steps (e.g., cooking steps or problem-solving steps) or multiple processes of the media content (e.g., tutorial-type media content). Further, an image matching model can extract multiple video frames associated with time information from the media content based on the time information associated with the multiple descriptive texts. For example, taking a first descriptive text among the multiple descriptive texts, the image matching model can match the first descriptive text with multiple timestamp texts associated with the media content. Further, the image matching model can determine the first time information corresponding to the first descriptive text based on the first timestamp text, based on the first timestamp text. Further, the image matching model can extract frames from the media content based on the first time information to obtain multiple candidate video frames. Further, a frame selection model can determine at least one video frame corresponding to the first descriptive text from the multiple candidate frames based on the feature similarity between the multiple candidate frames and the first descriptive text. Furthermore, the generative model can generate a text-image summary based on multiple descriptive texts and multiple video frames corresponding to those descriptive texts. The multiple descriptive texts and multiple video frames in the text-image summary are organized based on a structured style.

[0055] In some embodiments, such as Figure 2F As shown, the electronic device 110 can present an interface 200F. The electronic device 110 can present interactive content 236 corresponding to the text and image summary information on the interface 200F. For example, the interactive content 236 may include descriptive text 238 and image content 240 corresponding to the descriptive text 238. Alternatively, the interactive content 236 may also include summary text 242 for media content. That is, the interactive content may include summary text associated with a first preset topic, and may also include text and image summary information associated with a third preset topic.

[0056] As an example, the model can determine the topic of interactive content from multiple preset topics based on reference information about the media content. For example, the reference information about the media content can include the content length. For instance, the model can determine that the topic of the interactive content corresponds to a first preset topic if the content length of the media content is less than a preset threshold (e.g., video content is shorter than 10 seconds). For instance, the model can generate a summary text of the media content based on the media content as the interactive content if the topic of the interactive content corresponds to the first preset topic.

[0057] Alternatively, the model can determine that the topic of the interactive content is at least related to other topics among multiple preset topics, in response to the media content's length being no less than a preset threshold. As an example, the model can also determine the topic of the interactive content from multiple preset topics based on the type of the media content. Due to the richness of media content, the types associated with it are also diverse. The same media content can be associated with multiple types. The types of media content are described here only as examples. As an example, the model for media content can be determined, for example, based on a pre-trained classification model. Such a classification model can be trained, for example, based on a large number of media content samples and the corresponding annotation information. This disclosure is not intended to limit the specific training process of the classification model. For example, the type of media content can include story types, historical types, tutorial types (e.g., cooking tutorials), evaluation types (e.g., mobile phone evaluations), etc.

[0058] As an example, media content associated with a story type or historical genre can correspond to multiple storylines or historical events, making it suitable for being broken down into multiple chapters for description. For instance, in response to the media content's type being associated with related types such as story type and / or historical genre, the model can determine that the interactive content's theme is associated with a second preset theme. For example, in response to the interactive content's theme corresponding to a second preset theme, the model can generate chapter description information for the media content based on the media content, serving as the interactive content.

[0059] As an example, media content associated with a tutorial type or assessment type is suitable for description using images. For instance, the model could determine that interactive content is associated with a third pre-defined topic in response to the media content's type being associated with a tutorial type and / or assessment type. Alternatively, the model could generate a summary of the media content's visuals based on the media content, in response to the interactive content's topic corresponding to a third pre-defined topic, as the interactive content.

[0060] Alternatively, the model can respond to reference information by matching it with multiple candidate topics from a plurality of preset topics. Based on the priority of the multiple candidate topics, a topic for generating interactive content is determined from the multiple candidate topics. As an example, the first priority of a first preset topic is lower than the second priority of a second preset topic, and the second priority of the second preset topic is lower than the third priority of a third preset topic. For example, the model can respond to reference information of media content by matching it with the second and third preset topics from a plurality of preset topics, and determine the topic of the interactive content as the third preset topic.

[0061] In some embodiments, the viewing interface is associated with a content stream that includes media content. Reference information for the media content may at least indicate the type of the content stream. The topic of the interactive content may also be determined based on the type of the content stream. As an example, the content stream may be associated with a first type. The first type may indicate that multiple media contents in the content stream are presented based on a user's search request. For example, when multiple media contents in the content stream are determined based on a search request, the interactive content generated by the model includes answer content generated based on the media content. Such answer content corresponds to the search request. For example, such a search request may be associated with "how to make bread". Electronic device 110 may, in response to receiving such a search request, present a content stream associated with the search request. The content stream includes first media content determined based on the search request (e.g., video content associated with making bread). The interactive content generated by the model based on the first media content may include answer content corresponding to "how to make bread". For example, such answer content is generated based on the method mentioned in the first media content.

[0062] As an example, when the content stream is associated with a search request, the model can replace the summary text in the preceding interactive content with the answer content. For instance, the model can generate interactive content that only includes the answer content if the content length of the media content is less than a threshold. Alternatively, the model can generate interactive content that includes the answer content and chapter description information (or a summary of text and images) if the content length of the media content is not less than a threshold.

[0063] In some embodiments, interactive content may include first interactive content associated with a text style and second interactive content associated with a rich text style. For example, the interactive content associated with the summary text, answer content, chapter description information, and graphic summary information mentioned above is the first interactive content associated with the text style. Alternatively, the second interactive content associated with a rich text style may include graphic content and / or interactive components generated by the model based on media content. Such interactive components allow users to view portions of the text content or portions of the image content based on user interaction actions (e.g., click actions or swipe actions). For example, such interactive components may include table components, map components, etc. This disclosure is not intended to limit the style of the interactive components.

[0064] The electronic device 110 can display first interactive content on an interactive panel. Further, the electronic device 110 can switch the interactive panel to display second interactive content in response to receiving a second operation. In some embodiments, such as... Figure 2G As shown, electronic device 110 can present interface 200G. Electronic device 110 can present interactive panel 244 in interface 200G. Electronic device 110 can receive a second operation in response to a triggering of a first preset control (e.g., control 246) in interactive panel 244, to switch interactive panel 244 to present second interactive content 248. Alternatively, electronic device 110 can switch interactive panel 244 to present first interactive content in response to a triggering of a second preset control (e.g., control 250) in interactive panel 244. Alternatively, the second interactive content can correspond to HTML format.

[0065] Based on the process described above, embodiments of this disclosure can provide users with interactive entry points in the media content viewing interface, thereby enriching the ways users interact with media content. Furthermore, embodiments of this disclosure can respond to user triggering of the interactive entry point, presenting interactive content generated by the model based on the media content, thereby improving the efficiency of user information acquisition and the efficiency of interaction between the user and the model. Moreover, embodiments of this disclosure can determine the theme of the interactive content from multiple preset topics based on reference information of the media content. Thus, embodiments of this disclosure can enrich the presentation information of the interactive content through multiple preset topics. Furthermore, embodiments of this disclosure can determine the theme of the interactive content based on reference information of the media content, thereby improving the correlation between the interactive content and the media content, which is beneficial to improving the presentation efficiency of information associated with the media content.

[0066] Example process

[0067] Figure 3A flowchart illustrating an example process 300 of interface interaction according to some embodiments of the present disclosure is shown. Process 300 can be implemented at electronic device 110. Reference is made below. Figure 1 To describe process 300.

[0068] like Figure 3 As shown in box 310, the electronic device 110 presents an interactive entry point in the media content viewing interface.

[0069] In box 320, electronic device 110 responds to the triggering of an interactive entry point by presenting interactive content generated by a model based on media content, wherein the theme of the interactive content is determined from multiple preset themes based on reference information of the media content.

[0070] In some embodiments, in response to triggering an interactive entry, presenting interactive content generated by the model based on media content includes: in response to triggering an interactive entry, presenting an interactive panel of media content; presenting at least a portion of the interactive content in a preset area of ​​the interactive panel; and in response to receiving a first operation associated with the preset area, presenting the interactive content.

[0071] In this way, embodiments of this disclosure enable users to view interactive content generated by the model based on media content by triggering an interactive entry point, thereby improving the efficiency of users obtaining information. Furthermore, embodiments of this disclosure can also generate at least a portion of the interactive content within a preset area and present the interactive content based on a first operation associated with the preset area, thereby improving the presentation efficiency of the interactive content.

[0072] In some embodiments, process 300 further includes: presenting a set of media content associated with the media content in an interactive panel.

[0073] In this way, embodiments of the present disclosure can provide users with a set of media content associated with media content in an interactive panel, thereby improving the efficiency of users obtaining information.

[0074] In some embodiments, presenting at least a portion of interactive content in a preset area of ​​an interactive panel includes: in response to the interactive content including descriptive information corresponding to multiple segments of media content, presenting multiple content items corresponding to multiple segments of media content in the preset area.

[0075] In this way, embodiments of the present disclosure can present descriptive information corresponding to multiple segments of interactive content to users by presenting multiple content items of multiple segments of media content. Thus, embodiments of the present disclosure, based on presenting interactive content in the form of multiple content items, can improve the efficiency of users obtaining information.

[0076] In some embodiments, process 300 further includes: in response to the selection of a first content item among a plurality of content items, playing a first segment of media content, the first segment corresponding to the first content item.

[0077] In this way, embodiments of the present disclosure can enable users to play media content segments corresponding to content items by selecting content items, thereby improving the user's operational efficiency and information acquisition efficiency.

[0078] In some embodiments, a content item indicates at least one of the following: identification information of the corresponding segment; and time information of the corresponding segment.

[0079] In this way, embodiments of this disclosure can provide users with identification information and / or time information of corresponding segments in the content items, thereby improving the efficiency of users obtaining information.

[0080] In some embodiments, the viewing interface is associated with a content stream that includes media content, and the reference information at least indicates the type of the content stream.

[0081] In this way, embodiments of the present disclosure can support determining the theme of interactive content by the type of content stream, thereby enriching the presentation of interactive content and enhancing the correlation between interactive content and content stream.

[0082] In some embodiments, the content stream includes multiple media contents determined based on a search request, and the interactive content includes at least the response content generated by the model based on the media contents, the response content corresponding to the search request.

[0083] In this way, embodiments of the present disclosure can support providing answer content generated from media content corresponding to a search request within interactive content when the content stream is associated with a search request, thereby improving the efficiency of users obtaining information.

[0084] In some embodiments, the reference information indicates at least one of the following: the content length of the media content; the type of the media content.

[0085] In this way, embodiments of the present disclosure can determine the theme of interactive content based on the content length and / or type of media content, thereby enhancing the relevance between interactive content and media content.

[0086] In some embodiments, the interactive content includes first interactive content associated with a text style and second interactive content associated with a rich text style, and process 300 further includes: presenting the first interactive content in an interactive panel; and switching the interactive panel to present the second interactive content in response to receiving a second operation.

[0087] In this way, the embodiments of this disclosure can provide users with different styles of interactive content, thereby enriching the style of interactive content and improving the efficiency of users obtaining information.

[0088] In some embodiments, the multiple preset topics include a number of the following: a first preset topic, which instructs the generation of summary text for media content; a second preset topic, which instructs the generation of chapter description information for media content; and a third preset topic, which instructs the generation of graphic summary information for media content.

[0089] In this way, embodiments of the present disclosure can provide a variety of preset themes associated with interactive content, thereby enriching the presentation style of interactive content.

[0090] In some embodiments, the chapter description information is generated based on the following process: splitting media content into multiple segments; and generating multiple chapter descriptions corresponding to the multiple segments as chapter description information, wherein the multiple chapter descriptions include multiple descriptive texts corresponding to the multiple segments and multiple chapter titles.

[0091] In this way, embodiments of this disclosure can support the generation of interactive content associated with chapter description information based on media content, thereby improving the efficiency of interactive content generation.

[0092] In some embodiments, the graphic summary information is generated based on the following process: generating multiple descriptive texts associated with media content; obtaining multiple video frames corresponding to the time information from the media content based on the time information associated with the multiple descriptive texts; and generating graphic summary information based on the multiple descriptive texts and the multiple video frames.

[0093] In this way, embodiments of the present disclosure can support the generation of interactive content associated with graphic summary information based on media content, thereby improving the efficiency of interactive content generation.

[0094] In some embodiments, the topic of the interactive content is determined based on the following process: in response to the matching of reference information with multiple candidate topics among multiple preset topics, a topic for generating the interactive content is determined from multiple candidate topics based on the priority of the multiple candidate topics.

[0095] In this way, embodiments of the present disclosure can determine the topics for generating interactive content based on priority, thereby improving the efficiency of generating interactive content.

[0096] Example devices and equipment

[0097] Embodiments of this disclosure also provide corresponding apparatus for implementing the above methods or processes. Figure 4A schematic structural block diagram of an example device 400 for interface interaction according to certain embodiments of the present disclosure is shown. Device 400 may be implemented as or included in electronic device 110. Various modules / components in device 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0098] like Figure 4 As shown, the device 400 includes: a first presentation module 410 configured to present an interactive entry in a media content viewing interface; and a second presentation module 420 configured to present interactive content generated by a model based on the media content in response to the triggering of the interactive entry, wherein the theme of the interactive content is determined from a plurality of preset themes based on reference information of the media content.

[0099] In some embodiments, the second presentation module 420 is further configured to: present an interactive panel of media content in response to triggering an interactive entry; present at least a portion of the interactive content in a preset area of ​​the interactive panel; and present the interactive content in response to receiving a first operation associated with the preset area.

[0100] In some embodiments, the device 400 further includes a third presentation module configured to present a set of media content associated with the media content in an interactive panel.

[0101] In some embodiments, the second presentation module 420 is further configured to: in response to interactive content including descriptive information corresponding to multiple segments of media content, present multiple content items corresponding to multiple segments of media content in a preset area.

[0102] In some embodiments, the device 400 further includes a playback module, the playback being configured to: in response to the selection of a first content item among a plurality of content items, play a first segment of media content, the first segment corresponding to the first content item.

[0103] In some embodiments, a content item indicates at least one of the following: identification information of the corresponding segment; and time information of the corresponding segment.

[0104] In some embodiments, the viewing interface is associated with a content stream that includes media content, and the reference information at least indicates the type of the content stream.

[0105] In some embodiments, the content stream includes multiple media contents determined based on a search request, and the interactive content includes at least the response content generated by the model based on the media contents, the response content corresponding to the search request.

[0106] In some embodiments, the reference information indicates at least one of the following: the content length of the media content; the type of the media content.

[0107] In some embodiments, the interactive content includes first interactive content associated with a text style and second interactive content associated with a rich text style. The device 400 also includes a switching module configured to: present the first interactive content in an interactive panel; and switch the interactive panel to present the second interactive content in response to receiving a second operation.

[0108] In some embodiments, the multiple preset topics include a number of the following: a first preset topic, which instructs the generation of summary text for media content; a second preset topic, which instructs the generation of chapter description information for media content; and a third preset topic, which instructs the generation of graphic summary information for media content.

[0109] In some embodiments, the chapter description information is generated based on the following process: splitting media content into multiple segments; and generating multiple chapter descriptions corresponding to the multiple segments as chapter description information, wherein the multiple chapter descriptions include multiple descriptive texts corresponding to the multiple segments and multiple chapter titles.

[0110] In some embodiments, the graphic summary information is generated based on the following process: generating multiple descriptive texts associated with media content; obtaining multiple video frames corresponding to the time information from the media content based on the time information associated with the multiple descriptive texts; and generating graphic summary information based on the multiple descriptive texts and the multiple video frames.

[0111] In some embodiments, the topic of the interactive content is determined based on the following process: in response to the matching of reference information with multiple candidate topics among multiple preset topics, a topic for generating the interactive content is determined from multiple candidate topics based on the priority of the multiple candidate topics.

[0112] The units included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0113] Figure 5 A block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 5The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 5 The electronic device 500 shown can be used to achieve Figure 1 Electronic devices 110.

[0114] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0115] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0116] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0117] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0118] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0119] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0120] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0121] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0122] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0123] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0124] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: An interactive entry point is presented in the media content viewing interface; as well as In response to the triggering of the interactive entry point, interactive content generated by the model based on the media content is presented, wherein the theme of the interactive content is determined from multiple preset themes based on reference information of the media content.

2. The method of claim 1, wherein presenting interactive content generated by the model based on the media content in response to triggering the interactive entry point comprises: In response to the triggering of the interactive entry point, an interactive panel of the media content is presented; At least a portion of the interactive content is displayed in a preset area of ​​the interactive panel; as well as In response to receiving a first operation associated with the preset area, the interactive content is presented.

3. The method according to claim 2, further comprising: The interactive panel displays a set of media content associated with the media content.

4. The method of claim 2, wherein presenting at least a portion of the interactive content in a preset area of ​​the interactive panel comprises: In response to the interactive content including descriptive information corresponding to multiple segments of the media content, multiple content items corresponding to the multiple segments of the media content are presented in the preset area.

5. The method according to claim 4, further comprising: In response to the selection of a first content item among the plurality of content items, a first segment of the media content is played, the first segment corresponding to the first content item.

6. The method of claim 4, wherein the content item indicates at least one of the following: Identification information for the corresponding segment; The time information of the corresponding segment.

7. The method of claim 1, wherein the viewing interface is associated with a content stream including the media content, and the reference information at least indicates the type of the content stream.

8. The method of claim 7, wherein the content stream comprises a plurality of media content determined based on a search request, and the interactive content comprises at least response content generated by the model based on the media content, the response content corresponding to the search request.

9. The method of claim 1, wherein the reference information indicates at least one of the following: The length of the media content; The type of media content.

10. The method of claim 1, wherein the interactive content includes first interactive content associated with a text style and second interactive content associated with a rich text style, the method further comprising: The first interactive content is displayed in the interactive panel; as well as In response to receiving the second operation, the interactive panel is switched to display the second interactive content.

11. The method of claim 1, wherein the plurality of preset topics includes a number of the following: The first preset theme instructs the generation of a summary text for the media content; The second preset theme instructs the generation of chapter description information for the media content; The third preset theme instructs the generation of a text and image summary of the media content.

12. The method of claim 11, wherein the chapter description information is generated based on the following process: The media content is split into multiple segments; and Based on the multiple fragments, multiple chapter descriptions corresponding to the multiple fragments are generated as chapter description information. The multiple chapter descriptions include multiple descriptive texts and multiple chapter titles corresponding to the multiple fragments.

13. The method of claim 11, wherein the graphic summary information is generated based on the following process: Generate multiple descriptive texts associated with the media content; Based on time information associated with the plurality of descriptive texts, multiple video frames corresponding to the time information are obtained from the media content; and The graphic summary information is generated based on the multiple descriptive texts and the multiple video frames.

14. The method of claim 1, wherein the theme of the interactive content is determined based on the following process: In response to the reference information matching with multiple candidate topics among the multiple preset topics, the topic for generating the interactive content is determined from the multiple candidate topics based on the priority of the multiple candidate topics.

15. A device for interface interaction, comprising: The first presentation module is configured to present an interactive entry point in the media content viewing interface; as well as The second presentation module is configured to present interactive content generated by the model based on the media content in response to the triggering of the interactive entry, wherein the theme of the interactive content is determined from a plurality of preset themes based on reference information of the media content.

16. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 14 when executed by the at least one processor.

17. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 14.

Images