Interface interaction method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an interface interaction method and device, equipment and a storage medium. The method comprises the following steps: presenting a viewing interface of a content stream; presenting an interactive content item in the viewing interface, the interactive content item comprising a question and at least one interactive control for answering the question, the question being generated based on the reference media content in the content stream; and in response to receiving a target reply for the question via the at least one interaction control, providing evaluation information for the target reply, the evaluation information being determined based on the reference media content. Based on the mode, the embodiment of the invention can assist the user in understanding the knowledge in the reference media content through the interaction mode of question presentation and reply, and the information transmission efficiency can be effectively improved.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein relate generally to the field of computers, and more particularly to interface interaction methods, apparatuses, devices, and computer-readable storage media. Background Technology

[0002] With the development of computer technology, various forms of electronic devices have greatly enriched people's daily lives. For example, people can use electronic devices to perform various interactions, such as viewing various content items, which can be media content items or other content items, etc. Summary of the Invention

[0003] In a first aspect of this disclosure, a method for user interface interaction is provided. The method includes: presenting a viewing interface of a content stream; presenting interactive content items in the viewing interface, the interactive content items including a question and at least one interactive control for answering the question, the question being generated based on reference media content in the content stream; and, in response to receiving a target answer to the question via the at least one interactive control, providing evaluation information for the target answer, the evaluation information being determined based on the reference media content.

[0004] In a second aspect of this disclosure, an apparatus for interface interaction is provided. The apparatus includes: a first presentation module configured to present a viewing interface of a content stream; a second presentation module configured to present interactive content items in the viewing interface, the interactive content items including a question and at least one interactive control for answering the question, the question being generated based on reference media content in the content stream; and a providing module configured to provide evaluation information for the target answer received via the at least one interactive control, the evaluation information being determined based on the reference media content.

[0005] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect of this disclosure, a computer program product is provided. The computer program product includes computer-executable instructions that, when executed by a processor, implement the method according to a first aspect of this disclosure.

[0008] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0010] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0011] Figures 2A-2O Example interface diagrams are shown according to some embodiments of this disclosure;

[0012] Figure 3 A flowchart illustrating a user interface interaction process according to some embodiments of the present disclosure is shown;

[0013] Figure 4 A schematic structural block diagram of an apparatus for interface interaction according to certain embodiments of the present disclosure is shown;

[0014] Figure 5 A block diagram of an electronic device capable of implementing several embodiments of the present disclosure is shown. Detailed Implementation

[0015] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0016] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0017] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0018] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0019] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0020] Embodiments of this disclosure propose a user interface interaction scheme. According to this scheme, a viewing interface for a content stream can be presented. Further, interactive content items can be presented in the viewing interface, each interactive content item including a question and at least one interactive control for answering the question, the question being generated based on reference media content in the content stream. Further, in response to receiving a target answer to the question via at least one interactive control, evaluation information for the target answer can be provided, the evaluation information being determined based on the reference media content.

[0021] Based on this approach, the embodiments of this disclosure can assist users in understanding the knowledge in the reference media content through interactive methods such as question presentation and question answering, which can effectively improve the efficiency of information transmission.

[0022] Example Environment

[0023] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. For example... Figure 1As shown, example environment 100 may include electronic device 110.

[0024] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, and examples may include, but are not limited to, video applications, game applications, social applications, or other suitable applications.

[0025] exist Figure 1 In environment 100, if application 120 is active, application 120 can provide user 140 with a presentation interface 150.

[0026] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal with a display device, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of interface for the target user (such as "wearable" circuitry).

[0027] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0028] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0029] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0030] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0031] Example process

[0032] The following description, with reference to the accompanying drawings, illustrates an example interaction process according to an embodiment of the present disclosure. Figures 2A to 2O Example interfaces 200A to 200O according to some embodiments of the present disclosure are shown. Interfaces 200A to 200O can be provided by... Figure 1 The electronic device 110 shown is provided.

[0033] In some embodiments, the electronic device 110 may present a content stream viewing interface. This content stream may include multiple content items. In some embodiments, these multiple content items may include various types of media content items. Media content items may include live content items (i.e., content items generated in real time during a live broadcast), or non-live content items (i.e., not generated in real time, such as content items that a user may publish on application 120 at a historical time, or content items configured for application 120, etc.), which may be video, text, images, audio, etc.

[0034] In some embodiments, the electronic device can present these multiple content items in the content stream to the user in a linear or dynamic manner. As an example, the electronic device 110 can arrange these multiple content items according to predetermined rules (such as chronological order, recommendation algorithms, etc.) and present them to the user in a viewing interface.

[0035] In some embodiments, the electronic device 110 may respond to the completion of playback of the currently presented content item (e.g., the current video playback progress is 100%), and then the electronic device 110 may automatically play the next content item after the completed content item. This next content item may be other content items in the content stream that are configured to be adjacent to the completed content item and whose playback order is after the completed content item.

[0036] In other embodiments, the electronic device 110 may switch to playing the next content item in response to receiving a predetermined content switching operation while playing a certain content item. It should be noted that when this content switching operation is received, the electronic device 110 can directly switch to playing the next content item regardless of whether the currently playing content item has finished playing. The specific content switching operation can be any appropriate operation (e.g., a swipe up or down), etc.

[0037] To assist users in learning the various knowledge points within the content items and improve information delivery efficiency, in some embodiments, the electronic device 110 can present interactive content items in a viewing interface. Interactive content items may include a question and at least one interactive control for answering the question. This question may be generated based on reference media content in the content stream. The reference media content can be any suitable media content item in the content stream. In some embodiments, the reference media content may be determined based on the user's browsing history, which may indicate media content or media segments that the user has viewed in the content stream. Viewed media content may represent viewing the complete media content item. A media segment may represent a portion of a media content item that the user has viewed; for example, if video A has a total duration of 1 minute and the user only viewed the first 20 seconds of video A, then this media segment can be the segment corresponding to the first 20 seconds of video A. Of course, this reference media content can also be any other suitable media content in the content stream, which may be media content that the user has not viewed. As an example, this reference media content can be media content that meets predetermined requirements, such as a science video, etc.

[0038] This question can be used to assist users in understanding and learning from reference media content. In some embodiments, this at least one interactive control can be any appropriate interface element that assists the user in answering the question, such as a selection control (e.g., a button), a text box, etc.

[0039] In some embodiments, this problem can be generated based on audio information from reference media content. The audio information can be preset audio information in the reference media content, or it can be the voice output by one or more users in the reference media content. For example, in video 1, user A is introducing his residence, so the audio information can be the voice in video 1 about user A introducing his residence.

[0040] In some embodiments, the question can correspond to any appropriate type, such as multiple choice, true / false, short answer, etc. Taking the question generated by server 130 as an example, the question generation process will be explained as follows:

[0041] In some embodiments, server 130 can determine the text content corresponding to the audio information of the reference media content. As an example, server 130 can utilize a trained speech recognition model to recognize the text content corresponding to the audio information. The speech recognition model can be any suitable machine learning model configured to convert speech information into text information. Further, server 130 can provide the text content to the model to generate a question corresponding to a reference question type. The model can be any suitable machine learning model, such as a speech model or a multimodal model that can directly process audio and / or video content. In some embodiments, the reference question type can be any suitable type, which may include, but is not limited to, a first type, a second type, a third type, and a fourth type, etc. The first type may be associated with understanding a first segment of the text content, and a question corresponding to the first type may be, for example, "determine the meaning of a word in sentence A (first segment)". The second type may be associated with reading aloud a second segment of the text content, and a question corresponding to the second type may be, for example, "read aloud sentence B (second segment)". The third type can be associated with reference expressions in the application text content. A question corresponding to this type could be a fill-in-the-blank exercise, where a phrase from the text is presented as an option to fill in a missing part of a sentence. The fourth type can be associated with filling in a third segment of the text content. A question corresponding to this type could be setting a blank in sentence C (the third segment) and asking the user to fill in the missing content.

[0042] In other embodiments, the question may also be associated with audio information related to the reference media content, such as with at least one keyword in that audio information. For example, the question could be "Listen to the audio in video M, what words did you hear?"

[0043] In some embodiments, this interactive content item can be a content item presented when any suitable trigger condition is met. The trigger condition can be any suitable condition, and the question included in the interactive content item can correspond to any suitable reference question type.

[0044] Example 1:

[0045] In some embodiments, the electronic device may display the media content being played in the viewing interface. Figure 2A As shown, the electronic device 110 can play video 201 (refer to media content) in the viewing interface 200A. In some embodiments, the electronic device 110 can display the playback progress of video 201 in the viewing interface 200A, such as displaying a playback progress bar 202 of video 201 in the viewing interface 200A to indicate the playback progress of video 201.

[0046] In some embodiments, the video 201 may include multiple content segments, which may be played in a predetermined order. In some embodiments, these multiple content segments may correspond to different scenes, i.e., each scene corresponds to one content segment. In other embodiments, these multiple content segments may also correspond to different subtitle units, where a sentence in the subtitles can be a subtitle unit. Furthermore, such a subtitle unit may be, for example, the text corresponding to a content segment in the video 201. In some embodiments, this subtitle unit may be the text determined by the electronic device 110 using a predetermined speech model to recognize the speech corresponding to this content segment in the video 201. The predetermined speech model may be any suitable machine learning model, which can be configured to determine the text corresponding to the speech.

[0047] by Figure 2A For example, electronic device 110 is playing a content segment in video 201 that is associated with "waterfall". At this time, this content segment can correspond to subtitle unit 203, which is text recognized based on the speech information of this content segment.

[0048] by Figure 2BAs an example, in some embodiments, the electronic device 110 may, in response to determining that a content segment played in the video 201 meets predetermined conditions, present knowledge information associated with this content segment in the viewing interface 200B. The predetermined conditions can be any suitable condition, such as content introducing a predetermined object or the content segment being a predetermined science popularization segment. The knowledge information can be any suitable information, such as a word introduced in the content segment and its corresponding translation. This knowledge information can be presented on the viewing interface in any suitable form, such as in the form of bullet comments.

[0049] by Figure 2B For example, electronic device 110 can display a bullet screen 204 in response to playing a content segment associated with "waterfall". This bullet screen 204 can be configured to display "waterfall" and its corresponding translation (waterfall).

[0050] In some embodiments, this knowledge information can assist in responding to a question in an interactive content item, wherein the knowledge information is associated with the question, and therefore the presentation of this knowledge information can be configured before the presentation of the interactive content item.

[0051] In some embodiments, the electronic device 110 may be associated with a media content item being played on the viewing interface, presenting interactive content items associated with that media content item.

[0052] As an example, electronic device 110 can display interactive content item 205 in the viewing interface in response to the playback status of video 201 meeting a trigger condition. The playback status can indicate at least one of the following: the duration the reference media content has been played, or whether the reference media content has been paused. The trigger condition can be any suitable condition, such as whether the duration the reference media content has been played has reached the total playback duration of the reference media content, i.e., whether the playback progress of the reference media content is 100%. Alternatively, the trigger condition could be whether the duration the reference media content has been played exceeds a predetermined duration. Another example is that the trigger condition could be that the reference media content has been paused, such as whether the user clicked the pause control during the playback of video 201.

[0053] by Figure 2C As an example, in response to the playback progress of video 201 being 100%, meaning that video 201 has been played completely, electronic device 110 can display interactive content item 205 in viewing interface 200C.

[0054] In some embodiments, the interactive content 205 may include a question 206 and an interactive control 207 for answering the question 206. This interactive control 207 may include multiple selection controls corresponding to multiple candidates for the question 206, such as selection control 207-1 for the candidate "waterfall," selection control 207-2 for the candidate "ocean," and selection control 207-3 for the candidate "stream." In some embodiments, these multiple candidates may be generated by a model based on reference media content. Specifically, these multiple candidates may be generated by a model based on audio information from the reference media content. The model may be any suitable machine learning model, such as a language model or a multimodal model that can directly process audio and / or video content.

[0055] Taking the generation of these multiple candidate options by server 130 as an example, the generation process of these multiple candidate options will be explained.

[0056] In some embodiments, server 130 may determine the text content corresponding to the audio information in the reference media content. Further, server 130 may provide this text content to the model to generate a question corresponding to a reference question type and multiple candidate options.

[0057] In some embodiments, the reference question type corresponding to question 206 can be a first type, which is associated with understanding a first segment in the text content. The text content can be the text corresponding to the audio information of video 201 or a video segment in video 201. The first segment can be a text segment of any appropriate length in this text. As an example, if this text is English text, then the first segment can be a word or phrase in a sentence in this English text, and the question can be "Please translate this word or phrase".

[0058] Furthermore, electronic device 110 can determine a target answer for a question in response to receiving a trigger on at least one of a plurality of selection controls. For example, electronic device 110 can select “waterfall” as the target answer for question 206 in response to a selection on selection control 207-1.

[0059] Furthermore, the electronic device 110 can provide evaluation information for the target answer to a question in response to receiving the target answer. In some embodiments, the evaluation information may be an indication of whether the received target answer to the question is consistent with a reference answer to the question. The reference answer to the question is the standard answer to the question. This evaluation information can be any suitable type of information, such as text, animation, images, etc. For example, the electronic device can display the text "Answer Correct" in the viewing interface in response to receiving a target answer to question 206 that is "waterfall".

[0060] In some embodiments, the evaluation information may also be determined based on the reference media content. Specifically, the evaluation information may be determined based on the audio information of the reference media content.

[0061] Example 2

[0062] In other embodiments, the electronic device 110 may also present various interactive content items based on preset presentation rules. For example, it may present at least one interactive content item after presenting a predetermined number of media content items, or it may present at least one interactive content item at predetermined time intervals, etc., which will not be elaborated here. The reference media content corresponding to the interactive content item presented in the viewing interface can be the previously played media content, or it can be other media content that has already been played. For example, if the electronic device presents Video 1, Video 2, and Video 3 sequentially in the viewing interface, then after playing Video 3, it can present a question generated for Video 1 and interactive controls in the viewing interface. As another example, if the electronic device presents Video 1, Video 2, and Video 3 sequentially in the viewing interface, then after playing Video 3, it can present a question generated for Video 3 and interactive controls in the viewing interface.

[0063] by Figure 2D As an example, the electronic device 110 may present an interactive content item 210. This interactive content item 210 may include a question 211 and interactive controls 212 for answering the question 211. In some embodiments, this interactive content item 210 may be generated based on a video of "Foreigners Eating Sichuan Cuisine" or a video clip from that video.

[0064] Since this interactive content item 210 may not be generated based on the previously viewed video or video clip, to assist the user in quickly reviewing the content of the video or video clip that generated this question 211, and to quickly input the target answer to question 211 in the interactive content item 210, the electronic device 110 can associate itself with the interactive content item 210 and display a prompt message 213 related to the video "Foreigners Eating Sichuan Cuisine" in the viewing interface 200D. This prompt message 213 can be used to instruct the user to answer question 211 based on the video "Foreigners Eating Sichuan Cuisine".

[0065] To facilitate quick browsing of the video "Foreigners Eating Sichuan Cuisine," electronic device 110 can respond to the triggering of prompt message 213 and display the following: Figure 2E The interface 200E is shown. The electronic device 110 can display the video 214 "Foreigners Eating Sichuan Cuisine" or a video clip from the video 214 related to the question 211 in the interface 200E for the user to watch.

[0066] In some embodiments, a user can trigger this prompt message 213 based on any appropriate triggering method, such as clicking on... Figure 2D The text in prompt message 213 can also be clicked, along with the playback control for the media content in prompt message 213. This playback control can be configured on the preview area of ​​the video "Foreigners Eating Sichuan Cuisine" indicated in prompt message 213, or any other suitable location, which will not be elaborated here.

[0067] In some embodiments, question 211 may correspond to a first type, which is associated with understanding a segment (first segment) of text content. The text content may be the audio information corresponding to a video clip of "Foreigners Eating Sichuan Cuisine" or a video clip from that video. The first segment may be a text fragment of any appropriate length within that text. As an example, if the text is in English, then the segment may be a word or phrase from a sentence in that English text, and question 206 may be an alternative description or translation of that phrase.

[0068] In some embodiments, to improve interaction efficiency, the interactive control 212 may include multiple selection controls for multiple candidates for question 210, such as selection control 212-1 corresponding to the candidate "look at this", selection control 212-2 corresponding to the candidate "Ignore this", and selection control 212-3 corresponding to the candidate "clean this", so as to support users to quickly input the target answer for question 211 based on these selection controls.

[0069] Furthermore, electronic device 110 can respond to receiving a trigger on at least one of a plurality of selection controls to determine a target answer for question 211. For example, electronic device 110 can respond to a selection on selection control 212-1 to select "look at this" as the target answer for question 211. For example, a user can click selection control 212-1 to select the "look at this" candidate option, and then click control 219, at which point electronic device 110 can receive a selection on selection control 212-1.

[0070] Furthermore, the electronic device 110 may provide evaluation information about the target response to the received target response to question 211. In some embodiments, this evaluation information may indicate whether the input target response to question 211 is consistent with the reference response corresponding to question 211, that is, whether the input target response to question 211 is the correct answer to question 211.

[0071] like Figure 2F As shown, taking the reference answer to question 211 as "look at this" as an example, if the received target answer to question 211 is "look at this," then the electronic device 110 can display information 215 to indicate that the target answer entered by the user for question 211 is consistent with the reference answer, that is, the target answer entered by the user for question 211 is the correct answer. The electronic device 110 can also display the correct answer to question 211 in a predetermined style. Figure 2F As shown, the electronic device 110 can highlight the selection control corresponding to the correct answer, such as by thickening the border, setting the border color to a predetermined color (such as green), etc.

[0072] by Figure 2G As an example, in some embodiments, electronic device 110 may present interactive content item 220 (second interactive content item) in a viewing interface in response to providing evaluation information for a targeted answer to question 211. As an example, electronic device 110 may present, in response to receiving a selection of control 218 in interface 200F, such as... Figure 2G The viewing interface 200G shown contains interactive content items 220.

[0073] In some embodiments, the interactive content item 220 may include a question 220-1 and an interactive control 220-2 for answering the question 220-1. In some embodiments, the interactive content item 220 may be generated based on the video "Let's visit XXX's home together" or a video clip from that video.

[0074] Since question 220-1 may not have been generated based on the previously viewed video or video clip, to assist the user in quickly reviewing the video or video clip that generated question 220-1 for further inputting a target answer to question 220-1 in interactive content item 220, electronic device 110 can associate with interactive content item 220 and display a prompt message 221 related to the video "Let's visit XXX's house together" in the viewing interface 200G. This prompt message 221 can be used to instruct the user to answer question 220-1 based on the video "Let's visit XXX's house together".

[0075] To facilitate quick viewing of the video "Let's Visit XXX's Home Together," the electronic device 110 can respond to the triggering of the prompt message 221 and display the video "Let's Visit XXX's Home Together" on the viewing interface for the user to watch. In some embodiments, the user can trigger this prompt message 221 based on any appropriate triggering method, such as clicking on... Figure 2G The text in prompt message 221 can be clicked, and the media content playback control in prompt message 221 can also be clicked. This playback control can be configured on the preview area of ​​the video "Let's visit XXX's house together" indicated in the prompt message, or it can be placed in any other appropriate location, which will not be elaborated here.

[0076] In some embodiments, question 220-1 may correspond to a second type, which is associated with a segment (second segment) of text content to be read aloud. The text content may be the text corresponding to the audio information of the video "Let's Visit XXX's Home Together" or a video segment of the video "Let's Visit XXX's Home Together". In some embodiments, the video segment may be a media segment that the user has already viewed in the content stream. The segment to be read aloud may be any appropriately sized text segment. As an example, if the text is in English, then the segment may be a sentence from that English text.

[0077] To facilitate determining the accuracy of the user's reading aloud, in some embodiments, the interactive control 220-2 may include an input control, which can be a voice input control, allowing the user to input the voice generated by the sentence 222. To further facilitate reading aloud, the electronic device may also highlight the words in the sentence 222 that the user is expected to read aloud during the user's voice input process, such as by bolding the words or adding animation effects.

[0078] As an example, a user can click on this interactive control 220-2 (input control) and input voice based on sentence 222. At this time, the electronic device 110 can obtain the user's input through this interactive control 220-2 (input control) to determine the target answer for question 220-1.

[0079] In some embodiments, the input content can be either voice or text. That is, the interactive control 220-2 can provide both voice and text input. Figure 2G In addition to the voice input control shown, there can also be a text input control, such as an electronic keyboard, to allow users to input content based on the text input control, such as copying the sentence 222.

[0080] Furthermore, the electronic device 110 may provide evaluation information about the target response in response to receiving the target response to question 220-1. In some embodiments, this evaluation information may indicate whether the input target response to question 220-1 is consistent with the reference response corresponding to question 220-1, that is, whether the input target response to question 220-1 is the correct answer to question 220-1.

[0081] like Figure 2H As shown, the electronic device 110 can highlight correctly pronounced words in sentence 222 with a first color and incorrectly pronounced words with a second color to indicate whether the target answer to the user's input question 220-1 matches the reference answer, that is, to indicate which words in the user's pronunciation are correctly pronounced and which are incorrectly pronounced. Specifically, if all words in sentence 222 are highlighted with the first color, then the target answer to the user's input question 220-1 matches the reference answer. If any words in sentence 222 are highlighted with the second color, then the target answer to the user's input question 220-1 does not match the reference answer.

[0082] It should be noted that the first and second interactive content items do not limit the number of interactive content items that can be presented consecutively. They simply indicate that different interactive content items can be displayed consecutively, and the number of interactive content items that can be presented consecutively can be any number.

[0083] For ease of description, this application uses the continuous presentation of four interactive content items as an example.

[0084] by Figure 2IAs an example, in some embodiments, electronic device 110 may present interactive content item 230 in a viewing interface in response to providing evaluation information for a target answer to question 220-1. As an example, electronic device 110 may present, in response to receiving a selection of control 229 in interface 200H, such as... Figure 2I The viewing interface 200I shown contains interactive content items 230.

[0085] In some embodiments, the interactive content item 230 may include a question 231 and an interactive control 232 for answering the question 231. In some embodiments, the multiple candidate options (such as "lock down," "run over," and "lighten up") involved in the question 231 and the interactive control 232 in the interactive content item 230 may be generated based on the video "Let's visit XXX's house together" or a video clip from that video. This video clip may be a video clip that the user has already viewed.

[0086] In other words, different interactive content items can come from at least one of the following: the same video clip of the same video, different video clips of the same video, different videos, etc.

[0087] Since question 231 may not be generated based on the previously viewed video or video clip, to assist the user in quickly reviewing the video or video clip that generated question 231 in order to further input the target answer to question 231 in interactive content item 230, electronic device 110 can associate with interactive content item 230 and display a prompt message 233 related to the video "Let's visit XXX's house together" in the viewing interface 200I. This prompt message 233 can be used to instruct the user to answer question 231 based on the video "Let's visit XXX's house together".

[0088] To facilitate quick viewing of the video "Let's Visit XXX's Home Together," the electronic device 110 can respond to the triggering of the prompt message 233 by displaying the video "Let's Visit XXX's Home Together" on the viewing interface for the user to watch. In some embodiments, the user can trigger this prompt message 233 based on any appropriate triggering method, such as clicking on... Figure 2I The text in prompt message 233 can be clicked, and the media content playback control in prompt message 233 can also be clicked. This playback control can be configured on the preview area of ​​the video "Let's visit XXX's house together" indicated in the prompt message, or it can be placed in any other appropriate location, which will not be elaborated here.

[0089] In some embodiments, question 231 may correspond to a third type, which is associated with a reference expression in the application text content. In some embodiments, question 231 may be generated by a model based on a video of "Let's visit XXX's house together" or a video clip of that video; specifically, it may be generated by a model based on the text content of the audio content corresponding to the video of "Let's visit XXX's house together" or a video clip of that video. In some embodiments, the video clip in the video may be a media clip that the user has already viewed in the content stream. The clip to be read aloud may be a text clip of any appropriate length in the text content. As an example, if the text content is English text, then the clip may be a sentence of English from that English text. Figure 2I As an example, Question 231 can fill in missing phrases in sentences by using reference expressions in the application text content.

[0090] In some embodiments, to improve interaction efficiency, the interaction control 232 may include multiple selection controls for multiple candidates for question 231, such as selection control 232-1 corresponding to the candidate "lock down", selection control 232-2 corresponding to the candidate "runover" and selection control 232-3 corresponding to the candidate "lighten up", so as to support users to quickly input the target answer for question 231 based on these selection controls.

[0091] Furthermore, electronic device 110 may respond to receiving a trigger on at least one of a plurality of selection controls to determine a target response to a question. For example, electronic device 110 may respond to the selection of selection control 232-1 to select “lock down” as the target response to question 231.

[0092] Furthermore, the electronic device 110 can provide evaluation information about the target answer to question 231 in response to receiving such a target answer. In some embodiments, this evaluation information can indicate whether the target answer to the input question 231 is consistent with the reference answer corresponding to question 231, that is, whether the target answer to the input question 231 is the correct answer to question 231. The specific presentation method of the evaluation information can be similar to... Figure 2F Similarly, I will not elaborate further here.

[0093] Furthermore, the electronic device 110 may, in response to providing evaluation information for the target answer to question 231, present interactive content item 240 in the viewing interface.

[0094] In some embodiments, the interactive content item 240 may include a question 241 and an interactive control 242 for answering the question 241. In some embodiments, the interactive content item 240 may be generated based on a video of "Foreigners Eating Sichuan Cuisine" or a video clip of that video.

[0095] Since question 241 may not be generated based on the previously viewed video or video clip, to assist the user in quickly reviewing the video or video clip that generated question 241 for further inputting a target answer to question 241 in interactive content item 240, electronic device 110 can associate with interactive content item 240 and display a prompt message 243 related to the video "Foreigners Eating Sichuan Cuisine" in the viewing interface 200J. This prompt message 243 can be used to instruct the user to answer question 241 based on the video "Foreigners Eating Sichuan Cuisine" or a video clip from that video.

[0096] To facilitate quick viewing of the video "Foreigners Eating Sichuan Cuisine," the electronic device 110 can respond to the triggering of the prompt message 243 and display the video "Foreigners Eating Sichuan Cuisine" on the viewing interface for the user to watch. In some embodiments, the user can trigger this prompt message 243 based on any appropriate triggering method, such as clicking on... Figure 2J The text in prompt message 243 can also be clicked, along with the playback control for the media content. This playback control can be configured in the preview area of ​​the video "Foreigners Eating Sichuan Cuisine" as indicated in the prompt message, or in any other suitable location, which will not be elaborated here.

[0097] In some embodiments, question 241 may correspond to a fourth type, which is associated with filling in a segment (third segment) of text content. In some embodiments, this segment in the video may be a media segment that the user has already viewed in the content stream. As an example, if the text content is English text, then the third segment may be a sentence in that English text. Figure 2J As an example, question 241 could be filled in with two words to complete the sentence. Figure 2J The missing content in the sentence shown (third segment).

[0098] In some embodiments, for each empty position, the electronic device 110 can receive a trigger on one of the selection controls 242-1 and 242-2 in the interactive control 242 to determine the response for that empty position, that is, to determine the candidate option corresponding to the triggered selection control as the content to be filled in for that empty position. As an example, for the first empty position, in response to receiving a trigger on selection control 242-1, the electronic device 110 can determine "whatever" as the content to be filled in for the first empty position, and for the second empty position, in response to receiving a trigger on selection control 242-2, the electronic device 110 can determine "recommended" as the content to be filled in for the second empty position. At this time, the electronic device 110 can determine the target response to the question 241 based on the content filled in for these two empty positions. For example, for each empty position, the user can select the empty position and click on a selection control, so that the electronic device 110 can receive a trigger on that selection control for that empty position.

[0099] Furthermore, in response to receiving a target answer to question 241, electronic device 110 can provide evaluation information for that target answer. For example, if the user's target answer matches the reference answer to the question, then electronic device 110 can present, as follows: Figure 2F The information 215 shown indicates that the target answer to the user's input question 241 is consistent with the reference answer, that is, the target answer entered by the user for question 241 is the correct answer.

[0100] It should be noted that the number of interactive content items presented consecutively each time, the reference question type corresponding to each interactive content item, and the trigger conditions for the interactive content to be presented can be set according to needs.

[0101] by Figure 2D-Figure 2J As an example, when the viewing interface is set to present multiple interactive content items consecutively, the electronic device 110 can display the response progress of the interactive content items in the viewing interface, for example, it can display the response progress of the interactive content items in the form of a progress bar. Specifically, with Figure 2D As an example, in response to interactive content item 210 being the first of four consecutively presented interactive content items, the progress bar in the viewing interface 200D could correspond to one-quarter of the total progress. Figure 2I As an example, in response to interactive content item 230 being the third of four consecutive interactive content items, the progress bar in the viewing interface 200I can correspond to three-quarters of the total progress.

[0102] In some embodiments, the electronic device 110 may present only one interactive content item at a time, or present one interactive content item in one or more instances, but present multiple interactive content items consecutively in other instances. In the scenario where only one interactive content item is presented, after providing evaluation information for the target response, the electronic device 110 may also view supplementary media content in the content stream displayed on the interface. This supplementary media content is different from the reference media content. Supplementary media content can be media content whose playback time is after the reference media content, and the reference media content and supplementary media content can be adjacent media content or non-adjacent media content in the content stream. Supplementary media content can be any appropriate type of media content, such as text, images, video, audio, etc.

[0103] Example 3:

[0104] In some embodiments, an electronic device may display the media content item being played in a content streaming viewing interface. Figure 2K As shown, electronic device 110 can play video 251 in viewing interface 200K.

[0105] by Figure 2L As an example, electronic device 110 may, in response to determining that a media segment in video 251 meets predetermined conditions, display an interactive content item 252 associated with this content segment in viewing interface 200L. In this case, the media segment is the reference media content. The predetermined conditions can be any suitable conditions, such as the media segment being associated with a predetermined knowledge point, or a word in the audio information corresponding to the media segment having a similar pronunciation to other words, etc., which will not be elaborated upon here.

[0106] In some embodiments, the interactive content item 252 may include a question 253 and an interactive control 250 for answering the question 253. The interactive control 250 may include multiple selection controls for multiple candidates related to the question 253, such as selection control 250-1 for the candidate "cried", selection control 250-2 for the candidate "knife", selection control 250-3 for the candidate "fruit", selection control 250-4 for the candidate "food", selection control 250-5 for the candidate "night", and selection control 250-6 for the candidate "guy". In some embodiments, these multiple candidates may be generated by a model based on reference media content. Specifically, these multiple candidates may be generated by a model based on audio information from the reference media content. The model may be any suitable machine learning model, such as a language model or a multimodal model that can directly process audio and / or video content.

[0107] In some embodiments, question 253 may be associated with at least one keyword in the audio information of video 251. For example, the at least one keyword may include "knife" from the audio information "I cut the tomato with my knife" in video 251.

[0108] Furthermore, the electronic device can determine a target response to question 253 in response to receiving a trigger on at least one of a plurality of selection controls. Figure 2M As an example, electronic device 110 may respond to selections of selection controls 250-1, 250-3, and 250-5 by using “cried,” “fruit,” and “night” as target responses to question 253.

[0109] Furthermore, the electronic device can, in response to receiving a target response to question 253, provide evaluation information for the target response. Figure 2M As an example, the electronic device may provide evaluation information 260 in response to a received target response of "cried," "fruit," or "night." This evaluation information 260 may indicate that the received target response is inconsistent with the reference response to question 253, meaning that "cried," "fruit," and "night" are not the correct answer to question 253. As another example, the electronic device may present a replay audio selection control on interface 200M to assist the user in listening to the corresponding audio again to answer question 253 by selecting this control.

[0110] Furthermore, the electronic device may also present a viewing portal 261 in response to an evaluation information indicating a discrepancy between the target response and the reference response. Furthermore, the electronic device may present parsed content 262 associated with question 253 in response to receiving a selection of the viewing portal 261.

[0111] In some embodiments, the parsed content 262 may be generated based on the target response and the reference response. Figure 2N As an example, the parsed content 262 presented by the electronic device may include, but is not limited to, the reasons for incorrect answers to questions, reference answers to questions, analysis content corresponding to each candidate option, etc.

[0112] by Figure 2OAs an example, the electronic device can, in response to receiving selections of selection control 250-1, selection control 250-2, and selection control 250-3, use "cried", "knife", and "fruit" as target responses to question 253. Further, the electronic device can provide evaluation information 263 in response to receiving the target responses "cried", "knife", and "fruit", and this evaluation information 263 can indicate that the received target responses to question 253 are consistent with the reference response to this question 253.

[0113] Further, the electronic device can add the knowledge information associated with the reference response to the knowledge set in response to the evaluation information indicating that the target response is consistent with the reference response. The knowledge information can be the knowledge information corresponding to at least one keyword in the audio information, such as the translation content corresponding to at least one keyword. As an example, this knowledge information can be the knowledge information corresponding to all keywords associated with question 253, and can also be the knowledge information of the content in the reference response to question 253 that does not match the target response, which will not be elaborated here. For example, if the target responses are "cried", "fruit", and "night", and the reference response is "cried", "knife", and "fruit", then "knife" and its corresponding translation (tool) can be added to the knowledge set.

[0114] In some embodiments, the knowledge set can include the vocabulary list 270 where the words already collected in the application are located. Figure 2O As an example, the electronic device can, in response to adding "knife" and its corresponding translation (tool) to the vocabulary list 270, present the number of words included in the updated vocabulary list 270 (such as 7) in the interface 200O.

[0115] In some embodiments, the knowledge set can include the vocabulary list 271 where the words already mastered in the application are located. Specifically, the electronic device can also present a control 264 in the interface 200O to support adding the knowledge information associated with the reference response to the vocabulary list 271. Specifically, the electronic device can add "knife" and its corresponding translation (tool) to the vocabulary list 271 in response to receiving a selection of the control 264. Further, the electronic device can, in response to adding "knife" and its corresponding translation (tool) to the vocabulary list 271, present the number of words included in the updated vocabulary list 271 (such as 15) in the interface 200O.

[0116] Based on this approach, the embodiments of this disclosure can assist users in understanding the knowledge in the reference media content through an interactive method of presenting and answering questions, which can effectively improve the efficiency of information transmission.

[0117] Example process

[0118] Figure 3 A flowchart of a user interface interaction process 300 according to some embodiments of the present disclosure is shown. Process 300 can be implemented at electronic device 110. Reference is made below. Figure 1 Describe the process 300.

[0119] In box 310, electronic device 110 presents a viewing interface for the content stream.

[0120] In box 320, electronic device 110 presents interactive content items in the viewing interface. The interactive content items include a question and at least one interactive control for answering the question, which is generated based on reference media content in the content stream.

[0121] In box 330, electronic device 110, in response to receiving a target response to a question via at least one interactive control, provides evaluation information for the target response, the evaluation information being determined based on reference media content.

[0122] Based on this approach, embodiments of this disclosure can assist users in understanding the knowledge in reference media content through interactive question presentation and response, thereby effectively improving the efficiency of information transmission.

[0123] In some embodiments, the referenced media content is determined based on the user's browsing history, which indicates the media content or media segments that the user has viewed in the content stream.

[0124] In this way, the embodiments of this disclosure can effectively improve the efficiency of information transmission by assisting users in repeatedly consolidating their knowledge in the reference media content.

[0125] In some embodiments, at least one interactive control includes a plurality of selection controls with a plurality of candidates for a question, and process 300 further includes: receiving a trigger on at least one of the plurality of selection controls to determine a target response to the question.

[0126] In this way, embodiments of the present disclosure can quickly input the target answer to the question through multiple selection controls, effectively improving interaction efficiency.

[0127] In some embodiments, multiple candidates are generated by the model based on reference media content.

[0128] In this way, embodiments of this disclosure can accurately generate these multiple candidate options.

[0129] In some embodiments, at least one interactive control includes an input control, and process 300 further includes: obtaining user input via the input control to determine a target response to a question, wherein the input includes at least one of the following: text content; voice content.

[0130] In this way, the embodiments of this disclosure can provide input controls to quickly obtain user input content, which can effectively improve the efficiency of interaction. Furthermore, the embodiments of this disclosure can realize the input of various types of content through input controls, enriching the diversity of interaction.

[0131] In some embodiments, presenting an interactive content item in the viewing interface includes: playing reference media content in the viewing interface; and presenting an interactive content item in the viewing interface in response to the playback state of the reference media content meeting a trigger condition, wherein the interactive content item is generated based on a media segment that has been played in the reference media content.

[0132] In this way, embodiments of the present disclosure can present the interactive content item at an appropriate time during the playback of reference media content, which can effectively enhance interactivity.

[0133] In some embodiments, the playback status indicates at least one of the following: the duration for which the reference media content has been played; and whether the reference media content has been paused.

[0134] In this way, the embodiments of this disclosure can effectively ensure the provision of interactive content at key points to assist users in reviewing and consolidating knowledge in reference media content, thereby effectively improving the efficiency of information transmission.

[0135] In some embodiments, the question and / or evaluation information is generated based on audio information from reference media content.

[0136] In this way, embodiments of this disclosure can generate questions or evaluation information based on audio information, which can assist users in learning and understanding knowledge related to the audio information of reference media content, thereby improving the efficiency of information transmission.

[0137] In some embodiments, before presenting the interactive content item in the viewing interface, process 300 further includes: in response to playing a content segment in the reference media content that meets predetermined conditions, presenting knowledge information associated with the content segment in the viewing interface, the knowledge information being associated with the interactive content item.

[0138] In this way, embodiments of this disclosure can provide relevant knowledge information when playing specific content segments, which can help users better understand and digest the reference media content and improve the efficiency of information transmission.

[0139] In some embodiments, process 300 further includes: associating with the interactive content item, presenting a prompt message in the viewing interface that is related to the reference media content, the prompt message being used to instruct on answering questions based on the reference media content.

[0140] In this way, the embodiments of this disclosure can prompt users to answer questions based on reference media content, effectively improving the efficiency of information transmission and interaction.

[0141] In some embodiments, process 300 further includes: presenting reference media content in response to the triggering of a prompt message.

[0142] In this way, the embodiments of this disclosure can present reference media content in a quick manner, reducing many interaction processes and improving interaction efficiency.

[0143] In some embodiments, the interactive content item is a first interactive content item. After providing evaluation information for the target response, process 300 further includes: presenting a second interactive content item in the viewing interface; or presenting additional media content in the content stream in the viewing interface, the additional media content being different from the reference media content.

[0144] In this way, embodiments of this disclosure can continuously provide other interactive content items or other additional media content, increasing the continuity of interaction and improving the efficiency of information transmission.

[0145] In some embodiments, the question is generated based on the following process: determining text content corresponding to audio information of reference media content; and providing the text content to the model to generate a question corresponding to the reference question type.

[0146] In this way, embodiments of this disclosure can use models to summarize knowledge based on reference media content and generate corresponding questions, which can effectively improve the relevance of the generated questions to the reference media content.

[0147] In some embodiments, the reference question types include one of the following: a first type, associated with understanding a first segment of the text content; a second type, associated with reading a second segment of the text content; a third type, associated with applying a reference expression in the text content; and a fourth type, associated with filling in a third segment of the text content.

[0148] In this way, embodiments of the present disclosure can provide different types of questions, thereby increasing the diversity of interaction.

[0149] In some embodiments, the evaluation information indicates whether the target response is consistent with the reference response to the question.

[0150] In this way, embodiments of the present disclosure can present evaluation information to allow users to quickly determine whether their input of the target response is correct, thereby improving the efficiency of information transmission.

[0151] In some embodiments, process 300 further includes: in response to evaluation information indicating that the target response and the reference response are inconsistent, presenting a viewing entry; and in response to receiving a selection of the viewing entry, presenting parsed content associated with the question, the parsed content being generated based on the target response and the reference response.

[0152] In this way, embodiments of this disclosure can quickly present parsed information in the event of an incorrect answer, effectively improving the efficiency of information transmission.

[0153] Example devices and equipment

[0154] Embodiments of this disclosure also provide corresponding apparatus for implementing the above methods or processes. Figure 4 A schematic structural block diagram of a device 400 for interface interaction according to certain embodiments of the present disclosure is shown. The device 400 may be implemented as or included in the electronic device 110 discussed above. The various modules / components in the device 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0155] like Figure 4 As shown, the device 400 includes a first presentation module 410 configured to present a viewing interface of a content stream; a second presentation module 420 configured to present interactive content items in the viewing interface, the interactive content items including a question and at least one interactive control for answering the question, the question being generated based on reference media content in the content stream; and a providing module 430 configured to provide evaluation information for the target answer in response to receiving a target answer for the question via at least one interactive control, the evaluation information being determined based on the reference media content.

[0156] In some embodiments, the referenced media content is determined based on the user's browsing history, which indicates the media content or media segments that the user has viewed in the content stream.

[0157] In some embodiments, at least one interactive control includes a plurality of selection controls with a plurality of candidates for a question, and the apparatus 400 further includes a receiving module configured to receive a trigger on at least one of the plurality of selection controls to determine a target response to the question.

[0158] In some embodiments, multiple candidates are generated by the model based on reference media content.

[0159] In some embodiments, at least one interactive control includes an input control, and the device 400 further includes an acquisition module configured to: acquire user input via the input control to determine a target response to a question, wherein the input includes at least one of the following: text content; voice content.

[0160] In some embodiments, the second presentation module 420 is further configured to: play reference media content in the viewing interface; and, in response to the playback state of the reference media content meeting the trigger condition, present interactive content items in the viewing interface, wherein the interactive content items are generated based on media segments that have been played in the reference media content.

[0161] In some embodiments, the playback status indicates at least one of the following: the duration for which the reference media content has been played; and whether the reference media content has been paused.

[0162] In some embodiments, the question and / or evaluation information is generated based on audio information from reference media content.

[0163] In some embodiments, the device 400 further includes a third presentation module configured to: in response to playing a content segment in reference media content that meets predetermined conditions, present knowledge information associated with the content segment in a viewing interface, the knowledge information being associated with interactive content items.

[0164] In some embodiments, the device 400 further includes a fourth presentation module configured to: be associated with an interactive content item and present prompt information in a viewing interface that is related to the reference media content, the prompt information being used to instruct the user to answer questions based on the reference media content.

[0165] In some embodiments, the device 400 further includes a fifth presentation module configured to present reference media content in response to the triggering of a prompt message.

[0166] In some embodiments, the interactive content item is a first interactive content item, and the device 400 further includes a sixth presentation module configured to: present a second interactive content item in a viewing interface; or present additional media content in a content stream in a viewing interface, the additional media content being different from the reference media content.

[0167] In some embodiments, the question is generated based on the following process: determining text content corresponding to audio information of reference media content; and providing the text content to the model to generate a question corresponding to the reference question type.

[0168] In some embodiments, the reference question types include one of the following: a first type, associated with understanding a first segment of the text content; a second type, associated with reading a second segment of the text content; a third type, associated with applying a reference expression in the text content; and a fourth type, associated with filling in a third segment of the text content.

[0169] In some embodiments, the evaluation information indicates whether the target response is consistent with the reference response to the question.

[0170] In some embodiments, the apparatus 400 further includes a sixth presentation module configured to present a viewing entry in response to an evaluation message indicating that the target response and the reference response are inconsistent; and a seventh presentation module configured to present parsed content associated with the question in response to receiving a selection of the viewing entry, the parsed content being generated based on the target response and the reference response.

[0171] The units included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units may be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 may be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chips (SoCs), complex programmable logic devices (CPLDs), and so on.

[0172] Figure 5 A block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 5 The electronic device 500 shown can be used to achieve Figure 1 The electronic device 110 shown.

[0173] like Figure 5As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processors 510 or processing units, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0174] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be a removable or non-removable medium and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data (e.g., training data for training) and can be accessed within electronic device 500.

[0175] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0176] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0177] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0178] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0179] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0180] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0181] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0182] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0183] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A user interface interaction method, comprising: Presents a view interface for the content stream; The viewing interface presents interactive content items, which include a question and at least one interactive control for answering the question, the question being generated based on reference media content in the content stream; as well as In response to receiving a target response to the question via the at least one interactive control, evaluation information is provided for the target response, the evaluation information being determined based on the reference media content.

2. The method according to claim 1, wherein the reference media content is determined based on the user's browsing history information, the browsing history information indicating media content or media segments that the user has viewed in the content stream.

3. The method of claim 1, wherein the at least one interactive control comprises a plurality of selection controls for a plurality of candidate options for the question, the method further comprising: Receive a trigger on at least one of the plurality of selection controls to determine the target response to the question.

4. The method of claim 3, wherein the plurality of candidates are generated by the model based on the reference media content.

5. The method according to claim 1, wherein the at least one interactive control includes an input control, and the method further includes: The user's input is obtained via the input control to determine the target response to the question, wherein the input includes at least one of the following: text content; voice content.

6. The method according to claim 1, wherein presenting interactive content items in the viewing interface includes: Play the reference media content in the viewing interface; as well as In response to the playback status of the reference media content meeting the trigger condition, the interactive content item is presented in the viewing interface. The interactive content item is generated based on the media segment that has been played in the reference media content.

7. The method of claim 6, wherein the playback state indicates at least one of the following: The duration for which the reference media content has been played; Whether the reference media content is paused during playback.

8. The method of claim 1, wherein the problem and / or the evaluation information is generated based on the audio information of the reference media content.

9. The method according to claim 1, wherein before presenting interactive content items in the viewing interface, the method further comprises: In response to a content segment in the reference media content that meets predetermined conditions being played, knowledge information associated with the content segment is presented in the viewing interface, and the knowledge information is associated with the interactive content item.

10. The method according to claim 1, further comprising: Associated with the interactive content item, a prompt message related to the reference media content is presented in the viewing interface, the prompt message being used to instruct on answering the question based on the reference media content.

11. The method of claim 10, further comprising: In response to the triggering of the prompt message, the reference media content is presented.

12. The method of claim 1, wherein the interactive content item is a first interactive content item, and after providing evaluation information for the response to the target, the method further comprises: The second interactive content item is presented in the viewing interface; or Additional media content from the content stream is presented in the viewing interface; this additional media content is different from the reference media content.

13. The method of claim 1, wherein the problem is generated based on the following process: Determine the text content corresponding to the audio information of the reference media content; and The text content is provided to the model to generate the question corresponding to the reference question type.

14. The method of claim 13, wherein the reference problem type includes one of the following: The first type is associated with understanding the first segment of the text content; The second type is associated with the second segment of the text being read aloud; The third type is associated with reference expressions in the text content of the application; The fourth type is associated with the third segment in the text content.

15. The method of claim 1, wherein the evaluation information indicates whether the target response is consistent with the reference response corresponding to the question.

16. The method of claim 15, further comprising: In response to the evaluation information indicating that the target response is inconsistent with the reference response, a viewing entry is presented; In response to receiving a selection of the viewing entry, parsed content associated with the question is presented, which is generated based on the target answer and the reference answer.

17. A device for interface interaction, comprising: The first presentation module is configured to present the view interface of the content stream; The second presentation module is configured to present interactive content items in the viewing interface, the interactive content items including a question and at least one interactive control for answering the question, the question being generated based on reference media content in the content stream; as well as A module is configured to provide evaluation information for the target response to a target response received via the at least one interactive control, the evaluation information being determined based on the reference media content.

18. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processor.

19. A computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, implement the method according to any one of claims 1 to 16.

20. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 16.

Images