Interaction method and device, equipment and storage medium

Abstract

According to the embodiment of the invention, an interaction method and device, equipment and a storage medium are provided. The method comprises the following steps: presenting a first viewing interface of first media content; presenting a first text in a first region of the first viewing interface, the first text being determined based on a first audio associated with a first segment of the first media content; in response to receiving a switching operation associated with the first region, presenting a second text in the first region, the second text being generated based on an associated second audio of a second segment of the first media content; and switching the second area of the first viewing interface to present a picture associated with the second segment. Therefore, according to the embodiment of the invention, the text determined based on the audio of each media segment can be presented, so that the visual information and the auditory information are transmitted, and the information transmission rate is improved. In addition, the method and the device can support the switching of texts and pictures corresponding to different media segments in the same viewing interface, so that the interaction efficiency is improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to interactive methods, apparatuses, devices, and computer-readable storage media. Background Art

[0002] With the development of computer technology, various electronic devices can greatly enrich people's daily lives. For example, people can use electronic devices to carry out various interactions. How to improve the efficiency of interaction is a key issue. Summary of the Invention

[0003] In a first aspect of the present disclosure, an interaction method is provided. The method includes: presenting a first viewing interface of first media content; presenting first text in a first area of ​​the first viewing interface, the first text determined based on first audio associated with a first segment of the first media content; in response to receiving a switch operation associated with the first area, presenting second text in the first area, the second text generated based on second audio associated with a second segment of the first media content; and switching the second area of ​​the first viewing interface to present a screen associated with the second segment.

[0004] In a second aspect of the present disclosure, a device for interaction is provided. The device includes: a first presentation module configured to present a first viewing interface of first media content; a second presentation module configured to present first text in a first area of ​​the first viewing interface, the first text being determined based on a first audio associated with a first segment of the first media content; a third presentation module configured to present second text in the first area in response to receiving a switching operation associated with the first area, the second text being generated based on a second audio associated with a second segment of the first media content; and a switching module configured to switch the second area of ​​the first viewing interface to present a screen associated with the second segment.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein computer-executable instructions are stored on the computer-readable storage medium, and the computer-executable instructions can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect of the present disclosure, a computer program product is provided, which includes computer-executable instructions, which, when executed by a processor, implement the method according to the first aspect of the present disclosure.

[0008] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] Figure 1 A schematic diagram illustrating an example environment in which embodiments of the present disclosure can be implemented;

[0011] Figures 2A to 2I shows an example interface diagram according to some embodiments of the present disclosure;

[0012] Figure 3 A flowchart illustrating an interaction process according to some embodiments of the present disclosure is shown;

[0013] Figure 4 shows a schematic structural block diagram of an apparatus for interaction according to certain embodiments of the present disclosure;

[0014] Figure 5 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0015] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0016] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0017] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0018] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects shall comply with the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms them. Accordingly, when implementing the various embodiments of the present disclosure, the types, scope of use, and usage scenarios of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method may vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0019] If this specification and the solutions in the examples involve the processing of personal information, such processing will be done only with a legitimate basis (such as with the consent of the subject of personal information or as necessary for the performance of a contract) and only within the prescribed or agreed scope. A user's refusal to process personal information other than that required for basic functions will not affect the user's use of basic functions.

[0020] Traditional, existing language learning software generally interacts with users based on preset learning materials.

[0021] The embodiments of the present disclosure provide an interactive solution. According to the solution, a first viewing interface of first media content is presented; first text is presented in a first area of ​​the first viewing interface, the first text being generated by translating second text associated with a first segment of the first media content; in response to receiving a switch operation associated with the first area, third text is presented in the first area, the third text being generated by translating fourth text associated with a second segment of the first media content; and the second area of ​​the first viewing interface is switched to present a screen associated with the second segment.

[0022] Based on this approach, embodiments of the present disclosure can present text determined based on the audio of each media segment, enabling both visual and auditory information to be transmitted, effectively increasing the speed of information transmission. Furthermore, the present disclosure can support rapid switching between text and images corresponding to different media segments within the same viewing interface, effectively improving interaction efficiency.

[0023] Sample Environment

[0024] Figure 1 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. Figure 1 As shown, example environment 100 may include electronic device 110 .

[0025] In the example environment 100, the electronic device 110 may run an application 120 that supports interface interaction. The application 120 may be any suitable type of application for interface interaction, and examples thereof may include but are not limited to video applications, game applications, social applications, or other suitable applications.

[0026] exist Figure 1 In the environment 100 , if the application 120 is in an active state, the application 120 may provide a presentation interactive interface 150 for the user 140 .

[0027] In some embodiments, the electronic device 110 communicates with the server 130 to enable the provision of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, etc., which has a display device, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (Personal Communication System, PCS) device, a personal navigation device, a personal digital assistant (Personal Digital Assistant, PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the target user (such as a "wearable" circuit, etc.).

[0028] The server 130 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. For example, the server 130 may include a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 may provide background services for the application 120 that supports interface interaction in the electronic device 110.

[0029] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired or wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0030] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0031] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0032] Example Process

[0033] An example interaction process according to an embodiment of the present disclosure will be described below with reference to the accompanying drawings.

[0034] Figures 2A to 2I 200A to 200I according to some embodiments of the present disclosure. Figure 1 The electronic device 110 is provided as shown.

[0035] In some embodiments, the electronic device 110 may present an interface 200A. This interface 200A may be a viewing interface for a content stream. The electronic device 110 may present multiple content items under a content stream in this viewing interface. In some embodiments, these content items may be content items published by users of an application, or may be content items pre-set in the application, which will not be described in detail here. In some embodiments, these content items may be any appropriate media content, such as video content, audio content, graphic content, image content, etc.

[0036] In some embodiments, a content stream is an information flow that presents multiple content items to the user in a linear or dynamic manner. As an example, the electronic device 110 may arrange the multiple content items according to predetermined rules (such as chronological order, recommendation algorithm, etc.) and present them to the user in a viewing interface. The user can switch between multiple content items in the content stream by performing content switching operations, such as swiping up and down.

[0037] like Figure 2A As shown, the electronic device can present video 201 (first media content) in a predetermined area (second area) of interface 200A (first viewing interface). This predetermined area can be any appropriate area, such as the center area of ​​interface 200A. In some embodiments, video 201 can include multiple segments, and these segments can be played in a predetermined order.

[0038] In some embodiments, the multiple segments may correspond to different scenes, that is, each scene corresponds to a segment. In other embodiments, the multiple segments may also correspond to different subtitle units, where a sentence in the subtitle may be a subtitle unit. In addition, such a subtitle unit may be, for example, the text corresponding to a segment. Figure 2A For example, electronic device 110 is playing the first segment of video 201. In this case, this first segment may correspond to subtitle unit 202. Such subtitle unit may be presented in the area corresponding to video 201, or such subtitle unit 202 may not be presented. Additionally or alternatively, this first segment may be any one of multiple segments in video 201, which will not be described in detail here.

[0039] In some embodiments, the electronic device may present a control 203 in the interface 200A to enable the user to select and view text corresponding to a segment in the content item.

[0040] As an example, when the electronic device responds to playing the first segment of the video 201 (the screen 201-1 associated with the first segment is presented in the interface 200A), and receives a selection (such as a click operation) of the control 203, it can present the following Figure 2B Interface 200B is shown. In some embodiments, the electronic device may present text 204 (first text) in a preset area in interface 200B. Such text 204 is determined based on the audio (first audio) corresponding to the first segment of video 201. As an example, the electronic device may use an audio recognition model to recognize the audio corresponding to the first segment as corresponding text, such as text 204.

[0041] by Figure 2BAs an example, this text 204 can be presented in the lower area 205 (first area) of the video 201. At this time, there is a partial overlapping area between the second area and the lower area 205. For example, the lower area 205 can be included in the second area. In some embodiments, this text 204 can be presented in the form of a card interface superimposed on the screen of the video 201.

[0042] In order to facilitate displaying the complete video 201, in some embodiments, the first area may be located outside the second area. As an example, in response to receiving a selection (such as a click operation) on the control 203 when playing the first segment of the video 201, the electronic device may present the following: Figure 2C Interface 200C is shown. The electronic device can present text 204 in the lower area 206 (first area) of interface 200C. This text 204 can also be presented in the form of a card in interface 200C.

[0043] Specifically, the electronic device can adjust the size and / or position of the video 201 to present the complete video 201 in the interface 200C. Figure 2C For example, compared to the position of video 201 in interface 200A, the position of video 201 in interface 200C is higher, and compared to the size of video 201 in interface 200A, the position of video 201 in interface 200C is smaller. Figure 2C As an example, the lower area 206 where the text 204 is presented does not overlap with the second area of ​​the screen where the video 201 is presented.

[0044] It should be noted that, in addition to presenting text 204 in response to receiving a selection of control 203, the electronic device can also present this text 204 by default when presenting this first viewing interface. At this time, this text 204 is generally the first segment at the front of the playback order of video 201.

[0045] It is understandable that the contents described below can be implemented regardless of whether the first area is the lower area 205 or the lower area 206. For ease of description, the following description will be made using the lower area 205 (or the first area 205) as an example.

[0046] In some embodiments, the electronic device may present the translated text corresponding to the first text in the first area 205 in response to triggering the translation control in the first area 205. Figure 2B As an example, the electronic device may present a translation control 207 (a first control) in the first area 205. Additionally or alternatively, the translation control 207 may also be presented at any appropriate location in the interface 200B.

[0047] Furthermore, the electronic device may respond to receiving a selection of the translation control 207 (eg, the user may click on the translation control 207) by presenting the following Figure 2D Interface 200D is shown. The electronic device can present text 208 (translated text) in interface 200D. This text 208 can be associated with text 204 and presented in interface 200D, for example, below text 204.

[0048] In some embodiments, text 208 can be generated based on text 204 and context information associated with text 204, and context information is determined based on the first media content. As an example, text 208 can be generated by translating text 204 associated with the first segment of video 201, that is, text 204 and text 208 can correspond to different languages, such as text 204 is English, and text 208 obtained by translating text 204 can be Chinese. It is understandable that the two texts correspond to the same meaning and correspond to different language types. This disclosure is not intended to limit the language types of text 204 and text 208.

[0049] In some embodiments, the text 204 may be recognized based on a predetermined model. The predetermined model may be any appropriate machine learning model, such as a language model, which may be configured to recognize text corresponding to each segment in the first media content. The text may be a sentence in a dialogue or narration in a video (e.g., a user's speech in the video), or a subtitle unit in a subtitle pre-set for the media content.

[0050] In some embodiments, the electronic device presents second text in the first area in response to receiving a switch operation associated with the first area, where the second text is generated based on second audio associated with the second segment of the first media content.

[0051] Continue to refer Figure 2D and Figure 2E In response to receiving a switching operation (such as left swipe or right swipe) for the first area 205, the electronic device may present the following Figure 2E In the illustrated interface 200E, the electronic device may present text 211 in the first area 205 of the interface 200E, where the text 211 is generated based on the second audio associated with the second segment of the first media content. Additionally or alternatively, a translation text 212 corresponding to the text 211 may also be presented in the second area 205.

[0052] Furthermore, in some embodiments, the electronic device switches the second area of ​​the first viewing interface to present a screen associated with the second segment. Figure 2D and Figure 2E For example, in response to receiving a switching operation on the first area 205 , the electronic device may switch the second area of ​​the first viewing interface (displaying the screen 201 - 1 associated with the first segment) to presenting the screen 201 - 2 associated with the second segment.

[0053] In some embodiments, the electronic device 110 may determine a playback rate via the second control in the first area 205 , and may play the first segment of the first media content at the playback rate.

[0054] Specifically, continue to refer to Figure 2D and Figure 2F , the electronic device may present a selection control 209 corresponding to the play rate in the interface 200D. Further, the electronic device may present a selection control 209 corresponding to the play rate in response to receiving a selection of the selection control 209. Figure 2F Interface 200F is shown.

[0055] In some embodiments, the electronic device may present selection controls corresponding to the playback rate, such as controls 211-1 and 211-2, in interface 200F. Further, in response to receiving a selection of control 211-1, the electronic device may set half of the original playback rate as the final audio playback rate.

[0056] Back to Figure 2D , the electronic device may also present a repeat play selection control 210 in the interface 200D. Further, the electronic device may present a repeat play selection control 210 in response to receiving a selection of the selection control 210. Figure 2G The electronic device can repeatedly play the audio clip corresponding to the text 204, for example, the first clip. In this case, the audio clip corresponding to the text 204 is always presented in the interface 200G during the repeated playback process, that is, the screen 201-1 associated with the first clip is always presented.

[0057] by Figure 2H As an example, each text segment in the text 204 presented by the electronic device in the interface 200H may be set to a selectable state.

[0058] As an example, the electronic device may present the following in response to receiving a selection of the English word “took” (first content item) in the text 204 (first text): Figure 2HThe interactive window 212 shown. The electronic device can present the English word "took" in the interactive window 212, and can also present information such as the translation corresponding to the English word "took" (first knowledge information), for example, "took a ride" and information associated with taking a ride. Such first knowledge information can indicate a second content item (such as "took a ride") associated with a first language (such as Chinese), and a third content item associated with a second language (such as English). Such a second content item (such as "took a ride") is determined based on a first content item (such as "took"), and the third content item is used to explain the second content item.

[0059] It should be noted that the translation corresponding to the English word "took" is determined based on "took a ride" in text 208 and the context text corresponding to "took a ride" in text 208.

[0060] As another example, the electronic device can determine whether the text 204 includes a word combination associated with a target phrase in response to the selected English word corresponding to a fixed English phrase (word combination). For example, if the selected English word is "give" (first content item), and "give" corresponds to the English phrase "give up" (target word), then the electronic device can determine whether the text 204 includes the phrase "give up". Specifically, it can determine whether the word following "give" in text 204 is "up".

[0061] Furthermore, the electronic device can present "give up" in the interactive window 212 in response to whether the text 204 includes the phrase "give up".

[0062] In some embodiments, the electronic device can present a control 213 in the interactive window 212. Furthermore, the electronic device can add the English word "took" and its corresponding translation (took a ride) to the word book (knowledge set) in response to receiving a selection of the control 213.

[0063] For Figure 2G As an example, the electronic device can present an interface 200I as shown in Figure 2I response to receiving a selection operation on the control 214. This interface 2C0I can be a viewing interface (second viewing interface) corresponding to the word book (knowledge set). The electronic device can present a set of knowledge description items in the interface 200I, such as knowledge description item 230, knowledge description item 231, knowledge description item 232, knowledge description item 233 (target description item), and this target description item is the description item corresponding to the English word "took" and its corresponding translation (took a ride), etc.

[0064] In some embodiments, different knowledge points may indicate different English words, or different knowledge points may indicate the same English word, but different knowledge points indicating the same English word may indicate different Chinese translations.

[0065] Specifically, knowledge description item 230 can be the knowledge description item corresponding to the English word "appear" and the corresponding translation of the English word "appear" (appear), knowledge description item 231 can be the knowledge description item corresponding to the English word "appear" and the corresponding translation of the English word "appear" (seem), knowledge description item 232 can be the knowledge description item corresponding to the English word "learn" and the corresponding translation of the English word "learn" (learn, understand), and so on.

[0066] by Figure 2I As an example, the electronic device may present a viewing entry for media content associated with each description item in the interface 200I.

[0067] Continue to refer Figure 2I In the knowledge description item 233, the electronic device may present a viewing entry 240 associated with the video 201. Furthermore, the electronic device may present a viewing interface of the video 201 in response to receiving a trigger on the viewing entry 240 (eg, clicking the viewing entry 240).

[0068] In some embodiments, the electronic device may present a viewing interface of the first segment of the video 201 in response to receiving a trigger on the viewing entrance 240 (such as clicking the viewing entrance 240 ).

[0069] In order to highlight the relevance between the video 201 and the target knowledge description item and improve the efficiency of information transmission, Figure 2I As an example, the electronic device may present the following at the viewing portal 240: Figure 2I The second image associated with the first segment of the video 201 shown, or the cover image associated with the video 201 or the preset preview image corresponding to the video 201 (the first image) is presented in the viewing entrance 240. Figure 2I Not shown in the figure.

[0070] by Figure 2I As shown, taking the selected first content item as "learn" and the first knowledge information as "learning" as an example, the electronic device can respond to the first knowledge information and the second knowledge information "understand" in the knowledge set having a matching degree greater than a threshold, and can provide a second viewing entry associated with the second media content in the knowledge description item 232, where the second knowledge information is associated with the second media content.

[0071] In response to at least two knowledge points indicating the same English word "appear", in which the English word indicated corresponds to at least two Chinese translations and the semantic similarity of the two Chinese translations is less than or equal to a threshold, the electronic device can independently present the two knowledge points in the interface 200I.

[0072] In this way, embodiments of the present disclosure can present text based on the audio of each media segment, enabling both visual and auditory information to be transmitted, effectively increasing the rate of information transfer. Furthermore, the present disclosure can support rapid switching between text and images corresponding to different media segments within the same viewing interface, effectively improving interaction efficiency.

[0073] Example Process

[0074] Figure 3 FIG. 3 is a flow chart showing an interactive process 300 according to some embodiments of the present disclosure. The process 300 may be implemented at the electronic device 110. Figure 1 Process 300 is described.

[0075] In block 310 , the electronic device 110 presents a first viewing interface of first media content.

[0076] At block 320 , the electronic device 110 presents first text in a first area of ​​the first viewing interface, the first text being determined based on first audio associated with a first segment of the first media content.

[0077] At block 330 , the electronic device 110 presents second text in the first region in response to receiving the switch operation associated with the first region, the second text being generated based on second audio associated with the second segment of the first media content.

[0078] In block 340 , the electronic device 110 switches the second area of ​​the first viewing interface to present a screen associated with the second segment.

[0079] Based on this approach, embodiments of the present disclosure can present text determined based on the audio of each media segment, enabling both visual and auditory information to be transmitted, effectively increasing the speed of information transmission. Furthermore, the present disclosure can support rapid switching between text and images corresponding to different media segments within the same viewing interface, effectively improving interaction efficiency.

[0080] In some embodiments, before receiving the switching operation associated with the first region, process 300 further includes: in response to triggering the first control in the first region, presenting a translated text of the first text in the first region.

[0081] In this way, the embodiment of the present disclosure can ensure that while the original text is presented for viewing in the interface, the translated text of the original text can be quickly obtained by triggering the control, effectively improving the efficiency of interaction and the efficiency of information transmission.

[0082] In some embodiments, the translated text is generated based on the first text and context information associated with the first text, where the context information is determined based on the first media content.

[0083] In this way, the embodiments of the present disclosure can consider the context information associated with the first text during translation, which helps to better understand the semantics of the first text during the translation process and improves the accuracy of the translation.

[0084] In some embodiments, process 300 further includes: in response to receiving a selection of the first content item in the first text, presenting an interactive window; and presenting first knowledge information associated with the first content item in the interactive window.

[0085] In this way, the embodiment of the present disclosure can respond to the selection of the first content item in the first text, and the knowledge information provided through the interactive window can help the user to have a deeper understanding of the relevant knowledge of the first content item in the first text, thereby improving the efficiency of information transmission.

[0086] In some embodiments, the first knowledge information indicates: a second content item associated with the first language, the second content item being determined based on the first content item; and a third content item associated with the second language, the third content item being used to explain the second content item.

[0087] In this way, the first knowledge information of the embodiment of the present disclosure not only includes content related to the first language, but can also be extended to interpretations in the second language, effectively improving the efficiency of information transmission.

[0088] In some embodiments, process 300 further includes: in response to the first content item corresponding to the target word, determining whether the first text includes a word combination associated with the target word; and in response to the first text including the word combination, determining the word combination as the second content item.

[0089] In this way, the embodiment of the present disclosure can ensure that when the first content item corresponds to a target word, it can identify and provide extended information related to the target word, thereby improving both the efficiency and accuracy of information transmission.

[0090] In some embodiments, process 300 further includes: in response to receiving an add operation on the first knowledge information, adding the first knowledge information to a knowledge set associated with the current user.

[0091] In this way, the embodiment of the present disclosure can add the first knowledge information to the knowledge set, which helps to manage the knowledge information.

[0092] In some embodiments, process 300 further includes: in response to receiving a viewing operation on the knowledge set, presenting a second viewing interface of the knowledge set; presenting a group of knowledge description items in the second viewing interface, the group of knowledge description items including target knowledge description items corresponding to the first knowledge information.

[0093] In this way, the embodiment of the present disclosure can present a set of knowledge description items in the second viewing interface to ensure that users can quickly view the knowledge information they have added, which not only improves the efficiency of using the knowledge set, but also improves the efficiency of information transmission.

[0094] In some embodiments, the process 300 further includes: presenting a first viewing entry associated with the first media content in the target knowledge description item; and presenting a first viewing interface of the first media content in response to triggering the first viewing entry.

[0095] In this way, the embodiment of the present disclosure can realize the interactive function of returning from a knowledge set to the original media content, so as to quickly return from the knowledge set to the relevant media content, improve the coherence of the interaction, and improve the efficiency of the interaction.

[0096] In some embodiments, the process 300 further includes: in response to triggering the first viewing portal, playing a first segment associated with the first knowledge information in the first viewing interface.

[0097] In this way, the embodiment of the present disclosure can present the first segment associated with the first knowledge information in response to a trigger operation, so that the context of the knowledge description item can be quickly located, thereby improving the efficiency of the interaction.

[0098] In some embodiments, the first viewing portal presents a first image associated with the first media content or a second image associated with the first segment.

[0099] In this way, the embodiment of the present disclosure can display an image associated with the first media content or the first segment at the viewing entrance, so that the user can more intuitively identify and recall the relevant media content, and this intuitive presentation method can improve access efficiency.

[0100] In some embodiments, process 300 further includes: in response to a matching degree between the first knowledge information and the second knowledge information in the knowledge set being greater than a threshold, presenting a second viewing entry associated with the second media content in the target knowledge description item, wherein the second knowledge information is associated with the second media content.

[0101] In this way, the disclosed embodiment can ensure that when the matching degree between the first knowledge information and the second knowledge information exceeds a threshold, the second media content associated with the second knowledge information is recommended to better demonstrate the relationship between the various knowledge information and improve the efficiency of information transmission.

[0102] In some embodiments, process 300 further includes: determining, via a second control in the first area, a playback rate; and playing the first segment of the first media content at the playback rate.

[0103] In this way, the embodiment of the present disclosure can adjust the playback rate of the first segment via the second control, thereby improving the efficiency of the interaction.

[0104] In some embodiments, process 300 further includes: in response to triggering a third control in the first area, repeatedly playing the first segment of the first media content.

[0105] In this way, the embodiment of the present disclosure can repeatedly play the first segment via the third control, thereby improving the effectiveness of information transmission.

[0106] In some embodiments, the first area is located outside the second area; or the first area is included in the second area, so that the first text is displayed superimposed on the screen of the first media content.

[0107] In this way, the embodiment of the present disclosure can flexibly set the layout of the first text and the first media content, which helps the user understand the relevance between the first text and the first media content and improves the efficiency of information transmission.

[0108] Example devices and equipment

[0109] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 4 : A schematic structural block diagram of an apparatus 400 for interaction according to certain embodiments of the present disclosure is shown. The apparatus 400 may be implemented as or included in the electronic device 110 discussed above. Each module / component in the apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0110] like Figure 4As shown, the device 400 includes a first presentation module 410, which is configured to present a first viewing interface of the first media content; a second presentation module 420, which is configured to present a first text in a first area of ​​the first viewing interface, the first text being determined based on a first audio associated with a first segment of the first media content; a third presentation module 430, which is configured to present a second text in the first area in response to receiving a switching operation associated with the first area, the second text being generated based on a second audio associated with a second segment of the first media content; and a switching module 440, which is configured to switch the second area of ​​the first viewing interface to present a screen associated with the second segment.

[0111] In some embodiments, before receiving the switching operation associated with the first area, the apparatus 400 further includes a fourth presentation module configured to present a translation of the first text in the first area in response to triggering the first control in the first area.

[0112] In some embodiments, the translated text is generated based on the first text and context information associated with the first text, where the context information is determined based on the first media content.

[0113] In some embodiments, the apparatus 400 further includes a fifth presentation module configured to present an interactive window in response to receiving a selection of the first content item in the first text; and present first knowledge information associated with the first content item in the interactive window.

[0114] In some embodiments, the first knowledge information indicates: a second content item associated with the first language, the second content item being determined based on the first content item; and a third content item associated with the second language, the third content item being used to explain the second content item.

[0115] In some embodiments, the device 400 also includes a determination module configured to determine whether the first text includes a word combination associated with the target word in response to the first content item corresponding to the target word; and determine the word combination as the second content item in response to the first text including the word combination.

[0116] In some embodiments, the apparatus 400 further includes an adding module configured to add the first knowledge information to a knowledge set associated with the current user in response to receiving an adding operation on the first knowledge information.

[0117] In some embodiments, the device 400 also includes a sixth presentation module, which is configured to present a second viewing interface of the knowledge set in response to receiving a viewing operation on the knowledge set; and present a group of knowledge description items in the second viewing interface, the group of knowledge description items including target knowledge description items corresponding to the first knowledge information.

[0118] In some embodiments, the device 400 also includes a seventh presentation module, which is configured to present a first viewing entry associated with the first media content in the target knowledge description item; and present a first viewing interface of the first media content in response to triggering the first viewing entry.

[0119] In some embodiments, the apparatus 400 further includes a playing module configured to play a first segment associated with the first knowledge information in the first viewing interface in response to triggering the first viewing portal.

[0120] In some embodiments, the first viewing portal presents a first image associated with the first media content or a second image associated with the first segment.

[0121] In some embodiments, the device 400 also includes an eighth presentation module, which is configured to present a second viewing entry associated with the second media content in the target knowledge description item in response to the degree of match between the first knowledge information and the second knowledge information in the knowledge set being greater than a threshold, and the second knowledge information is associated with the second media content.

[0122] In some embodiments, the apparatus 400 further includes a first processing module configured to determine a playback rate via a second control in the first area; and play the first segment of the first media content at the playback rate.

[0123] In some embodiments, the apparatus 400 further includes a second processing module configured to repeatedly play the first segment of the first media content in response to triggering the third control in the first area.

[0124] In some embodiments, the first area is located outside the second area; or the first area is included in the second area, so that the first text is displayed superimposed on the screen of the first media content.

[0125] The units included in the device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in the device 400 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0126] Figure 51 shows a block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 5 The illustrated electronic device 500 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 5 The electronic device 500 shown can be used to implement Figure 1 An electronic device 110 is shown.

[0127] like Figure 5 As shown, electronic device 500 is in the form of a general electronic device. Components of electronic device 500 may include, but are not limited to, one or more processors 510 or processing units, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device 500.

[0128] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and can be accessed within the electronic device 500.

[0129] The electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 5 As shown in FIG, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. Memory 520 may include a computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0130] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 500 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0131] Input device 550 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 560 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 500 may also communicate with one or more external devices (not shown) via communication unit 540 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with electronic device 500, or with any device that allows electronic device 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0132] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0133] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0134] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0135] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0136] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0137] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method of interaction, comprising: Presenting a first viewing interface of first media content; presenting first text in a first area of ​​the first viewing interface, the first text being determined based on first audio associated with a first segment of the first media content; In response to receiving a switch operation associated with the first region, presenting second text in the first region, the second text generated based on second audio associated with a second segment of the first media content; as well as The second area of ​​the first viewing interface is switched to present a screen associated with the second segment.

2. The method according to claim 1, wherein before receiving the handover operation associated with the first area, the method further comprises: In response to triggering a first control in the first area, a translated text of the first text is presented in the first area. 3 . The method of claim 2 , wherein the translated text is generated based on the first text and context information associated with the first text, the context information being determined based on the first media content.

4. The method according to claim 1, further comprising: In response to receiving a selection of a first content item in the first text, presenting an interactive window; as well as First knowledge information associated with the first content item is presented in the interactive window.

5. The method according to claim 4, wherein the first knowledge information indicates: a second content item associated with the first language, the second content item being determined based on the first content item; and A third content item associated with a second language, the third content item being used to interpret the second content item.

6. The method according to claim 5, further comprising: In response to the first content item corresponding to a target word, determining whether the first text includes a word combination associated with the target word; as well as In response to the first text including the word combination, the word combination is determined as the second content item.

7. The method according to claim 4, further comprising: In response to receiving an adding operation on the first knowledge information, the first knowledge information is added to a knowledge set associated with the current user.

8. The method according to claim 7, further comprising: In response to receiving a viewing operation on the knowledge set, presenting a second viewing interface of the knowledge set; A group of knowledge description items is presented in the second viewing interface, where the group of knowledge description items includes a target knowledge description item corresponding to the first knowledge information.

9. The method according to claim 8, further comprising: In the target knowledge description item, presenting a first viewing entry associated with the first media content; as well as In response to triggering the first viewing entry, the first viewing interface of the first media content is presented.

10. The method according to claim 9, further comprising: In response to the triggering of the first viewing entrance, the first segment associated with the first knowledge information is played in the first viewing interface. 11 . The method of claim 9 , wherein the first viewing portal presents a first image associated with the first media content or a second image associated with the first segment.

12. The method according to claim 9, further comprising: In response to a matching degree between the first knowledge information and second knowledge information in the knowledge set being greater than a threshold, a second viewing entry associated with second media content is presented in the target knowledge description item, wherein the second knowledge information is associated with the second media content.

13. The method according to claim 1, further comprising: determining a playback rate via a second control in the first area; as well as The first segment of the first media content is played at the playback rate.

14. The method according to claim 1, further comprising: In response to triggering of a third control in the first area, the first segment of the first media content is repeatedly played.

15. The method of claim 1, wherein: The first area is outside the second area; or The first area is included in the second area, so that the first text is displayed in an overlaid manner on the screen of the first media content.

16. An apparatus for interaction, comprising: A first presentation module is configured to present a first viewing interface of the first media content; a second presentation module configured to present a first text in a first area of ​​the first viewing interface, the first text being determined based on a first audio associated with a first segment of the first media content; a third presentation module configured to present, in response to receiving a switch operation associated with the first region, a second text in the first region, the second text being generated based on a second audio associated with a second segment of the first media content; as well as The switching module is configured to switch the second area of ​​the first viewing interface to present a picture associated with the second segment.

17. An electronic device comprising: at least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 15 when executed by the at least one processor.

18. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are capable of implementing the method according to any one of claims 1 to 15 when executed by a processor.

19. A computer program product comprising computer executable instructions, wherein the computer executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 15.

Images