Webpage-based interaction method, electronic device, storage medium, and product

Abstract

The present invention relates to a webpage-based interaction method, an electronic device, a storage medium, and a product. The webpage-based interaction method comprises: on the basis of a requested webpage, determining an interaction mode; in response to the interaction mode being a first mode, processing at least part of content in the webpage, and displaying the processed content in the webpage; and in response to the interaction mode being a second mode, displaying the webpage, and on the basis of content of the webpage, recommending a tool matching the webpage to a user.

Description

Web-based interactive methods, electronic devices, storage media, and products Technical Field

[0001] This disclosure relates, and particularly relates to, a web-based interactive method, electronic device, storage medium, and product. Background Technology

[0002] In related technologies, users can enter a URL to access the webpage they want. Alternatively, users can use a search engine to search for webpages corresponding to keywords, and then open and browse the target webpage from the search results. Summary of the Invention

[0003] According to some embodiments of this disclosure, a webpage-based interaction method is provided, comprising: determining an interaction mode based on a requested webpage; in response to the interaction mode being a first mode, processing at least a portion of the content in the webpage and displaying the processed content in the webpage; and in response to the interaction mode being a second mode, displaying the webpage and recommending tools matching the webpage to the user based on the content of the webpage.

[0004] According to some embodiments of the present disclosure, an electronic device is provided, including: a memory; and a processor coupled to the memory, the processor being configured to execute a web-based interactive method of any embodiment of the present disclosure based on instructions stored in the memory.

[0005] According to some embodiments of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, performs a web-based interactive method according to any embodiment of the present disclosure.

[0006] According to some embodiments of the present disclosure, a computer program product is provided that, when run on a computer, enables the computer to implement the web-based interactive method of any embodiment described in the present disclosure.

[0007] According to some embodiments of the present disclosure, a computer program is provided, comprising: instructions that, when executed by a processor, cause the processor to perform a web-based interactive method according to any embodiment of the present disclosure.

[0008] Other features, aspects, and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0009] Embodiments of this disclosure are described below with reference to the accompanying drawings. It should be understood that the drawings described below are merely illustrative of some embodiments of this disclosure and are not intended to limit the scope of this disclosure. In the drawings:

[0010] Figure 1 shows a schematic flowchart of a web-based interactive method according to some embodiments of the present disclosure.

[0011] Figure 2 shows a flowchart illustrating a method for determining an interaction mode according to some embodiments of the present disclosure.

[0012] Figure 3 shows a schematic diagram of the original interface of a requested webpage according to some embodiments of the present disclosure.

[0013] Figure 4 shows a schematic diagram of a webpage interface in a first mode according to some embodiments of the present disclosure.

[0014] Figure 5 shows a schematic diagram of the interface of a webpage in a first mode according to some other embodiments of the present disclosure.

[0015] Figure 6 shows a schematic diagram of the original interface of a requested webpage according to some embodiments of the present disclosure.

[0016] Figure 7 shows a schematic diagram of a webpage interface in a second mode according to some embodiments of the present disclosure.

[0017] Figure 8 shows a schematic diagram of the webpage interface in a second mode according to some other embodiments of the present disclosure.

[0018] Figure 9 shows a schematic diagram of the structure of a web-based interactive device according to some embodiments of the present disclosure.

[0019] Figure 10 shows a block diagram of an electronic device according to some embodiments of the present disclosure.

[0020] Figure 11 shows a block diagram of an electronic device according to other embodiments of the present disclosure.

[0021] It should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not necessarily drawn to actual scale. The same or similar reference numerals are used in the various drawings to denote the same or similar parts. Therefore, once an item is defined in one drawing, it may not be discussed further in subsequent drawings. Detailed Implementation

[0022] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. It should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0023] It should be understood that the various steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of components and steps set forth in these embodiments should be interpreted as merely exemplary and do not limit the scope of this disclosure.

[0024] As used in this disclosure, the term "comprising" and its variations are open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to". The term "based on" means "at least partially based on".

[0025] It should be noted that the concepts of "first," "second," etc., used in this disclosure are used only to distinguish different devices, modules, or units, and are not intended to define the order of functions performed by these devices, modules, or units or their interdependencies. Unless otherwise specified, the concepts of "first," "second," etc., are not intended to imply that the objects described herein must be in a given temporal, spatial, rank, or any other given order.

[0026] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0027] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0028] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals shall be provided for users to choose to authorize or refuse.

[0029] The embodiments of this disclosure are described in detail below with reference to the accompanying drawings; however, this disclosure is not limited to these specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Furthermore, in one or more embodiments, specific features, structures, or characteristics can be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.

[0030] Some users may encounter problems while browsing the web. For example, they may not understand the content, or further questions may arise after browsing. In such cases, users need to browse other web pages for answers or use other tools for interpretation. Some problems cannot even be solved in one go through these methods. For instance, a user who doesn't understand English and wants to understand the content of a video in pure English without subtitles will need to use audio translation software that can read audio from electronic devices to understand the video content, without human assistance. In short, users may face some obstacles in obtaining information from web pages, resulting in lower information acquisition efficiency and a degraded user experience.

[0031] Web pages can contain various types of data. From a data type perspective, this includes text, audio, images, video, etc. From a content type perspective, it includes news, entertainment, sports, academic content, etc. From a language type perspective, it includes Chinese, English, French, and so on. These different data types lead to different types and degrees of obstacles for users in understanding the content.

[0032] Embodiments of this disclosure provide a webpage-based interaction method, electronic device, storage medium, and product that determines an interaction mode applied to a requested webpage. Based on the interaction mode, it can be determined whether to process at least a portion of the webpage and display it to the user, or to recommend tools to the user while displaying the original webpage.

[0033] Figure 1 illustrates a flowchart of a web-based interactive method according to some embodiments of the present disclosure. As shown in Figure 1, the interactive method of this embodiment includes steps S102 to S106. This embodiment can be executed by an electronic device, for example, by a browser on an electronic device. Alternatively, a server can determine the interaction mode and send it to a browser, which then determines the presentation method of the webpage based on the interaction mode.

[0034] In step S102, the interaction mode is determined based on the requested webpage.

[0035] The requested webpage refers to the webpage corresponding to the access request sent by the user. This webpage can be one that has already been displayed, or one whose data has been obtained by the electronic device after the request but has not yet been displayed.

[0036] Interaction modes can be varied, each corresponding to a different way of presenting a webpage to the user. Because different webpages have different types and characteristics, the appropriate interaction methods may not be entirely the same for different webpages. Regardless of the interaction mode, the goal is to help users consume webpage content more efficiently, that is, to improve the efficiency of information retrieval.

[0037] Interaction patterns can be based on artificial intelligence. For example, this could be a pattern that uses AI technology to process webpage content, or a pattern that recommends AI tools to users. Different webpages require varying degrees of AI intervention, thus allowing for the determination of corresponding interaction patterns for each webpage.

[0038] In step S104, in response to the interaction mode being the first mode, at least a portion of the content in the webpage is processed, and the processed content is displayed in the webpage.

[0039] The first mode can be considered as the mode that requires deep artificial intelligence to assist users in browsing web pages. For web pages with high comprehension costs for users, their interaction mode can be identified as the first mode.

[0040] In the first mode, at least some of the content on the webpage is modified to allow users to understand it more efficiently. Therefore, in the first mode, the webpage presented to the user differs from the original content of the webpage. That is, the requested webpage is displayed after being modified, and this modification includes processing at least some of the webpage's content.

[0041] In this way, web pages can be presented in a way that is easy for users to understand, greatly reducing the user's understanding cost.

[0042] In step S106, in response to the interaction mode being the second mode, the webpage is displayed, and tools matching the webpage are recommended to the user based on the content of the webpage.

[0043] The second mode can be considered as a mode that does not require deep AI assistance for users browsing web pages, but recommendation tools can further improve the efficiency of information acquisition for users. For web pages with low user comprehension costs, their interaction mode can be identified as the second mode.

[0044] In the second mode, the original content of the webpage is presented. Tools tailored to the webpage help users further understand the content without altering the original display. Recommended tools include those for processing the webpage content and displaying the results to the user; or generating new content based on the existing content.

[0045] Through the above embodiments, it is possible to determine the appropriate interaction mode based on a webpage. This allows for automatic determination of whether to process and display at least a portion of the webpage's content or to recommend tools based on the original webpage. Consequently, it enables more efficient and rational assistance to users in browsing webpages, improving their information retrieval efficiency.

[0046] Since a webpage may contain content from multiple modules or various types of content, embodiments of this disclosure can determine the interaction mode based on the target content in the webpage. Figure 2 shows a flowchart illustrating an interaction mode determination method according to some embodiments of this disclosure. As shown in Figure 2, the interaction mode determination method of this embodiment includes steps S202 to S206.

[0047] In step S202, it is determined whether the target content exists in the webpage and whether the target content matches the specified content processing method.

[0048] The target content can be of a specific type and needs to be processed using a specified content processing method. That is, content that users may have difficulty understanding and requires further processing through the first mode can be considered target content.

[0049] The target content may include content that needs translation, content that needs genre conversion, content that needs explanation, and so on. In other words, when such content exists, at least a portion of the webpage needs to be processed before the processed content is displayed.

[0050] In some embodiments, in response to the content processing method including translation, determining whether target content exists in a webpage includes: in response to the existence of content in a specified language in the webpage, identifying the content in the specified language as the target content. For example, if the specified language is language A, the content expressed in language A is identified as the target content. The content in the specified language includes at least one of text, images, audio, video, etc. Thus, the content in the webpage that needs to be translated can be accurately identified.

[0051] For content requiring translation, the processing method can be to generate a translation result of the target content. The translation result can be presented in various ways. Some translation processing methods are described below as examples. For instance, in response to the target content being text, at least one of the following can be generated: translated text or translated audio; in response to the target content being audio, at least one of the following can be generated: translated text or translated audio; in response to the target content being video, at least one of the following can be generated: subtitles or translated dubbing. The above examples support presenting the translation result in the same genre as the original target content to maintain visual consistency, and also support presenting it in different genres or multiple types of genres to enrich the user's information acquisition channels and further improve the efficiency of information acquisition.

[0052] When translating, traditional machine translation tools or AI-based translation models can be used. If genre conversion is involved, the text corresponding to the target content can be obtained first, and then a translated text can be generated based on the translation tool or model. If the translation result needs to be presented in a form other than text, then generative models can be used to generate images, audio, video, or other content based on the translated text.

[0053] In some embodiments, content processing includes genre conversion. Determining whether target content exists in a webpage includes: in response to the webpage including content in a first genre, determining whether the content in the first genre includes content adapted to a second genre; and in response to the content in the first genre including content adapted to the second genre, identifying the content in the first genre as the target content. That is, if content is presented in a first genre in the original webpage but is actually more suitable for presentation in a second genre, then it is determined that the content can be processed, i.e., it can be identified as target content. Different genres can be of the same data type or of different data types. For example, for text content, poetry and novels can be different genres. Similarly, for text and video content, which are different data types, text and video can also be different genres.

[0054] Processing at least a portion of the content on a webpage includes converting content in a first genre to content in a second genre. This genre conversion helps users understand the original content more quickly. Genre conversion can be implemented using a generative model, where the model's input and output belong to different genres. If the first and second genres are of different data types, the generative model can be a multimodal model, where the input and output belong to different modalities. By inputting the target content of the first genre into the model, the model outputs content in the second genre. This allows for the efficient generation of genre-converted content that matches the original content of the webpage.

[0055] The following are examples of two genre conversion processes.

[0056] One example is a text-based format where the first format is text, and the second format includes at least one of images or videos. If the text contains extensive descriptions of visual content, it can be considered to contain content that matches at least one of the images or videos—the target content. For example, if the text includes descriptions of clothing and makeup combinations, this content can be converted into images or videos. As needed, the text can be simplified and displayed alongside images or videos to generate graphic content. Thus, presenting lengthy, cumbersome, and unintuitive textual content in a visual way can more effectively convey information to users.

[0057] Another example is where the first genre is video, and the second genre includes at least one of images and text. For instance, some videos are quite long (e.g., exceeding a length threshold), requiring users a considerable amount of time to absorb all the information. In this case, genre conversion can be used to condense the video into images and text that can be described more concisely, thus helping users quickly understand the content and improving the efficiency of information retrieval.

[0058] In some embodiments, in response to the content processing method including the interpretation of content, determining whether target content exists in a webpage includes: in response to the webpage including content related to a specified domain, identifying the content related to the specified domain as target content. Content related to a specified domain can be content related to a specific professional field, such as technical terms, historical events, or knowledge points. Users may encounter difficulties in understanding this content; therefore, when processing such target content, an interpretation of the target content can be generated as the processing result. When identifying such target content, it can be determined using a specified thesaurus or terminology matching method, or by classifying the content to determine whether it relates to a specified domain.

[0059] When generating explanations, this can be achieved by searching dictionaries and encyclopedias (such as various encyclopedia tools), or by using artificial intelligence models. For example, content related to a specific domain can be input into a generative model to obtain the explanation output by the model.

[0060] Considering that some content may only contain a portion related to a specific domain, such as technical terms in an article while the rest is easily understood, the generated explanation can be integrated with other content. Specifically, in some embodiments, processing at least a portion of the webpage content includes: generating an explanation of the target content; and integrating non-target content with the generated explanation. For example, the target content in the webpage can be identified, an explanation of the target content can be generated, and then a generative model can be used to integrate this explanation with other content in the webpage besides the target content. Alternatively, the webpage content can be directly input into the generative model, instructing the model to regenerate the content and explaining the content related to the specified domain during the generation process. This allows for a smoother webpage presentation to the user, improving the browsing experience.

[0061] When determining target content, the amount of content matching the specified content processing method can also be considered. In some embodiments, content matching the specified content processing method is determined based on the webpage; the presence of target content in the webpage is determined based on the amount of content matching the specified content processing method. For example, based on the amount of matching content (e.g., length, word count, percentage of total content in the webpage), it is determined whether this matching content is the main content of the webpage; if it is the main content, the webpage is determined to contain target content. This allows for a more accurate assessment of the user's comprehension cost of the webpage content.

[0062] In step S204, in response to the existence of target content on the webpage, the interaction mode is determined to be the first mode.

[0063] In step S206, in response to the absence of target content on the webpage, the interaction mode is determined to be the second mode.

[0064] The above embodiments, by determining the target content that needs to be processed in a specified manner, and then determining the interaction mode based on the determination result, can accurately identify web pages with high user comprehension costs and perform corresponding processing. Thus, when the target content appears on a web page, it can quickly assist users in achieving a deeper understanding and perform in-depth processing of the web page content, improving the user's information acquisition efficiency.

[0065] In the second mode, tool recommendations to users can be based on the content of the webpage. For example, recommendations can be made based on the overall content or partial content of the webpage. When recommending based on overall content, this can be determined by identifying the type of the webpage. In some embodiments, when recommending based on partial content, the content of a specified data type within the webpage is determined; candidate tools for processing the specified data type are determined; and based on the understanding of the content of the specified data type, a tool matching the webpage is selected from the candidate tools. The specified data type in the webpage can be determined by identifying the tags of the content in the webpage's Document Object Model (DOM). For example, tags representing paragraphs, audio, images, and video can be used to determine the data type. Since some tools are only used to process specific types of data, determining candidate tools for processing the specified data type first can reduce the amount of data processed subsequently. When understanding the content of the specified data type, a natural language processing model can be used to identify the topic, key information, etc., within the content. Then, based on the attributes and descriptions of the candidate tools, a tool matching the understanding result is selected as the tool to match the webpage.

[0066] Besides the aforementioned methods of determining interaction patterns based on target content, interaction patterns can also be determined based on the type of webpage. In some embodiments, the type of webpage is determined based on the content or links of the requested webpage; the interaction pattern is determined based on the type of webpage and a pre-set correspondence, wherein the correspondence includes the correspondence between the type of webpage and the interaction pattern. When determining the interaction pattern based on content, some or all of the content in the webpage can be categorized, and the categorization can be based on dimensions such as data type, content type, and language type. This process can be implemented using classification models, natural language processing models, etc. Alternatively, links to webpages can be collected and marked in advance to determine the category of each linked webpage.

[0067] The above embodiments describe the strategies for determining the two interaction modes and the processing strategies under the two interaction modes. The following section further describes the interaction effects under the two interaction modes from the perspective of user interaction.

[0068] In the first mode, after processing the original content of the webpage, the webpage's presentation will differ from the original. Depending on the needs, the processed content can be displayed in the original layout of the webpage or in a new layout. In some embodiments, displaying the processed content on the webpage includes redrawing the webpage and displaying the processed content in the redrawn webpage. Redrawing refers to re-rendering the webpage based on the new layout and processed content, thereby enabling the redrawn webpage to adapt its layout to the processed content and improve the user browsing experience. The layout and style used in the redrawn webpage can be a simplification of the original webpage's layout and style, allowing users to focus on the processed core content.

[0069] When the interaction mode of the requested webpage is determined to be the first mode, the original webpage may or may not be displayed. Furthermore, after determining the interaction mode, the user may be asked whether to enable the first mode; alternatively, with prior user authorization, instead of asking the user for each webpage individually, the webpage including the processed content may be displayed directly after the user confirms the use of the first mode, such as directly displaying the redrawn webpage.

[0070] When asking users whether to enable the first mode, a thumbnail of the redrawn webpage can be displayed to help users decide whether to use the first mode.

[0071] Figure 3 shows a schematic diagram of the original interface of a requested webpage according to some embodiments of the present disclosure. In interface 3 of Figure 3, the requested webpage (URL: http: / / abc.abc.abc) is displayed in a browser. The webpage includes a main navigation bar 31, a secondary navigation bar 32, an advertising bar 33, and also includes a title 34 and body text 35 of an article.

[0072] When the webpage in interface 3 is determined to be suitable for presentation in the first mode, it can be as shown in Figure 4. Figure 4 shows a schematic diagram of the webpage interface in the first mode according to some embodiments of the present disclosure.

[0073] In Figure 4, a toggle control 46 is displayed in the browser's toolbar, along with a thumbnail 47 showing the webpage displayed in the first mode. In response to the toggle control 46 being triggered, the requested webpage is displayed in the first mode.

[0074] Figure 5 illustrates a schematic diagram of a webpage interface in a first mode according to some other embodiments of the present disclosure. The webpage displayed in interface 5 is based on the same requested URL as the webpage displayed in interface 3; that is, interface 5 is obtained by processing the original webpage in interface 3. For example, the text shown in Figure 3 is converted into text and image content. In interface 5, the article title 51 is consistent with title 31, the original body text 35 is abbreviated to paragraphs such as body text 52 and 54, and images 53 and 55 are generated based on the original body text 35. Furthermore, the main navigation bar, secondary navigation bar, and advertising bar are omitted. Thus, the webpage in the first mode can convey the information in the original webpage to the user more efficiently using a more concise text and image format.

[0075] In the second mode, the tools recommended to the user can be triggered and work directly (e.g., with the user's prior authorization), or the tool's working process can be triggered after the user's confirmation.

[0076] To make the function of the recommended tools clearer to users, the content that the tools can handle can be identified on the webpage. In some embodiments, trigger controls for tools matching the webpage are displayed on the webpage; the content to be processed by the tools is identified on the webpage.

[0077] Figure 6 illustrates a schematic diagram of the original interface of a requested webpage according to some embodiments of the present disclosure. In interface 6 of Figure 6, the requested webpage (URL: http: / / xyz.xyz.xyz) is displayed in a browser. The webpage includes a news article, with body 61 describing the content of the news article and at least two paragraphs 61 and 62. Paragraph 61 describes a timeline of an event.

[0078] By analyzing the webpage, it was determined that the second mode is relatively easy for users to understand. Based on the multiple time points in paragraph 61, a mind mapping tool can be recommended to users to organize the sub-events at each time point and the relationships between the sub-events.

[0079] Figure 7 illustrates a schematic diagram of a webpage interface in a second mode according to some embodiments of the present disclosure. When using a recommendation tool, paragraph 61 can be highlighted or marked in any other arbitrary way, and this area can be associated with a trigger control of the mind mapping tool, such as control 73 shown in Figure 7. Thus, the user can clearly understand that the highlighted portion can be processed through trigger control 73 to meet further user needs.

[0080] In some embodiments, in response to a tool being triggered in the second interaction mode and matching a webpage, the processing result is displayed at the location of the content processed on the webpage or in the agent's interactive interface.

[0081] For example, after the user triggers control 73, the generated mind map can be displayed near paragraph 61. Alternatively, the mind map can also be displayed in the interactive interface with the agent.

[0082] Figure 8 illustrates a schematic diagram of a webpage interface in a second mode according to some other embodiments of the present disclosure. Based on interface 6 shown in Figure 7, interface 8 can be presented if a mind mapping tool is triggered, for example, control 73 is activated. The left side of interface 8 is consistent with the content of the original webpage, while the right side displays the agent's interactive interface 81. Interactive interface 81 includes a mind map generated based on paragraph 61. Furthermore, if the user wants to delve deeper into the relevant content, they can continue to ask questions to the agent through interactive interface 81.

[0083] The methods of the disclosed embodiments have been described above. The apparatus for performing the methods described above is described below.

[0084] Figure 9 shows a schematic diagram of the structure of a web-based interactive device according to some embodiments of the present disclosure. As shown in Figure 9, the interactive device 9 of this embodiment includes: a determining module 91, configured to determine an interaction mode based on a requested webpage; a content processing module 92, configured to process at least a portion of the content in the webpage and display the processed content in the webpage in response to the interaction mode being a first mode; and a recommendation module 93, configured to display the webpage and recommend tools matching the webpage to the user based on the content of the webpage in response to the interaction mode being a second mode.

[0085] In some embodiments, the determining module 91 is further configured to: determine whether target content exists in the webpage, and whether the target content matches a specified content processing method; in response to the existence of target content in the webpage, determine the interaction mode as a first mode; in response to the absence of target content in the webpage, determine the interaction mode as a second mode.

[0086] In some embodiments, the content processing method includes translation, and the determination module 91 is further configured to: in response to the existence of content in a specified language in the webpage, determine the content in the specified language as the target content.

[0087] In some embodiments, the content processing module 92 is further configured to: generate at least one of translated text and translated audio in response to the target content being text; generate at least one of translated text and translated audio in response to the target content being audio; and generate at least one of subtitles and translated dubbing for the video in response to the target content being video.

[0088] In some embodiments, the content processing method includes genre conversion, and the determining module 91 is further configured to: in response to the webpage including content of a first genre, determine whether the content of the first genre includes content adapted to a second genre; in response to the content of the first genre including content adapted to a second genre, determine the content of the first genre as the target content.

[0089] In some embodiments, the first genre is text, and the second genre includes at least one of images and videos; or, the first genre is video, and the second genre includes at least one of images and text; the content processing module 92 is further configured to convert the content of the first genre into the content of the second genre.

[0090] In some embodiments, the content processing method includes interpreting the content, and the determination module 91 is further configured to: in response to the webpage including content related to a specified domain, determine the content related to the specified domain as target content.

[0091] In some embodiments, the content processing module 92 is further configured to: generate an explanation of the target content; and merge non-target content in the webpage with the explanation.

[0092] In some embodiments, the content processing module 92 is further configured to: redraw the webpage and display the processed content in the redrawn webpage.

[0093] In some embodiments, the recommendation module 93 is further configured to: determine the content of a specified data type in the webpage; determine alternative tools for processing the specified data type; and, based on the understanding of the content of the specified data type, determine a tool that matches the webpage from the alternative tools.

[0094] In some embodiments, the recommendation module 93 is further configured to: display trigger controls for tools that match the webpage in the webpage; and identify the content to be processed by the tool in the webpage.

[0095] In some embodiments, the recommendation module 93 is further configured to: in response to the triggering of a tool whose interaction mode is the second mode and matches the webpage, display the processing result at the location of the processed content on the webpage or in the interactive interface of the agent.

[0096] In some embodiments, the determining module 91 is further configured to: determine, based on the webpage, content that matches the specified content processing method; and determine whether the target content exists in the webpage based on the amount of content in the webpage that matches the specified content processing method.

[0097] In some embodiments, the determining module 91 is further configured to: determine the type of a webpage based on the content or link of the requested webpage; and determine the interaction mode based on the type of the webpage and a pre-set correspondence, wherein the correspondence includes the correspondence between the type of the webpage and the interaction mode.

[0098] In some embodiments, the modules in a web-based interactive device may be entirely located on the user device, or some modules may be located on the user device and some modules may be located on the server. Modules located on the user device may be located in a browser or in other applications, and this disclosure does not limit this.

[0099] Figure 10 shows a block diagram of an electronic device according to some embodiments of the present disclosure.

[0100] Memory 101 is used to store one or more computer-readable instructions. Memory 101 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Memory 101 may, for example, store operating systems, application programs, boot loaders, databases, and other programs, as well as various application programs and various data.

[0101] The processor 102 is configured to execute computer-readable instructions to implement the method described in any of the foregoing embodiments. Specific implementations of each step of the method can be found in the above embodiments; repeated details will not be elaborated upon here.

[0102] The processor 102 can be configured to perform the steps of the methods in any of the foregoing embodiments. The processor 102 can be embodied in various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The central processing unit (CPU) can be an x86 or ARM architecture, etc.

[0103] The processor 102 and the memory 101 can communicate with each other directly or indirectly. For example, the processor 102 and the memory 101 can communicate via a network. The network can include a wireless network, a wired network, and / or any combination of wireless and wired networks. The processor 102 and the memory 101 can also communicate with each other via a system bus, which is not limited in this disclosure.

[0104] It should be noted that the components of the electronic device 10 shown in Figure 10 are exemplary and not limiting. The electronic device 10 may have other components depending on the actual application requirements. The processor 102 can control other components in the electronic device 10 to perform desired functions.

[0105] Electronic device 10 can be implemented by software, firmware and / or hardware, and can be integrated into a device with relevant applications installed.

[0106] Figure 11 shows a block diagram of an electronic device according to other embodiments of the present disclosure.

[0107] The electronic device 11 shown in Figure 11 can be a computer system with a dedicated hardware structure, which can perform corresponding functions when relevant applications are installed.

[0108] Electronic devices include, but are not limited to, mobile terminals such as smartphones, laptops, personal digital assistants (PDAs), tablet computers (PCs), PMPs (portable multimedia players), in-vehicle terminals (such as in-vehicle navigation terminals), wearable devices, and fixed terminals such as digital televisions and desktop computers.

[0109] As shown in Figure 11, the Central Processing Unit (CPU) 111 performs various processes based on a program stored in the Read-Only Memory (ROM) 112 or a program loaded from the Storage Section 118 into the Random Access Memory (RAM) 113. The RAM 113 stores data required as needed when the CPU 111 performs various processes. The CPU is merely exemplary and can also be other types of processors, such as the various processors described above. The ROM 112, RAM 113, and Storage Section 118 can be various forms of computer-readable storage media. It should be noted that although the ROM 112, RAM 113, and Storage Section 118 are shown separately in Figure 11, one or more of them can be combined or located in the same or different memories or storage modules.

[0110] CPU 111, ROM 112 and RAM 113 are interconnected via bus 114. Input / output interface 115 is also connected to bus 114.

[0111] The following components are connected to the input / output interface 115: input section 116, such as a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output section 117, including displays such as cathode ray tube (CRT), liquid crystal display (LCD), speakers, vibrators, etc.; storage section 118, including hard disks, magnetic tapes, etc.; and communication section 119, including network interface cards such as LAN cards, modems, etc. The communication section 119 allows communication processing to be performed via a network such as the Internet. It is readily understood that although parts of the electronic device 11 shown in Figure 11 communicate via bus 114, they can also communicate via a network or other means, wherein the network can include wireless networks, wired networks, and / or any combination of wireless and wired networks.

[0112] As needed, drive 1110 is also connected to input / output interface 115. Removable media 1111, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 1110 as needed, so that computer programs read from them can be installed into storage section 118 as needed.

[0113] When the above series of processes are implemented through software, the program constituting the software can be installed from a network such as the Internet or a storage medium such as a removable medium 1111.

[0114] According to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product that, when run on a computer, causes the computer to perform the methods described in any of the foregoing embodiments. The computer program product includes computer instructions carried on a computer-readable medium, containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer instructions can be downloaded and installed from a network via communication section 119, or installed from storage section 118, or installed from ROM 112. When the computer program is executed by CPU 111, the methods of embodiments of this disclosure are performed.

[0115] It should be noted that, in the context of this disclosure, a computer-readable medium can be a tangible medium that may contain or store programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0116] A computer-readable medium may be a computer-readable storage medium, a computer-readable signal medium, or any combination thereof.

[0117] Computer-readable storage media include, but are not limited to, systems, apparatuses, or devices that are electrical, magnetic, optical, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. Computer instructions are stored on the computer-readable storage medium that, when executed by a processor, implement the methods described in any of the foregoing embodiments.

[0118] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0119] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0120] In some embodiments, a computer program is also provided, comprising: instructions that, when executed by a processor, cause the processor to perform the methods described in any of the foregoing embodiments. For example, the instructions may be embodied in computer program code.

[0121] In embodiments of this disclosure, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0122] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0123] The functions described above can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0124] While specific embodiments of this disclosure have been described in detail by way of example, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A webpage-based interactive method, comprising: Determine the interaction mode based on the requested webpage; In response to the interaction mode being the first mode, at least a portion of the content in the webpage is processed, and the processed content is displayed on the webpage; In response to the second interaction mode, the webpage is displayed, and tools matching the webpage are recommended to the user based on the content of the webpage.

2. The interaction method according to claim 1, wherein, Determining the interaction mode based on the requested webpage includes: Determine whether the target content exists in the webpage, and whether the target content matches the specified content processing method; In response to the presence of the target content on the webpage, the interaction mode is determined to be the first mode; In response to the absence of the target content on the webpage, the interaction mode is determined to be the second mode.

3. The interaction method according to claim 2, wherein, The content processing method includes translation, and determining whether the target content exists in the webpage includes: In response to the presence of content in a specified language on the webpage, the content in the specified language is determined as the target content.

4. The interaction method according to claim 3, wherein, The processing of at least a portion of the content in the webpage includes: In response to the target content being text, at least one of translated text and translated audio is generated for the text; In response to the target content being audio, at least one of translated text and translated audio is generated for the audio. In response to the target content being a video, at least one of the following is generated: a subtitle translation of the video and a translated dubbing of the video.

5. The interaction method according to any one of claims 2 to 4, wherein, The content processing method includes genre conversion, and determining whether the target content exists in the webpage includes: In response to the webpage including content of a first genre, determine whether the content of the first genre includes content adapted to a second genre; In response to the fact that the content of the first genre includes content adapted to the second genre, the content of the first genre is determined as the target content.

6. The interaction method according to claim 5, wherein: The first genre is text, and the second genre includes at least one of images and videos; or, the first genre is video, and the second genre includes at least one of images and text. The processing of at least a portion of the content in the webpage includes: converting the content of the first genre into the content of the second genre.

7. The interaction method according to any one of claims 2 to 6, wherein, The content processing method includes interpreting the content, and determining whether the target content exists in the webpage includes: In response to the webpage including content related to a specified domain, the content related to the specified domain is identified as the target content.

8. The interaction method according to claim 7, wherein, The processing of at least a portion of the content in the webpage includes: Generate an explanation of the target content; The non-target content in the webpage is integrated with the explanation.

9. The interaction method according to any one of claims 1 to 8, wherein, The process of displaying the processed content on the webpage includes: The webpage is redrawn, and the processed content is displayed on the redrawn webpage.

10. The interaction method according to any one of claims 1 to 9, wherein, The tool that recommends webpages to users based on the content of the webpage includes: Determine the content of the specified data type in the webpage; Identify alternative tools for processing the specified data type; Based on the understanding of the content of the specified data type, a tool that matches the webpage is determined from the candidate tools.

11. The interaction method according to any one of claims 1 to 10, wherein, The tool that recommends webpages to users based on the content of the webpage includes: Display trigger controls for tools that match the webpage in the webpage; The content to be processed by the tool is identified on the webpage.

12. The interaction method according to any one of claims 1 to 11, further comprising: When a tool is triggered in response to the second interaction mode and matching the webpage, the processing result is displayed at the location of the processed content on the webpage or in the agent's interaction interface.

13. The interaction method according to any one of claims 2 to 8, wherein, Determining whether the target content exists in the webpage includes: Based on the webpage, determine the content that matches the specified content processing method; Based on the amount of content in the webpage that matches the specified content processing method, determine whether the target content exists in the webpage.

14. The interaction method according to any one of claims 1 to 13, wherein, Determining the interaction mode based on the requested webpage includes: The type of the requested webpage is determined based on its content or link. The interaction mode is determined based on the type of the webpage and a pre-set correspondence, wherein the correspondence includes the correspondence between the type of the webpage and the interaction mode.

15. An electronic device comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute a web-based interactive method as described in any one of claims 1 to 14 based on instructions stored in the memory.

16. A computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the web-based interactive method of any one of claims 1 to 14.

17. A computer program product, when run on a computer, causes the computer to implement the web-based interactive method according to any one of claims 1 to 14.

18. A computer program comprising: Instructions, when executed by a processor, cause the processor to perform the web-based interactive method according to any one of claims 1 to 14.

Images