A search method and an electronic device
Patent Information
- Application Number
- CN202210724383.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-24
- Publication Date
- 2026-10-27
- Estimated Expiration
- 2042-06-24
AI Technical Summary
[0002]用户通过终端的搜索功能(例如搜索引擎提供的搜索功能)输入关键词并进行搜索时,终端返回的是包括多个网页的概要信息的网页列表,为了获取所需内容,用户需要逐个点击网页列表包括的网页以查看网页的详细内容,一个网页包括的内容通常很多,而终端(尤其是体积较小的手机等终端)一次展示的内容有限,因此,用户需要花费大量的时间去寻找所需内容,搜索效率很低,用户体验感差
Smart Images

Figure CN117332138B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and more particularly to a search method and electronic device. Background Technology
[0002] When a user enters keywords and searches using the terminal's search function (such as the search function provided by a search engine), the terminal returns a list of web pages containing summary information of multiple web pages. In order to obtain the desired content, the user needs to click on each web page in the web page list to view the detailed content of the web page. A web page usually contains a lot of content, while the terminal (especially small terminals such as mobile phones) has a limited amount of content to display at one time. Therefore, users need to spend a lot of time to find the desired content, resulting in low search efficiency and a poor user experience. Summary of the Invention
[0003] This application discloses a search method and electronic device that can integrate multiple contents from at least one webpage and provide them to a user, reducing the time it takes for the user to obtain the required content and improving search efficiency.
[0004] In a first aspect, this application provides a search method applied to an electronic device. The method includes: acquiring a first keyword input by a user; sending a first search request to a network device, the first search request including the first keyword; receiving a set of search results sent by the network device based on the first search request; displaying a first interface, the first interface including the set of search results, the set of search results including a first search result and a second search result, the first search result being related to a first webpage, and the second search result being related to a second webpage; receiving a first user operation; responding to the first user operation, generating a first card set, the first card set including a first card, the first card including first content and second content, the first webpage including the first content, and the second webpage including the second content; and displaying a second interface after the first user operation, the second interface including the first card.
[0005] In the above method, the electronic device can automatically extract the first content from the first search result and the second content from the second search result, and display the extracted content through the first card in the first card set. This allows users to quickly obtain the content in the search results that matches their search intent through the first card set, without having to click on multiple web page cards or browse the entire web page. This reduces the user operations and time spent when organizing search results, and greatly improves search efficiency.
[0006] In one possible implementation, both the first content and the second content are associated with the first keyword.
[0007] For example, the similarity between the first content and the first keyword is greater than or equal to a preset threshold, and the similarity between the second content and the first keyword is greater than or equal to a preset threshold.
[0008] In the above method, the content of the first card in the first card set is related to the first keyword entered by the user, so as to avoid the influence of content unrelated to the first keyword in the search results on the user's sorting of search results, and further improve search efficiency.
[0009] In one possible implementation, the method further includes: receiving a second user action applied to the first search result on the first interface; displaying the first webpage; receiving a third user action; responding to the third user action to generate a second card set, the second card set including a second card, the first card including third content and fourth content, the third content and the fourth content being content of the first webpage; and displaying a third interface, the third interface including the second card.
[0010] In one possible implementation, the third content and the fourth content are associated with the first keyword. For example, the similarity between the third content and the first keyword is greater than or equal to a preset threshold, and the similarity between the fourth content and the first keyword is greater than or equal to a preset threshold.
[0011] In the above method, after a user opens the first webpage, the electronic device can filter out the third and fourth contents related to the first keyword from the first webpage, and display the filtered contents through the second card in the second card set. This allows the user to quickly obtain the content on the first webpage that matches the user's search intent through the second card set, without having to browse the entire first webpage. This reduces the user operations and time spent organizing search results, and improves search efficiency.
[0012] In one possible implementation, the method further includes: receiving a selection operation performed by a user on the first webpage; obtaining first information based on the selection operation; receiving a fourth user operation; responding to the fourth user operation to generate a third card, the third card being a card from the second card set, the third card including fifth content and sixth content, both of which are content of the first webpage, and both of which are associated with the first information; and displaying a fourth interface, the fourth interface including the third card.
[0013] In the above method, users can customize the selection of the first information on the first webpage. The electronic device can filter out the fifth and sixth contents associated with the first information from the first webpage and display the filtered contents through the third card in the second card set. The user's customization of webpage content improves the flexibility of the search. Furthermore, it eliminates the need for users to manually search for the fifth and sixth contents and add them to storage locations such as notepads and sticky notes, reducing the user operations and time spent organizing search results, making it more convenient and faster to use.
[0014] In one possible implementation, the first card set further includes a fourth card, the first card including content of a first type, and the fourth card including content of a second type, the first type and the second type being different.
[0015] For example, the first card contains text content, and the fourth card contains image content.
[0016] In the above method, different types of content can be displayed through different cards, eliminating the need for users to manually organize content of the same type together. This makes browsing more convenient and improves the efficiency of users in obtaining the content they need. For example, a user may only want to obtain text-type content, so the user can quickly obtain the content they need by only viewing cards containing text-type content.
[0017] In one possible implementation, generating the first card set includes: receiving a fifth user operation; responding to the fifth user operation by selecting the first search result and the second search result from the search result set; and generating the first card set based on the first search result and the second search result.
[0018] In the above method, the first and second search results used to generate the first card set can be user-defined, which can meet the user's personalized needs and provide a better user experience.
[0019] In one possible implementation, when the similarity between the first content and the first keyword is greater than the similarity between the second content and the first keyword, the first content is placed before the second content; or, when the first search result is placed before the second search result, the first content is placed before the second content.
[0020] In the methods described above, content with a high degree of similarity to the primary keyword can be displayed more prominently. Users can prioritize seeing content predicted by the electronic device that better matches their search intent, reducing the time spent searching for desired content and further improving search efficiency. Alternatively, the display order of content within the cards can be consistent with the display order of the corresponding search results, unifying the display effect of the search result set and card set, resulting in a better user browsing experience.
[0021] In one possible implementation, after displaying the second interface, the method further includes: displaying a fifth interface, the fifth interface including a first control, the fifth interface being the desktop of the electronic device, the negative one screen, or the collection interface of the first application, the first control being associated with the first card set; receiving a sixth user operation applied to the first control; and displaying a sixth interface, the sixth interface including the fifth card in the first card set.
[0022] In one possible implementation, after displaying the second interface, the method further includes: displaying a user interface of a gallery, the user interface of which includes a first image associated with the first card set; receiving a user operation for identifying the first image; and displaying the sixth interface.
[0023] In the above method, users can view the first card set again through the desktop, the negative one screen, the first application's favorites, or the pictures in the gallery. There are many ways to obtain the information, which is highly flexible and increases the probability of users viewing the first card set again, making the function highly usable.
[0024] In one possible implementation, the method further includes: receiving a seventh user action applied to the first content in the second interface; and displaying the first webpage.
[0025] For example, the seventh user action is a single-click action or a double-click action.
[0026] In the above method, users can operate on any item in the first card to view the webpage to which that item belongs, without having to manually search for and click on the search results, making it more convenient for users.
[0027] In one possible implementation, the method further includes: receiving an eighth user operation applied to the first card in the second interface; deleting the first card in response to the eighth user operation; or, receiving a ninth user operation applied to the first content in the second interface; deleting the first content in response to the ninth user operation.
[0028] For example, the eighth user action is a user action of dragging up or down, or the eighth user action is a click action performed on the delete control corresponding to the first card.
[0029] For example, the ninth user action is a click operation on the delete control corresponding to the first content.
[0030] In the above method, users can delete any card in the first card set, and users can also delete any content in the first card, which meets users' personalized needs and improves the user experience.
[0031] In one possible implementation, the method further includes: receiving a tenth user operation on the first content in the second interface; responding to the tenth user operation, modifying the first content to a seventh content; and displaying the seventh content in the first card.
[0032] In the above method, users can modify any content in the first card without having to manually copy the content to a notepad or other location for modification, reducing user operations, meeting users' personalized needs, and improving user experience.
[0033] In one possible implementation, the first content in the first card is positioned before the second content; the method further includes: receiving an eleventh user operation applied to the first content in the second interface; responding to the eleventh user operation, adjusting the display positions of the first content and the second content in the first card; and displaying the adjusted first card, wherein the first content in the adjusted first card is positioned after the second content.
[0034] For example, the eleventh user operation is to drag the first content to the location of the second content.
[0035] In the above method, users can adjust the display order of the content in the first card to meet their personalized needs and improve the user experience.
[0036] In one possible implementation, the first card set further includes a sixth card; the method further includes: receiving a twelfth user operation on the first content in the second interface; in response to the twelfth user operation, moving the first content from the first card to the sixth card; in response to the twelfth user operation, the first card does not include the first content, and the sixth card includes the first content.
[0037] For example, the twelfth user action is a user action of dragging to the left or right.
[0038] In the above method, users can move the first content in the first card to other cards in the first card set, which can meet the user's personalized needs and improve the user experience.
[0039] In one possible implementation, the first card set further includes a seventh card; the method further includes: receiving a thirteenth user operation on the first card in the second interface; and in response to the thirteenth user operation, merging the first card and the seventh card into an eighth card, wherein the eighth card includes the content of the first card and the content of the seventh card.
[0040] For example, the thirteenth user operation is to drag the first card to the position of the seventh card.
[0041] In the above method, users can merge any two cards in the first card set to meet their personalized needs and improve the user experience.
[0042] In one possible implementation, the method further includes: receiving a fourteenth user operation; displaying a seventh interface, the seventh interface including the content of cards in the first card set; receiving a fifteenth user operation applied to the seventh interface; obtaining the eighth content included in the ninth card of the first card set according to the fifteenth user operation; receiving a sixteenth user operation; responding to the sixteenth user operation, generating a tenth card, the tenth card being a card in the first card set, the tenth card including the eighth content; and displaying an eighth interface, the eighth interface including the tenth card.
[0043] In the above method, users can select the eighth content included in the ninth card in the first card set, and generate the tenth card based on the selected content in the first card set, which meets the user's personalized needs and eliminates the need for users to manually add the eighth content to the tenth card, reducing user operations and improving user experience.
[0044] In one possible implementation, the method further includes: storing information about the first card set, the information about the first card set including at least one of the following: the first keyword, the number of cards included in the first card set, the content included in the cards in the first card set, the display position of the first card in the first card set, the display of the first content in the first card, and information about the first webpage to which the first content belongs.
[0045] Secondly, this application provides another search method applied to an electronic device. The method includes: displaying a first webpage; obtaining first information related to the first webpage, wherein the first information is a first keyword used to search the first webpage, or the first information is information obtained based on a user's selection operation on the first webpage; receiving a first user operation; responding to the first user operation, generating a first card set, the first card set including a first card, the first card including first content and second content, the first content and the second content being content of the first webpage, and both the first content and the second content being associated with the first information; and displaying a first interface after the first user operation, the first interface including the first card.
[0046] In the above method, the electronic device can obtain the first keyword (first information) entered by the user during the search or the first information customized by the user on the first webpage, and automatically filter out the first content and second content related to the first information from the first webpage, and display the filtered content through the first card in the first card set. This allows the user to quickly obtain the content on the first webpage that matches the user's search intent through the first card set, without having to browse the entire first webpage, reducing the user operations and time spent when organizing search results, and improving search efficiency.
[0047] In one possible implementation, displaying the first webpage includes: acquiring the first keyword input by a user; sending a first search request to a network device, the first search request including the first keyword; receiving a set of search results sent by the network device based on the first search request; displaying a second interface, the second interface including the set of search results, the set of search results including a first search result and a second search result, the first search result being related to the first webpage, and the second search result being related to the second webpage; receiving a second user operation applied to the first search result; and responding to the second user operation by displaying the first webpage.
[0048] In one possible implementation, both the first content and the second content are associated with the first information, including: the similarity between the first content and the first keyword is greater than or equal to a preset threshold, and the similarity between the second content and the first keyword is greater than or equal to a preset threshold.
[0049] In one possible implementation, when the first information is information obtained based on a user's selection operation on the first webpage, the first information includes at least one of text, images, audio, and video from the first webpage.
[0050] In the method described above, users can customize the first piece of information on the first webpage, enhancing the flexibility of the search. Furthermore, users are no longer required to manually search for the first and second pieces of content associated with the first piece of information on the first webpage, nor to add this content to notes, sticky notes, or other storage locations. This reduces the user's time and effort spent organizing search results, making the method more convenient and efficient.
[0051] In one possible implementation, when the first information includes at least one of text, images, audio, and video from the first webpage, the first card set further includes a second card, the first card including content of a first type, and the second card including content of a second type, wherein the first type and the second type are different.
[0052] For example, the first card includes audio content, and the second card includes video content.
[0053] In the above method, different types of content can be displayed through different cards, eliminating the need for users to manually organize content of the same type together. This makes browsing more convenient and improves the efficiency of users in obtaining the content they need. For example, a user may only want to obtain video content, so the user can quickly obtain the content they need by only viewing the cards that include video content.
[0054] In one possible implementation, when the similarity between the first content and the first information is greater than the similarity between the second content and the first information, the first content in the first card is positioned before the second content; or, when the first content in the first webpage is positioned before the second content, the first content in the first card is positioned before the second content.
[0055] In the above methods, content with a high degree of similarity to the first piece of information can be displayed earlier, allowing users to see content predicted by the electronic device that better matches their search intent, reducing the time spent searching for desired content and further improving search efficiency. Alternatively, the display order of content in the cards can be consistent with the display order on the webpage, unifying the display effect of the webpage and card set, resulting in a better user browsing experience.
[0056] In one possible implementation, after displaying the first interface, the method further includes: displaying a third interface, the third interface including a first control, the third interface being the desktop of the electronic device, the negative one screen, or the collection interface of the first application, the first control being associated with the first card set; receiving a third user operation applied to the first control; and displaying a fourth interface, the fourth interface including a third card from the first card set.
[0057] In one possible implementation, after displaying the first interface, the method further includes: displaying a user interface of a gallery, the user interface of which includes a first image associated with the first card set; receiving a user operation for identifying the first image; and displaying the fourth interface.
[0058] In the above method, users can view the first card set again through the desktop, the negative one screen, the first application's favorites, or the pictures in the gallery. There are many ways to obtain the information, which is highly flexible and increases the probability of users viewing the first card set again, making the function highly usable.
[0059] In one possible implementation, the method further includes: receiving a fourth user operation applied to the first content in the first interface; and displaying the first webpage.
[0060] For example, the fourth user action is a single click or a double click.
[0061] In the above method, users can operate on any item in the first card to view the webpage to which that item belongs, without having to manually search for and click on the search results, making it more convenient for users.
[0062] In one possible implementation, the method further includes: receiving a fifth user operation applied to the first card in the first interface; deleting the first card in response to the fifth user operation; or, receiving a sixth user operation applied to the first content in the first interface; deleting the first content in response to the sixth user operation.
[0063] For example, the fifth user action is a user action of dragging up or down, or the fifth user action is a click action on the delete control corresponding to the first card.
[0064] For example, the sixth user action is a click operation on the delete control corresponding to the first content.
[0065] In the above method, users can delete any card in the first card set, and users can also delete any content in the first card, which meets users' personalized needs and improves the user experience.
[0066] In one possible implementation, the method further includes: receiving a seventh user operation on the first content in the first interface; responding to the seventh user operation, modifying the first content to third content; and displaying the third content in the first card.
[0067] In the above method, users can modify any content in the first card without having to manually copy the content to a notepad or other location for modification, reducing user operations, meeting users' personalized needs, and improving user experience.
[0068] In one possible implementation, the first content in the first card is positioned before the second content; the method further includes: receiving an eighth user operation acting on the first content in the first interface; responding to the eighth user operation, adjusting the display positions of the first content and the second content in the first card; and displaying the adjusted first card, wherein the first content in the adjusted first card is positioned after the second content.
[0069] For example, the eighth user operation is a user operation that drags the first content to the location of the second content.
[0070] In the above method, users can adjust the display order of the content in the first card to meet their personalized needs and improve the user experience.
[0071] In one possible implementation, the first card set further includes a fourth card; the method further includes: receiving a ninth user operation on the first content in the first interface; in response to the ninth user operation, moving the first content from the first card to the fourth card; and in response to the ninth user operation, the first card does not include the first content, and the fourth card includes the first content.
[0072] For example, the ninth user action is a dragging action to the left or right.
[0073] In the above method, users can move the first content in the first card to other cards in the first card set, which can meet the user's personalized needs and improve the user experience.
[0074] In one possible implementation, the first card set further includes a fifth card; the method further includes: receiving a tenth user operation on the first card in the first interface; and in response to the tenth user operation, merging the first card and the fifth card into a sixth card, wherein the sixth card includes the content of the first card and the content of the fifth card.
[0075] For example, the tenth user operation is a user operation that drags the first card to the position of the fifth card.
[0076] In the above method, users can merge any two cards in the first card set to meet their personalized needs and improve the user experience.
[0077] In one possible implementation, the method further includes: receiving an eleventh user operation; displaying a fifth interface, the fifth interface including the content of cards in the first card set; receiving a twelfth user operation applied to the fifth interface; obtaining the fourth content included in the seventh card in the first card set according to the twelfth user operation; receiving a thirteenth user operation; responding to the thirteenth user operation, generating an eighth card, the eighth card being a card in the first card set, the eighth card including the fourth content; and displaying a sixth interface, the sixth interface including the eighth card.
[0078] In the above method, users can select the fourth content included in the seventh card in the first card set, and generate the eighth card based on the selected content in the first card set, which meets the user's personalized needs and eliminates the need for users to manually add the fourth content to the eighth card, reducing user operations and improving user experience.
[0079] In one possible implementation, the method further includes: saving information about the first card set, the information about the first card set including at least one of the following: information about the first webpage, the first information, the number of cards included in the first card set, the content included in the cards in the first card set, the display position of the first card in the first card set, and the display of the first content in the first card.
[0080] Thirdly, this application provides an electronic device, including a transceiver, a processor, and a memory, wherein the memory is used to store a computer program, and the processor invokes the computer program to execute the search method in any possible implementation of any aspect above.
[0081] Fourthly, this application provides an electronic device including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, including computer instructions, which, when executed by the one or more processors, cause the electronic device to perform the search method in any possible implementation of any of the above aspects.
[0082] Fifthly, this application provides a computer storage medium storing a computer program that, when executed by a processor, implements the search method in any of the possible implementations of any of the above aspects.
[0083] Sixthly, this application provides a computer program product that, when run on an electronic device, causes the electronic device to execute the search method in any possible implementation of any of the above aspects.
[0084] In a seventh aspect, this application provides an electronic device that includes the method or apparatus described in any implementation of this application. The electronic device is, for example, a chip. Attached Figure Description
[0085] The accompanying drawings used in the embodiments of this application are described below.
[0086] Figure 1A This is a schematic diagram of the architecture of a search system provided in an embodiment of this application;
[0087] Figure 1B This is an interactive schematic diagram of a search system provided in an embodiment of this application;
[0088] Figure 2A This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;
[0089] Figure 2B This is a schematic diagram of the software architecture of an electronic device provided in an embodiment of this application;
[0090] Figure 3 This is a schematic diagram of a user interface for one embodiment provided in this application.
[0091] Figure 4 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0092] Figure 5A This is a schematic diagram of the user interface of another embodiment provided in this application;
[0093] Figure 5B This is a schematic diagram of the user interface of another embodiment provided in this application;
[0094] Figure 6 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0095] Figure 7A This is a schematic diagram of the user interface of another embodiment provided in this application;
[0096] Figure 7B This is a schematic diagram of the user interface of another embodiment provided in this application;
[0097] Figure 8 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0098] Figure 9 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0099] Figure 10 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0100] Figure 11 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0101] Figure 12 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0102] Figure 13 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0103] Figure 14 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0104] Figure 15 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0105] Figure 16 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0106] Figure 17A This is a schematic diagram of the user interface of another embodiment provided in this application;
[0107] Figure 17B This is a schematic diagram of the user interface of another embodiment provided in this application;
[0108] Figure 18 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0109] Figure 19A This is a schematic diagram of the user interface of another embodiment provided in this application;
[0110] Figure 19B This is a schematic diagram of the user interface of another embodiment provided in this application;
[0111] Figure 20 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0112] Figure 21 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0113] Figure 22 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0114] Figure 23 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0115] Figure 24 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0116] Figure 25A This is a schematic diagram of the user interface of another embodiment provided in this application;
[0117] Figure 25B This is a schematic diagram of the user interface of another embodiment provided in this application;
[0118] Figure 25C This is a schematic diagram of the user interface of another embodiment provided in this application;
[0119] Figure 26 This is a schematic diagram of the user interface of another embodiment provided in this application;
[0120] Figure 27A This is a schematic diagram of the user interface of another embodiment provided in this application;
[0121] Figure 27B This is a schematic diagram of the user interface of another embodiment provided in this application;
[0122] Figure 28 This is a flowchart illustrating a search method provided in an embodiment of this application;
[0123] Figure 29 This is a schematic diagram illustrating a process for obtaining a first content set according to an embodiment of this application;
[0124] Figure 30 This is a flowchart illustrating another search method provided in the embodiments of this application. Detailed Implementation
[0125] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " represents "or," for example, A / B can represent A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0126] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.
[0127] When users use a device's search function (such as the search function provided by a search engine), they expect to obtain content related to their search keywords (referred to as search keywords). This content may include a piece of text, an image, a video, or other types of content from a webpage. However, the search function returns a list of webpages containing summary information (referred to as webpage cards), where dynamic effects of key webpage content can be displayed within the webpage cards. To obtain webpage content that matches their search intent, users often need to click on multiple webpage cards in the webpage list to view the detailed content of the corresponding webpage. A single webpage typically contains a lot of content, while a device (especially a small device like a mobile phone) has a limited capacity for displaying content at a time. Although keywords within the webpage content can be highlighted (e.g., highlighted), users still need to browse the entire webpage to see if there is any text, images, videos, etc., that match their search intent. In other words, users need to perform multiple operations and spend a significant amount of time searching for content that matches their search intent, resulting in low search efficiency and a poor user experience.
[0128] This application provides a search method and an electronic device. After receiving keywords (hereinafter referred to as search keywords) input by a user, the electronic device can retrieve at least one webpage based on the keywords and generate at least one card based on these at least one webpage. This at least one card can include content related to the search keywords from the at least one webpage. This at least one card can be viewed, modified, and saved by the user. In essence, the electronic device automatically compares and organizes the content of the at least one webpage, integrating multiple pieces of content related to the search keywords into at least one card (hereinafter referred to as a card set). This allows the user to quickly obtain content matching their search intent / required content through the card set, reducing the time spent organizing search results, improving search efficiency, and enhancing the user experience.
[0129] This method can be applied to the field of web search. Web search can be based on user-inputted search keywords, using specific algorithms and strategies to retrieve search results (related to web pages) from the internet. These search results are then sorted and displayed as a search result list (also called a search result set or web page list). The search result list can include summary information of the search results (called web page cards). Users can interact with any web page card to view the content page of the corresponding web page (used to display the detailed content of the web page). This method is not limited to this; it can also be applied to other search fields, where the search results may not be related to web pages, such as being related to products. This application does not limit this application. For ease of description, this application uses the example of search results being related to web pages (hereinafter referred to as search results as web pages) for illustration.
[0130] The touch operations in this application may include, but are not limited to, single-click, double-click, long-press, single-finger long-press, multi-finger long-press, single-finger swipe, multi-finger swipe, knuckle swipe, and other forms. Among these, the swipe-type touch operation can be simply referred to as a swipe operation, which includes, but is not limited to, swiping left and right, swiping up and down, and swiping towards a first specific position. This application does not limit the trajectory of the swipe operation. In some embodiments, the touch operation can be applied to a second specific position on the electronic device. This specific position may be located on the display screen of the electronic device, such as the location of icons or other controls, or the edge of the display screen. Alternatively, the specific position may be located on the side, back, or other locations of the electronic device, such as the location of volume buttons, power buttons, or other buttons. This specific position may be preset by the electronic device, or determined by the electronic device in response to user operation.
[0131] The drag operation in this application is a touch operation. A drag operation applied to a control can be an operation that involves keeping the control touched and sliding, such as, but not limited to, single-finger drag, multi-finger drag, knuckle drag, and other forms. Similar to the swiping operation, the drag operation can be, for example, but not limited to, dragging left and right, dragging up and down, dragging to a specific position, etc. This application does not limit the trajectory of the drag operation.
[0132] The screenshot operation in this application can be used to select content displayed in any area on the screen of an electronic device and save the displayed content as an image to the electronic device. The displayed content can include at least one type of content, such as text content, image content, and video content. The screenshot operation can be, but is not limited to, touch operation, voice input, motion gestures (e.g., gestures), brainwaves, etc. For example, the screenshot operation is a knuckle swipe, or the screenshot operation is a touch operation that simultaneously acts on the power button and volume button of the electronic device.
[0133] The card set in this application may include at least one card. The card in this application may be a control displayed in the form of a card; in specific implementations, it may also be displayed in other forms such as a floating box. This application does not limit the specific display form of the card. On the one hand, the card can be used to display web page content for users to browse; on the other hand, the electronic device can receive user operations on the card to perform various operations such as viewing the original web page to which the web page content belongs, moving, editing, deleting, and adding.
[0134] The webpage card in this application can be a control that displays a summary of search results (webpages) in the form of a card. In specific implementations, it can also be displayed in other forms such as text boxes, and this application does not limit this. The summary information of the webpage includes, but is not limited to, the webpage content displayed at the top of the webpage, and the content of the webpage including search keywords, etc.
[0135] The following describes a search system 10 based on an embodiment of this application.
[0136] Figure 1A An exemplary schematic diagram of the architecture of a search system 10 is shown.
[0137] like Figure 1A As shown, the search system 10 may include an electronic device 100 and a network device 200. The electronic device 100 may communicate with the network device 200 via wired (e.g., universal serial bus, twisted pair, coaxial cable, and fiber optic cable, etc.) and / or wireless (e.g., wireless local area networks, WLAN, Bluetooth, and cellular communication networks, etc.) means.
[0138] The electronic device 100 can be a mobile phone, tablet computer, handheld computer, desktop computer, laptop computer, ultra-mobile personal computer (UMPC), netbook, cellular phone, personal digital assistant (PDA), as well as smart home devices such as smart TVs and projectors, wearable devices such as smart bracelets, smartwatches, and smart glasses, extended reality (XR) devices such as augmented reality (AR), virtual reality (VR), and mixed reality (MR), or in-vehicle devices. This application does not impose any special limitations on the specific type of electronic device. In one embodiment, the electronic device 100 can support a variety of applications, including, but not limited to, applications for camera, image management, image processing, word processing, telephone, email, instant messaging, network communication, media playback, location, and time management.
[0139] The network device 200 may include at least one server. In one embodiment, any server may be a hardware server; in another embodiment, any server may be a cloud server. In one embodiment, the network device 200 may be a Linux server, a Windows server, or other server device that can provide simultaneous access for multiple devices. In one embodiment, the network device 200 may be a server cluster composed of multiple regions, multiple data centers, and multiple servers. In one embodiment, the network device 200 may support message storage and distribution functions, multi-user access management functions, large-scale data storage functions, large-scale data processing functions, and data redundancy backup functions.
[0140] In one implementation, electronic device 100 can communicate with network device 200 using either a browser / server (B / S) architecture or a client / server (C / S) architecture. Electronic device 100 can receive keywords input by a user and request search results related to those keywords from network device 200. Electronic device 100 can display the search results obtained from network device 200, such as displaying a list of web pages.
[0141] Figure 1B An interactive schematic diagram of a search system 10 is shown as an example.
[0142] like Figure 1BAs shown, the electronic device 100 in the search system 10 may include an input module 101, a processing module 102, a communication module 103, an output module 104, a storage module 105, and a shortcut entry 106. The network device 200 in the search system 10 may include a communication module 201 and a processing module 202, wherein:
[0143] Input module 101 is used to receive user input instructions, such as user-input search keywords, user-input card set retrieval requests, or content selected by the user on a webpage (hereinafter referred to as selected content). Processing module 102 is used by the electronic device 100 to perform judgment, analysis, and calculation actions, and to send instructions to other modules to coordinate the orderly execution of corresponding programs by each module, such as executing the following... Figure 28 and Figure 30 The method is illustrated. Communication module 103 is used for information transmission between electronic device 100 and network device 200 (implemented via communication module 201). Output module 104 is used to output information to the user, such as displaying search results or card sets to the user via a display screen.
[0144] In one implementation, after receiving a search keyword input by a user, the input module 101 can send the search keyword to the search module in the processing module 102. The search module can then send the search keyword to the communication module 201 of the network device via the communication module 103. The communication module 201 can then send a search request containing the search keyword to the processing module 202 of the network device. The processing module 202 can obtain search results (i.e., multiple web pages related to the search keyword) based on the search request and send the search results to the communication module 103 via the communication module 201. The communication module 103 can then send the search results to the search module in the processing module 102. The search module can then send the search results to the output module 104. The output module 104 can output the search results, for example, by displaying a list of web pages.
[0145] In one implementation, after receiving a card set retrieval request from a user, the input module 101 can send the card set retrieval request to the extraction module in the processing module 102. Upon receiving the card set retrieval request, the extraction module can obtain the search results from the search module and extract the content of at least one webpage from the search results. For example, it can extract the content of the top N webpages (N is a positive integer) from a plurality of searched webpages, or it can extract the content of the webpage selected by the user from a plurality of searched webpages. Then, the extraction module can send the content of this at least one webpage to the semantic matching module in the processing module 102. The semantic matching module can filter out content related to the search keywords from the content of this at least one webpage. The semantic matching module can send the content related to the search keywords to the card generation module in the processing module 102. The card generation module can generate a card set based on this content. For example, different cards in the card set include different types of content, specifically: cards including text, cards including static images, cards including dynamic images, cards including videos, cards including audio, etc. The card generation module can send the generated card set to the output module 104, and the output module 104 can output the card set, for example, by displaying the card set.
[0146] In one implementation, after receiving content selected by the user on a webpage, the input module 101 can send the selected content to the related content acquisition module in the processing module 102. The related content acquisition module can obtain content related to the selected content (which may be referred to as the related content corresponding to the selected content) from the webpage and send the selected content and related content to the card generation module. The card generation module can generate at least one card based on the selected content and related content. For example, the card includes the selected content and the corresponding related content. This at least one card may belong to the aforementioned card set. For example, the output module 104 can add and display this at least one card to the card set.
[0147] The card set generated by the processing module 102 can be sent to the storage module 105 for storage. In one embodiment, the card set information stored in the storage module 105 may include, but is not limited to, at least one of the following: card set identification information, search keywords, the number of cards included in the card set, the display position of the cards in the card set, card names, web page content such as text, images, and videos included in the cards, the display position of the web page content in the cards, and the address information of the web page to which the web page content in the card set belongs.
[0148] The shortcut entry 106 can be used to display the entry point for a secondary loading card set. For example, after the output module 104 outputs the card set, the shortcut entry point 106 can display the entry point for the secondary loading card set in locations such as the search application's favorites, the desktop of the electronic device 100, the user interface of the negative one screen application, and the user interface of the gallery application. The search application can provide search functionality (receiving search keywords and providing search results related to those keywords) and the function of displaying the card set. In one embodiment, the shortcut entry point 106 can obtain some or all of the information included in the card set from the storage module 105 and display the entry point for the secondary loading card set based on the obtained information, for example, displaying search keywords on the entry point for the secondary loading card set. In one embodiment, after receiving an instruction to load the card set 1 corresponding to entry point 1, the shortcut entry point 106 can send the identification information of card set 1 to the storage module 105. After receiving the identification information of card set 1, the storage module 105 can obtain all the information of card set 1 corresponding to the identification information and send it to the output module 104. The output module 104 can output card set 1 based on the received information, for example, displaying card set 1.
[0149] In one embodiment, at least one of the above-mentioned input module 101, processing module 102, output module 104 and storage module 105 may belong to the search application of the electronic device 100. The search application can provide search functions. For example, a user can open the search application in the electronic device 100 and enter search keywords based on the user interface of the search application. The electronic device 100 can display search results related to the search keywords through the user interface of the search application.
[0150] In one embodiment, the storage module 105 may be the memory of the electronic device 100, for example, as follows: Figure 2A The internal memory 121 shown.
[0151] In one implementation, the shortcut entry 106 can be a widget or control provided by the application, such as a card-shaped widget provided by the negative one screen application.
[0152] In one implementation, the output module 104 may be a display component provided by an application. For example, the application that provides the output module 104 and the application that provides the shortcut entry 106 may be the same application. After receiving an instruction to load a card set, the shortcut entry 106 may output the card set through the output module 104, which belongs to the same application.
[0153] The following describes an exemplary electronic device 100 provided in the embodiments of this application.
[0154] Figure 2AAn exemplary schematic diagram of the hardware structure of an electronic device 100 is shown.
[0155] It should be understood that, Figure 2A The electronic device 100 shown is merely an example, and the electronic device 100 may have more than Figure 2A The more or fewer components shown can be combined into two or more components, or they can have different component configurations. Figure 2A The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0156] like Figure 2A As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0157] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0158] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0159] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0160] The processor 110 may also include a memory for storing instructions and data. In one embodiment, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0161] In one embodiment, the processor 110 may include one or more interfaces. These interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0162] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In one implementation, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0163] The I2S interface can be used for audio communication. In one embodiment, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to realize communication between the processor 110 and the audio module 170. In one embodiment, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to realize the function of answering phone calls through a Bluetooth headset.
[0164] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In one embodiment, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In another embodiment, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0165] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In one implementation, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In one implementation, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0166] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In one embodiment, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.
[0167] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In one implementation, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0168] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0169] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0170] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0171] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In another embodiment, the power management module 141 and the charging management module 140 may be located in the same device.
[0172] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. In one embodiment, electronic device 100 can communicate with network device 200 through wireless communication, for example, by sending a search request to network device 200.
[0173] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0174] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In one embodiment, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In another embodiment, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0175] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In one embodiment, the modem processor may be a separate device. In another embodiment, the modem processor may be independent of the processor 110 and housed within the same device as the mobile communication module 150 or other functional modules.
[0176] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0177] In one embodiment, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0178] The electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. In one embodiment, the electronic device 100 can display a semantic aggregation card set (including web page content that matches the search intent) and an entry control for secondary loading of the semantic aggregation card set.
[0179] The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU performs mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information. The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In one embodiment, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0180] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0181] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In one implementation, the ISP can be integrated into the camera 193.
[0182] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In one embodiment, electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0183] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0184] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0185] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0186] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0187] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.
[0188] Electronic device 100 can implement audio functions, such as playing audio content included in semantic aggregation card set, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0189] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In one embodiment, the audio module 170 can be located in the processor 110, or some functional modules of the audio module 170 can be located in the processor 110.
[0190] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.
[0191] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.
[0192] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In another embodiment, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In yet another embodiment, electronic device 100 may have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, among other functions.
[0193] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.
[0194] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In one embodiment, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In one embodiment, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.
[0195] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In one embodiment, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100's shake, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.
[0196] The barometric pressure sensor 180C is used to measure air pressure. In one embodiment, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0197] The magnetic sensor 180D includes a Hall effect sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In one embodiment, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic unlocking of the flip cover can be set.
[0198] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.
[0199] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In one embodiment, when shooting a scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.
[0200] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.
[0201] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0202] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.
[0203] Temperature sensor 180J is used to detect temperature. In one embodiment, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 reduces the performance of a processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In another embodiment, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In some other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.
[0204] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In another embodiment, touch sensor 180K can also be located on the surface of electronic device 100, in a different position than display screen 194.
[0205] The bone conduction sensor 180M can acquire vibration signals. In one embodiment, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In one embodiment, the bone conduction sensor 180M can also be integrated into headphones to form bone conduction headphones. The audio module 170 can analyze the voice signals based on the vibration signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can analyze heart rate information based on the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.
[0206] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.
[0207] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.
[0208] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.
[0209] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In one embodiment, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0210] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. For example, a layered architecture software system can be the Android system, the Harmony operating system (OS), or other software systems. This application embodiment uses the layered architecture Android system as an example to illustrate the software structure of electronic device 100.
[0211] Figure 2B An exemplary schematic diagram of the software architecture of an electronic device 100 is shown.
[0212] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In one implementation, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0213] The application layer can include a series of application packages.
[0214] like Figure 2B As shown, the application package may include applications such as camera, calendar, music, navigation, SMS, search, gallery, negative one screen, and browser. The search application provides search functionality. Search can be a standalone application or a functional component encapsulated in other applications such as a browser; this application does not limit this. In this application, the application package can also be replaced with other forms of software such as mini-programs. The following embodiments illustrate this using a browser application that integrates a search functional component as an example.
[0215] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0216] like Figure 2B As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0217] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0218] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0219] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0220] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).
[0221] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0222] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0223] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.
[0224] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0225] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0226] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0227] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0228] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0229] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0230] A 2D graphics engine is a graphics engine for 2D drawing.
[0231] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0232] The following example, using a web search scenario, illustrates the workflow of the software and hardware of electronic device 100.
[0233] When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, etc.). The raw input event is stored in the kernel layer. The application framework layer retrieves the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking a single touch operation as an example, where the corresponding control is the browser application's search control, the browser calls the application framework layer's interface to perform a search based on the keywords entered by the user in the browser's search box control. Then, it calls the kernel layer to start the display driver and displays the list of search results on the display screen 194. The user can interact with any webpage card in the list to view the detailed content of the corresponding webpage and obtain content matching their search intent.
[0234] The following describes the application scenarios involved in the embodiments of this application and the user interface diagrams in these scenarios.
[0235] Figure 3 An exemplary user interface diagram of a web page search process is shown.
[0236] like Figure 3 As shown in (A), the electronic device 100 can display a browser user interface 310. The user interface 310 may include a search bar 311 and a search control 312, wherein the search bar 311 is used to receive keywords entered by the user, and the search control 312 is used to trigger a search operation for the keywords in the search bar 311. The electronic device 100 can receive the keyword "Xi'an travel routes" entered by the user in the search bar 311, and then receive a touch operation (e.g., a click operation) on the search control 312. In response to the touch operation, it searches for at least one webpage related to the aforementioned keyword and sorts these at least one webpage. The electronic device 100 can display the sorted webpages, as detailed in [reference needed]. Figure 3 The user interface 320 shown in (B) is shown.
[0237] like Figure 3As shown in (B), the user interface 320 may include a search bar 321 and a list of web pages. The search bar 321 displays the currently searched keyword "Xi'an travel routes". The user interface 320 displays summary information (referred to as web page cards) of the top three web pages in the web page list, in the following order from top to bottom: web page card 322, web page card 323, and web page card 324, where: web page card 322 indicates web page 1 with the title "Xi'an Travel Route Map", URL "URL 111", and source "Source aaa". Web page card 323 indicates web page 2 with the title "Xi'an Travel Routes - Guide", URL "URL 222", and source "Source bbb". Web page card 324 indicates web page 3 with the title "Xi'an Travel Complete Guide", URL "URL 3333", and source "Source ccc". The navigation bar at the bottom of the user interface 320 includes a card control 325. The card control 325 triggers the display of a semantic aggregation card set. This semantic aggregation card set includes, for example, content from web pages 1, 2, and 3 related to the search keyword "Xi'an travel routes," but excludes content from web pages 1, 2, and 3 unrelated to the search keyword "Xi'an travel routes." This is not limited to... Figure 3 The card control 325 in the user interface 320 shown in (B) triggers the display of the semantic convergence card set. In other examples, the display of the semantic convergence card set can also be triggered by user input gestures or voice. This application does not limit the way the semantic convergence card set is triggered.
[0238] The touch operations in the following examples include, but are not limited to: single click, double click, long press, single-finger long press, multi-finger long press, single-finger swipe (including single-finger drag), multi-finger swipe (including multi-finger drag), or knuckle swipe.
[0239] In one implementation, on Figure 3 After the operation shown, the electronic device 100 can receive signals targeting... Figure 3 Touch operations (e.g., click operations) on the card control 325 in the user interface 320 shown in (B) respond to the touch operation by displaying a semantic aggregation card set. See the example below. Figure 4 The user interface shown.
[0240] Understandably, a webpage can include multiple types of content, such as text, images, videos, and audio. In one implementation, any card in the semantic convergence card set can include only one type of content; for example, one card may include a static image, and another card may include a dynamic image. In another implementation, any card in the semantic convergence card set can include multiple different types of content; for example, one card may include both text and images.
[0241] Figure 4 Taking a semantic convergence card set consisting of three cards as an example, these three cards respectively include web page content of text, image, and video types (which can be referred to as text cards, image cards, and video cards, respectively). In specific implementations, the semantic convergence card set may include more or fewer cards. For example, the semantic convergence card set may only include text cards, or it may only include image cards and video cards. This application does not limit this.
[0242] In one implementation, the semantic convergence card set includes cards that are user-defined, such as the following: Figure 5B The example shown is illustrated below. In another implementation, the semantic convergence card set includes cards generated by the electronic device based on webpage content. For example, since webpages 1, 2, and 3 do not contain text content related to the search keyword "Xi'an travel routes," the semantic convergence card set only includes image cards and video cards.
[0243] like Figure 4As shown in (A), the electronic device 100 can display a browser user interface 410. The user interface 410 is used to display text cards (for displaying text-type webpage content) from a semantic convergence card set. The user interface 410 may include a title 411, text cards 412, page options 413, a save control 414, and a add control 415. The title 411 is used to display the currently searched keyword "Xi'an travel routes". The text card 412 includes a title ("text card") and multiple text contents. According to the similarity to the keyword "Xi'an tourist routes" from highest to lowest, the multiple text contents displayed in text card 412 are arranged from top to bottom as follows: text content 4121 ("Popular tourist routes include..."), text content 4122 ("Tourist route: Xicang - Muslim Quarter..."), and text content 4123 ("Attraction route one: Shaanxi History Museum - Bell and Drum Tower..."). The source information 4121A in text card 412 indicates that text content 4121 is included in webpage 1 with URL "URL 111" and source "source aaa". The source information 4122A in text card 412 indicates that text content 4122 is included in webpage 3 with URL "URL 333" and source "source ccc". The source information 4123A in text card 412 indicates that text content 4123 is included in webpage 2 with URL "URL 222" and source "source bbb". Page option 413 includes three options (represented by three circles), where the first option is selected (represented by a black circle), and the other two options are unselected (represented by white circles). This indicates that the semantic convergence card set includes three cards, and that text card 412 is the first card in the semantic convergence card set. The save control 414 is used to trigger saving the semantic convergence card set. The add control 415 is used to trigger creating a new card in the semantic convergence card set.
[0244] The electronic device 100 can receive swipe operations on the text card 412, such as swiping up and down or swiping left and right. Figure 4 This is illustrated using an example of a right-to-left swipe operation. The electronic device 100 responds to this swipe operation by displaying... Figure 4 User interface 420 is shown in (B). User interface 420 and Figure 4Similar to the user interface 410 shown in (A), the difference is that user interface 420 is used to display image cards (for displaying image-type web page content) in the semantic convergence card set. Image cards 421 in user interface 420 include a title (“Image Card”) and multiple image contents, such as image content 4211 and image content 4212. Source information 4211A in user interface 420 indicates that image content 4211 is an image included in web page 1 with URL “URL 111” and source “source aaa”, and source information 4212A in user interface 420 indicates that image content 4212 is an image included in web page 2 with URL “URL 222” and source “source bbb”. The second option in page options 413 of user interface 420 is selected, while the other two options are unselected, indicating that image card 421 is the second card in the semantic convergence card set.
[0245] The electronic device 100 can receive swiping operations on the image card 421, such as swiping up and down or swiping left and right. Figure 4 This is illustrated using an example of a right-to-left swipe operation. The electronic device 100 responds to this swipe operation by displaying... Figure 4 User interface 430 is shown in (C). User interface 430 and Figure 4 Similar to the user interface 410 shown in (A), the difference is that user interface 430 is used to display video cards (for displaying web page content of video type) in the semantic convergence card set. The video card 431 in user interface 430 includes a title (“Video Card”) and multiple video contents, such as video content 4311 and video content 4312. Source information 4311A in user interface 430 indicates that video content 4311 is a video included in web page 2 with URL “URL 222” and source “source bbb”, and source information 4312A in user interface 430 indicates that video content 4312 is a video included in web page 1 with URL “URL 111” and source “source aaa”. The third option in page options 432 of user interface 430 is selected, while the other two options are unselected, indicating that video card 431 is the third card in the semantic convergence card set.
[0246] In one implementation, the semantic convergence card set may include all or part of the search results. For example, the image cards in the semantic convergence card set may include all or part of the images in the search results. For instance, suppose the search results are... Figure 3 The aforementioned webpages 1, 2, and 3, Figure 4 The text card 412 in the user interface 410 shown in (A) can include the text content from these three web pages. Figure 4 The image card 421 in the user interface 420 shown in (B) only includes the image content from webpages 1 and 2, and does not include the image content from webpage 3. Figure 4 The video card 431 in the user interface 430 shown in (C) only includes video content from web pages 1 and 2, excluding video content from web page 3. In some examples, the image and video content from web page 3 has low relevance to the search keywords; therefore, the image card 421 does not include image content from web page 3, and the video card 431 does not include video content from web page 3.
[0247] Not limited to above Figure 4 In some other examples, the semantic convergence card set shown may not display information about the webpage to which the webpage content in the semantic convergence card set belongs. For example, Figure 4 The text card 412 in the user interface 410 shown in (A) does not include: source information 4121A indicating the webpage 1 to which the text content 4121 belongs. This application does not limit the specific display method of the semantic convergence card set.
[0248] Not limited to the examples above, in other examples, the semantic convergence card set may include content extracted from more or fewer web pages. Electronic device 100 can extract the top N web pages from at least one web page retrieved by a search, and include the content related to the search keywords from these N web pages as the content of the semantic convergence card set, where N is a positive integer.
[0249] Not limited to the examples above, in another implementation, the semantic convergence card set may include content extracted from at least one webpage selected by the user that is related to the search keywords. For example, in the above... Figure 3 After the operation shown, the electronic device 100 can receive signals targeting... Figure 3 The touch operation (e.g., click operation) of the card control 325 in the user interface 320 shown in (B) responds to the touch operation, displaying a user interface for selecting a webpage. See the example below. Figure 5A The user interface 510 shown in (A) is shown.
[0250] like Figure 5A As shown in (A), the user interface 510 and Figure 3Similar to the user interface 320 shown in (B), the user interface 510 includes multiple webpage cards, such as webpage card 511 indicating webpage 1, webpage card 512 indicating webpage 2, and webpage card 513 indicating webpage 3. Each webpage card also displays a selection control, which is used to select the corresponding webpage (i.e., the webpage indicated by its corresponding webpage card) or deselect it. In the user interface 510, selection controls 511A and 513A are selected, while selection control 512A is unselected, indicating that webpage 1 corresponding to selection control 511A and webpage 3 corresponding to selection control 513A have been selected. The function bar at the bottom of the user interface 510 includes a select all control 514, a card control 515, and an exit control 516. The select all control 514 is used to select all webpages indicated by the webpage cards displayed in the user interface 510. Card control 515 is used to trigger the display of a semantic convergence card set, wherein the content of the semantic convergence card set is extracted from the web pages 1 and 3 selected by the user, and the content of the semantic convergence card set triggered by card control 325 in user interface 320 is extracted from at least one web page obtained from the search (taking the top three web pages 1, 2, and 3 as an example). Exit control 516 is used to exit the function of selecting web pages.
[0251] Electronic device 100 can receive touch operations (e.g., click operations) on card control 515, and in response to the touch operation, extract content related to the search keywords from the selected web pages 1 and 3, and use it as the content of a semantic aggregation card set. Electronic device 100 can display the semantic aggregation card set, for example, displaying... Figure 5A User interface 520 is shown in (B). User interface 520 and Figure 4 The user interface 410 shown in (A) is similar, except that the text content included in the text cards is different. The text card 521 in the user interface 520 includes the text content 4121 in the user interface 410, source information 4121A (indicating that the text content 4121 is text included in web page 1), text content 4122, and source information 4122A (indicating that the text content 4122 is text included in web page 3), but does not include the text included in web page 2 that the user has not selected (such as the text content 4123 in the user interface 410).
[0252] In one implementation, the card types, number of cards, and / or the amount of content included in the semantic convergence card set can be preset by the electronic device. In another implementation, the card types, number of cards, and / or the amount of content included in the semantic convergence card set can be determined by the electronic device in response to user actions. In some examples, on the... Figure 3After the operation shown, the electronic device 100 can receive signals targeting... Figure 3 (B) The touch operation (e.g., click operation) of the card control 325 in the user interface 320 shown in the diagram, in response to the touch operation, displays Figure 5B The user interface 530 is shown. In other examples, users can also access it via card settings. Figure 5B The user interface shown is 530.
[0253] like Figure 5BAs shown, the user interface 530 includes a settings interface 531, which includes a title ("Card Personalization Settings"), settings instructions 5311 ("You can set the type of card and the amount of content included in the card"), and multiple card options. These card options include, for example, options 5312 for text cards, 5313 for image cards, 5314 for video cards, 5315 for audio cards, and 5316 for document cards. Audio cards contain audio-type web page content, and document cards contain document-type web page content (e.g., Word, Excel, and PPT format documents). Each option displays a selection control, which is used to add the corresponding card to the semantic convergence card set or deselect it. Option 5312 is used as an example; other options are similar. The selection control 5312A displayed in option 5312 is used to add the corresponding text card to the semantic convergence card set or deselect it. When selection control 5312A is selected, option 5312 can also display content option 5312B. Content option 5312B includes the phrase "maximum of... text content," where the "..." displays setting control 5312C. The middle box in setting control 5312C displays the maximum number of text content items that the currently set text card can include. The left box in setting control 5312C increases the maximum number of text content items that the text card can include, and the right box in setting control 5312C decreases the maximum number of text content items that the text card can include. In user interface 530, the selection controls displayed in options 5312, 5313, and 5314 are all selected, while the selection controls displayed in options 5315 and 5316 are all unselected. This indicates that the current setting is to add the text card corresponding to option 5312, the image card corresponding to option 5313, and the video card corresponding to option 5314 to the semantic convergence card set. Furthermore, the setting control 5312C in option 5312 displays the number 3, indicating that the maximum number of contents included in the text card is set to 3; the setting control in option 5313 displays the number 2, indicating that the maximum number of contents included in the image card is set to 2; and the setting control in option 5314 displays the number 2, indicating that the maximum number of contents included in the video card is set to 2. The user interface 530 also includes a confirm control 5317 and a cancel control 5318, the cancel control 5318 being used to cancel the display of the semantic convergence card set. The electronic device 100 can receive a touch operation (e.g., a click operation) on the confirm control 5317, and in response to the touch operation, displays the semantic convergence card set set as described above, as detailed in [reference needed]. Figure 4 The semantic aggregation card set shown.
[0254] Not limited to the examples above, in other examples, settings interfaces such as the system settings interface of electronic device 100 and the settings interface of browser applications may also be displayed. Figure 5B The user interface shown is 530.
[0255] Not limited to the examples above, in other examples, it is also possible to use... Figure 3 The aforementioned methods, such as voice, gestures, and other triggers, are used to display the semantic aggregation card set. Figure 4 , Figure 5A and Figure 5B The user interface shown.
[0256] In one implementation, electronic device 100 displays a semantic convergence card set (e.g., displaying...). Figure 4 When the user interface 410 shown in (A) is active, it can receive a touch operation (e.g., a double-click operation) on any content in the semantic convergence card set. In response to the touch operation, the detailed content of the webpage to which the content belongs is displayed. See the example below. Figure 6 .
[0257] like Figure 6 As shown in (A), the electronic device 100 can display Figure 4 User interface 410, as shown in (A), contains source information 4121A indicating that text content 4121 is text included in webpage 1 with URL "URL 111" and source "source aaa". Electronic device 100 can receive touch operations (e.g., double-click) on text content 4121, and in response to such touch operations, displays detailed content of webpage 1 to which text content 4121 belongs. See [link to example]. Figure 6 User interface 600 is shown in (B). User interface 600 may include a search bar 601, which displays the URL and source "URL 111 (Source aaa)" of the currently displayed webpage 1. User interface 600 also includes the title 602 of webpage 1 ("Xi'an Tourist Route Map") and various types of content such as text and images. The text content 4121 targeted by the aforementioned touch operation is highlighted in user interface 600 (e.g., highlighted). Users can obtain information related to the aforementioned text content 4121 through user interface 600, such as its display position and context on webpage 1.
[0258] In one embodiment, the electronic device 100, in response to a touch operation on any content in the semantic convergence card set, displays web page content related to that content. Optionally, the web page content can be positioned within the web page to which it belongs. For example, the electronic device 100 can respond to an action on... Figure 25B Touch operations of associated content 2512B in the user interface 2530 shown are displayed. Figure 25C The user interface 2540 shown has related content 2512B positioned above the webpage 1 to which the related content 2512B belongs. Optionally, the webpage content can be highlighted within the webpage to which it belongs. For example, the electronic device 100 can respond to... Figure 4 Touch operation of text content 4121 in user interface 410 shown in (A) displays Figure 6 In the user interface 600 shown in (B), text content 4121 is highlighted on the webpage 1 to which text content 4121 belongs. For example, electronic device 100 can respond to an action on Figure 25B Touch operations of associated content 2512B in the user interface 2530 shown are displayed. Figure 25C The user interface 2540 shown here has related content 2512B highlighted in the webpage 1 to which related content 2512B belongs.
[0259] In one implementation, electronic device 100 displays a semantic convergence card set (e.g., displaying...). Figure 4 When the user interface 410 shown in (A) is received, a touch operation (e.g., an up or down drag operation, or a click operation) can be received for any card in the semantic convergence card set. In response to the touch operation, the card is deleted from the semantic convergence card set. See the example below. Figure 7A and Figure 7B .
[0260] In such Figure 7A In the example shown in (A), electronic device 100 can display Figure 4 The user interface 410 shown in (A) is used to display text cards 412 in the semantic convergence card set. The electronic device 100 can receive drag operations on the text cards 412, such as dragging up and down or swiping left and right. Figure 7A The following example illustrates the drag operation as a bottom-to-top drag. In response to this drag operation, electronic device 100 deletes text card 412 from the semantic convergence card set. At this time, other cards in the semantic convergence card set can be displayed, for example, showing... Figure 7A The user interface 700 shown in (B) is used to display the picture card 421 in the semantic convergence card set. Unlike the page options 413 in the user interface 410, which includes three options, the page options 701 in the user interface 700 include only two options, and the first option is selected. This indicates that the semantic convergence card set includes two cards, and that picture card 421 is the first of these two cards.
[0261] like Figure 7BAs shown in (A), the electronic device 100 can display Figure 4 The user interface 410 shown in (A) displays text cards 412 in a semantic convergence card set. When a card is editable, such as when a user selects an edit control or otherwise makes the card editable, a delete control 4124 is displayed in the text card 412. The electronic device 100 can receive a touch operation (e.g., a click operation) on the delete control 4124. In response to the touch operation, the text card 412 is deleted from the semantic convergence card set. At this time, other cards in the semantic convergence card set can be displayed, such as... Figure 7B User interface 700 shown in (B) is described in detail and Figure 7A The user interface shown in (B) is similar to that of 700. Figure 7B The user interface 700 shown in (B) may also display a delete control in the picture card 421, which is used to trigger the deletion of the picture card 421.
[0262] In one implementation, electronic device 100 displays a semantic convergence card set (e.g., displaying...). Figure 4 When the user interface 410 shown in (A) is received, a touch operation (e.g., a long press) can be received for any card in the semantic convergence card set. In response to the touch operation, a user interface for editing the card (hereinafter referred to as the editing interface) is displayed. For a specific example, see [link to example]. Figure 8 .
[0263] like Figure 8 As shown in (A), the electronic device 100 can display Figure 4 User interface 410 is shown in (A). Electronic device 100 can receive a long press operation on text card 412 in user interface 410, such as a single-finger long press or a two-finger long press, and in response to the long press operation, displays... Figure 8 User interface 800 is shown in (B). User interface 800 implements the editing function of text card 412. Each text content in text card 412 displayed in user interface 800 has a delete control. Taking text content 4121 as an example, other text content is similar. Text content 4121 displays a delete control 810, used to delete text content 4121 in text card 412. User interface 800 also includes a confirm control 820 and a cancel control 830. The confirm control 820 is used to save the current editing operation (i.e., save the text card 412 displayed in user interface 800), and the cancel control 830 is used to cancel the current editing operation (i.e., save the text card 412 before editing). Examples of the above editing operations can be found below. Figures 9-12 The editing operations shown.
[0264] In one implementation, on Figure 8 After the operation shown, the electronic device 100 can receive signals targeting... Figure 8 Touch operations (e.g., click operations) on the text content 4121 in the user interface 800 shown in (B) respond to the touch operation, displaying an editing interface for the text content 4121. See the example below for details. Figure 9 The user interface 910 shown in (A) is shown.
[0265] like Figure 9 As shown in (A), the user interface 910 is used to implement the editing function of the text content 4121 in the text card 412. A cursor 911 is displayed before the characters "Popular tourist routes include..." included in the text content 4121. The cursor 911 is used to indicate the insertion point for text editing. The electronic device 100 can receive characters input by the user and display those characters before the cursor 911. For example, the electronic device 100 can receive the characters "Solution 1:" input by the user and display... Figure 9 User interface 920 is shown in (B). The text content 4121 in the text card 412 shown in user interface 920 includes the characters “Option 1: Popular tourist routes include…”, where a cursor 911 is displayed between the characters “Option 1:” and the characters “Popular tourist routes include…”.
[0266] Not limited to the examples above, in other examples, electronic device 100 displays Figure 9 When the user interface 910 shown in (A) is in use, it can also delete characters included in the text content 4121 in response to user operation (e.g., voice input of "delete"). This application does not limit the specific editing method of any content in the card set.
[0267] In one implementation, on Figure 8 After the operation shown, the electronic device 100 can receive signals targeting... Figure 10 The user interface 800 shown in (A) is (i.e.) Figure 8 Touch operation (e.g., click operation) of the delete control 810 in the user interface 800 shown in (B) deletes the text content 4121 in the user interface 800 in response to the touch operation. At this time, the electronic device 100 can display Figure 10 The user interface 1000 shown in (B) includes text content 412 and text content 4123, but does not include text content 4121.
[0268] In one implementation, on Figure 8 After the operation shown, the electronic device 100 can receive signals targeting... Figure 8Touch operations (e.g., dragging down or up) on any text content in the user interface 800 shown in (B) adjust the display position of the text content in the text card (or adjust the arrangement order of the text content in the text card) in response to the touch operation. See the example below. Figure 11 .
[0269] like Figure 11 As shown in (A), the electronic device 100 can display Figure 8 The user interface 800 is shown in (B). The electronic device 100 can receive drag operations on the text content 4122 of the text card 412 shown in the user interface 800, such as dragging up and down or dragging left and right. Figure 11 The following example illustrates a drag-and-drop operation where a user drags text content 4122 from text card 412 on the user interface 800 upwards to the position of text content 4121. In response to this drag-and-drop operation, the electronic device 100 swaps the display positions of text content 4121 and text content 4122, at which point it can display... Figure 11 User interface 1100 is shown in (B). Figure 11 The arrangement of text content in user interface 800 shown in (A) is different (text content 4121 is displayed on top of text content 4122). In text card 412 shown in user interface 1100, text content 4122 is displayed on top of text content 4121. Not limited to the above example, in other examples, electronic device 100 may display user interface 1100 in response to a user operation that drags text content 4121 down to the position of text content 4122 in user interface 800.
[0270] In one implementation, on Figure 8 After the operation shown, the electronic device 100 can receive signals targeting... Figure 8 Touch operations (e.g., dragging left or right) on any text content in the user interface 800 shown in (B) adjust the display position of the text content in the semantic convergence card set in response to the touch operation. See [example example]. Figure 12 .
[0271] like Figure 12 As shown in (A), the electronic device 100 can display a user interface 1210, which may include... Figure 8 The text card 412 and preview card 1211 in the user interface 800 shown in (B) are, in one embodiment, the user interface 1210 may be an electronic device 100 responding to a request for Figure 8The drag operation of text content 4121 in user interface 800 shown in (B) is displayed in the user interface. For example, the drag operation is used to drag text content 4121 in user interface 800 to the right to the position where text content 4121 is located in user interface 1210. Preview card 1211 is used to indicate the image cards arranged in a semantic convergence card group after text card 412.
[0272] The electronic device 100 can receive drag operations applied to the text content 4121, such as dragging up and down or dragging left and right. Figure 12 The following example illustrates the drag operation as a user action of dragging towards the right edge of the screen (which can also be understood as a user action of dragging text content 4121 towards the location of preview card 1211). In response to this drag operation, electronic device 100 moves the text content 4121 to the image card indicated by preview card 1211 for display. See [link to specific example] for details. Figure 12 User interface 1220 is shown in (B). Figure 4 Unlike the picture card 421 in the user interface 420 shown in (B), the picture card 421 in the user interface 1220 includes not only picture content 4211 and picture content 4212 (not shown), but also text content 4121.
[0273] In one implementation, electronic device 100 displays a semantic convergence card set (e.g., displaying...). Figure 4 When the user interface 410 shown in (A) is received, a touch operation (e.g., a drag operation to the left or right) can be received for any card in the semantic convergence card set. In response to the touch operation, the card is merged with other cards into one card. See the example below. Figure 13 .
[0274] like Figure 13 As shown in (A), the electronic device 100 can display Figure 4 User interface 410 is shown in (A). Electronic device 100 can receive drag operations on text cards 412 in user interface 410, such as dragging up and down or dragging left and right. Figure 13 The following example illustrates a user action of dragging text card 412 towards the right edge of the screen. In response to this user action, electronic device 100 displays... Figure 13User interface 1310 is shown in (B). It should be noted that when the electronic device 100 displays user interface 1310, the user's finger is still touching the screen and positioned on text card 412. Text card 412 is located inside and displayed on top of image card 421 in user interface 1310. The electronic device 100 can respond to the user's release operation (i.e., the finger leaves the screen, which can be understood as part of the aforementioned drag operation) by merging text card 412 and image card 421, for example, moving the content of text card 412 onto image card 421 for display. At this time, it can display... Figure 13 User interface 1320 is shown in (C). User interface 1320 may include a new card 1321 and page options 1322. Page options 1322 are used to indicate that the semantic convergence card set includes two cards, and that the currently displayed new card 1321 is the first of these two cards. New card 1321 is the card obtained by merging text card 412 and picture card 421, and includes not only picture content 4211 and picture content 4212 in picture card 421, but also text content 4121, text content 4122 and text content 4123 in text card 412, as detailed in [link to documentation]. Figure 13 The user interface 1320 shown in (D) is shown. Figure 13 The user interface 1320 shown in (D) can be an electronic device 100 responding to a specific request. Figure 13 The user interface 1320 shown in (C) displays a swipe operation for the new card 1321, such as a left-right swipe or a up-down swipe. Figure 13 The following is an example of a sliding operation that is slid from bottom to top.
[0275] Not limited to the examples above, in other examples, on Figure 8 Following the operation shown, the electronic device 100 can receive a touch operation (e.g., a drag operation to the left or right) on any card in the semantic convergence card set. In response to the touch operation, the display position of the card in the semantic convergence card set is adjusted. This can be understood as, when the electronic device displays a card editing interface, the display position of the card is adjusted in response to a touch operation on that card. For example, the electronic device 100 can respond to... Figure 8 The user operation of dragging the text card 412 to the right in the user interface 800 shown in (B) switches the display positions of the text card 412 and the picture card 421. At this time, the picture card 421 is the first card and the text card 412 is the second card.
[0276] Not limited to the examples above, in other examples, when the electronic device displays the card editing interface, in response to a touch operation (e.g., dragging left or right) on the card, the card can be merged into a single card with other cards; when the electronic device displays the semantic convergence card set, in response to a touch operation (e.g., dragging left or right) on any card in the semantic convergence card set, the display position of that card in the semantic convergence card set can be adjusted. This application does not limit the user operation that triggers the adjustment of the card.
[0277] In one implementation, electronic device 100 displays a semantic convergence card set (e.g., displaying...). Figure 4 When the user interface 410 shown in (A) is accessed, it can receive touch operations (e.g., click operations) for the newly added control 415. In response to the touch operation, a new card is created in the semantic convergence card set. See the example below. Figure 14 .
[0278] like Figure 14 As shown in (A), the electronic device 100 can display Figure 4 User interface 410 is shown in (A). Electronic device 100 can receive touch operations (e.g., click operations) on newly added controls 415 in user interface 410, and in response to the touch operation, create a new card without any content, at which time it can be displayed. Figure 14 User interface 1400 is shown in (B). User interface 1400 may include card 1410 and page options 1420. Card 1410 may include a title (“Custom Card 1”) and an add control 1410A for adding content to card 1410. Unlike page options 413 (which includes three options) in user interface 410, page options 1420 includes four options, with the fourth option being selected. This indicates that the semantic convergence card set includes four cards, and that the currently displayed card 1410 is the fourth card among these four cards.
[0279] In one implementation, on Figure 14 After the operation shown, the electronic device 100 can receive signals targeting... Figure 14 (B) shows the addition of a touch operation (e.g., a click operation) to the user interface 1400 of the control 1410A, in response to the touch operation, displaying Figure 15 The user interface 1510 shown in (A) is shown.
[0280] like Figure 15 As shown in (A), the user interface 1510 includes a title 1511 (“Custom Card 1”) that instructs the user interface 1510 to add content to a card titled “Custom Card 1” (hereinafter referred to as Custom Card 1), which is... Figure 14 The user interface 1400 shown in (B) contains card 1410. User interface 1510 also includes a confirmation control 1512 and multiple card options. These multiple card options include, for example, option 1513 for text cards, option 1514 for picture cards, and option 1515 for video cards. The selection control displayed in any of these options is used to select whether to add the content of the corresponding card to the custom card 1 or to deselect it. In user interface 1510, selection controls 1513A in option 1513 and 1514A in option 1514 are selected, while selection control 1515A in option 1515 is unselected, indicating that the current selection is to add the content of the text and picture cards to the custom card 1. The confirmation control 1512 is used to trigger the addition of the selected card's content to the custom card 1.
[0281] The electronic device 100 can receive touch operations (e.g., click operations) on a specified control 1512, and in response to the touch operation, display... Figure 15 User interface 1520 is shown in (B). Cards 1410 in user interface 1520 include: selected text cards (i.e....) Figure 4 The text content 1521A included in the text card 412 of the user interface 410 shown in (A), and the selected picture card (i.e. Figure 4 The text card 421) in the user interface 420 shown in (B) includes image content 1521B, but does not include video content included in unselected video cards. The card 1410 in the user interface 1520 also includes an add control 1410A, which can be used to continue adding content to the card 1410.
[0282] Not limited to the examples above, in other examples, card 1410 in user interface 1520 can also be replaced with Figure 13 The new card 1321 in the user interface 1320 shown in (C) and (D) (the title should be changed to "Custom Card 1" at this time), similarly, Figure 13 The new card 1321 in user interface 1320 shown in (C) and (D) can also be replaced with card 1410 in user interface 1520 (in which case the title needs to be changed to "New Card").
[0283] In one implementation, on Figure 14 After the operation shown, the electronic device 100 can receive signals targeting... Figure 14 (B) shows the addition of a touch operation (e.g., a click operation) to the user interface 1400 of the control 1410A, in response to the touch operation, displaying Figure 16 The user interface 1610 shown in (A) is shown.
[0284] like Figure 16 As shown in (A), the user interface 1610 includes a header 1611 (“Custom Card 1”), the user interface 1610 and Figure 15 Similar to the user interface 1510 shown in (A), both are used to add content to custom card 1. The difference is that user interface 1610 can also add any one of the contents included in the card to custom card 1. User interface 1610 includes a confirmation control 1612 and multiple card options, such as option 1613 for text cards, option 1614 for image cards, and option 1615 for video cards. Each option displays at least one of the contents included in the corresponding card, as well as a selection control for each content. Each selection control is used to add the corresponding content to custom card 1 or deselect the selection. Option 1613 is used as an example; the other options are similar. Option 1613 displays text content 4121, text content 4122, and text content 4123 included in the text card, as well as selection controls corresponding to these three text contents, such as selection control 1613A for text content 4121. In the user interface 1610, the selection control 1613A corresponding to the text content 4121 and the selection control 1614A corresponding to the image content 4211 in the option 1614 of the image card 421 are selected, while other selection controls are unselected. This indicates that the current selection is to add the text content 4121 and the image content 4211 to the custom card 1.
[0285] The electronic device 100 can receive touch operations (e.g., click operations) on a specified control 1612, and in response to the touch operation, display... Figure 16 User interface 1620 is shown in (B). Card 1410 in user interface 1620 includes the selected text content 4121 and the selected image content 4211, but does not include other unselected content. Card 1410 in user interface 1620 also includes an add control 1410A, which can be used to continue adding content to card 1410.
[0286] Not limited to the examples above, in other examples, it can also be done according to Figure 15 or Figure 16 The operation shown adds content to text cards, image cards, and video cards in the semantic convergence card set.
[0287] Not limited to the above embodiments, in another embodiment, the electronic device 100 displays a semantic convergence card set (e.g., displays...). Figure 4 When the user interface 410 shown in (A) is displayed, it can receive touch operations (e.g., click operations) for the newly added control 415, and in response to the touch operation, display Figure 15(A) or Figure 16 The content selection interface shown in (A) allows the electronic device 100 to generate a new card based on the webpage content selected by the user from the content selection interface, for example... Figure 15 Card 1410 in the user interface 1520 shown in (B), or Figure 16 Card 1410 in the user interface 1620 shown in (B).
[0288] In one implementation, on Figure 14 Following the operation shown, the electronic device 100 can receive a touch operation (e.g., a drag operation to the left or right) on any content in the card, and in response to the touch operation, move the content to... Figure 14 (B) shows the card 1410 in the user interface 1400, for example, see [link to example]. Figure 17A .
[0289] like Figure 17A As shown in (A), the electronic device 100 can display Figure 12 The user interface 1210 shown in (A) includes text cards 412 containing text content 4121. The electronic device 100 can receive drag operations applied to the text content 4121, such as horizontal or vertical dragging. Figure 17A The following example illustrates the drag operation, where the text content 4121 is dragged towards the right edge of the screen. In response to this drag operation, the electronic device 100 moves the text content 4121 to... Figure 14 (B) shows the card 1410 in the user interface 1400, for example, see [link to example]. Figure 17A User interface 1710 is shown in (B). Cards 1410 in user interface 1710 include text content 4121 and an add control 1410A, which, for example, is used to... Figure 15 or Figure 16 The method shown adds content to card 1410.
[0290] Not limited to Figure 17A In another implementation, as shown in the example, the semantic convergence card group can also move multiple contents from the same card or different cards to... Figure 14 (B) shows the card 1410 in the user interface 1400, for example, see [link to example]. Figure 17B .
[0291] like Figure 17B As shown in (A), the electronic device 100 can display a user interface 1720, and the user interface 1720 and Figure 8Similar to the user interface 800 shown in (B), the difference is that in the user interface 1720, any text content of the text card 412 includes a selection control. In the user interface 1720, the selection control 1721 displayed in the text content 4121 is in a selected state, while the selection controls displayed in the text content 4122 and the text content 4123 are in an unselected state, which can indicate that the text content 4121 is currently selected.
[0292] Electronic device 100 can also display Figure 17B User interface 1730 is shown in (B). User interface 1730 is similar to user interface 1720, except that user interface 1730 is used to implement the editing function of image card 421. In user interface 1730, the selection control 1731 displayed in image content 4211 is in a selected state, while the selection control displayed in image content 4212 is in a deselected state, indicating that image content 4211 is currently selected.
[0293] The electronic device 100 can receive touch operations on the image content 4211 in the user interface 1730, such as dragging left or right or dragging up or down. Figure 17B The following example illustrates the touch operation of dragging image content 4211 towards the right edge of the screen. In response to this touch operation, the electronic device 100 moves the selected text content 4121 and image content 4211 to... Figure 14 (B) shows the card 1410 in the user interface 1400, for example, see [link to example]. Figure 17B The user interface 1740 is shown in (C). The card 1410 in the user interface 1740 includes the aforementioned selected text content 4121 and image content 4211, and also includes an add control 1410A, which is used, for example, for... Figure 15 or Figure 16 The method shown adds content to card 1410.
[0294] In one implementation, electronic device 100 displays a semantic convergence card set (e.g., displaying...). Figure 4 When the user interface 410 shown in (A) is in use, it can receive a touch operation (e.g., a click operation) on the save control 414, and in response to the touch operation, save the semantic aggregation card set. See below for a specific example. Figure 18 .
[0295] like Figure 18 As shown in (A), the electronic device 100 can display Figure 4 User interface 410 is shown in (A). Electronic device 100 can receive touch operations (e.g., click operations) on save control 414 in user interface 410, and in response to the touch operation, display Figure 18 User interface 1800 is shown in (B). User interface 1800 is used to select the display location of the entry point for secondary loading of the semantic convergence card set. The prompt box 1810 in user interface 1800 includes a title ("Display Location") and multiple display location options, such as option 1811 in the browser's favorites, option 1812 on the desktop, option 1813 on the negative one screen, and option 1814 in the gallery. The selection control displayed in any option is used to select whether to save the semantic convergence card set to the display location corresponding to that option or to deselect the option. In user interface 1800, the selection control 1811A displayed in option 1811, selection control 1812A displayed in option 1812, selection control 1813A displayed in option 1813, and selection control 1814A displayed in option 1814 are all selected, which can indicate that the current selection is to save the semantic convergence card set to the browser application's favorites, desktop, negative one screen application, and gallery application. Understandably, more or fewer selection controls can be selected. The user interface 1800 also includes a confirm control 1815 and a cancel control 1816, the cancel control 1816 being used to cancel saving the semantic convergence card set. The electronic device 100 can receive a touch operation (e.g., a click operation) on the confirm control 1815, and in response to the touch operation, save the semantic convergence card set to the selected display location.
[0296] In one implementation, on Figure 18 After the operations shown, users can view the semantic convergence card set again through their browser application's bookmarks. See the example below. Figure 19A .
[0297] like Figure 19A As shown in (A), the electronic device 100 can display a browser user interface 1910. A navigation bar at the bottom of the user interface 1910 may include a control 1911, which is used to trigger the opening of the favorites list. The electronic device 100 can receive touch operations (e.g., click operations) on the control 1911 and, in response to the touch operation, display... Figure 19A User interface 1920 is shown in (B). User interface 1920 includes a title 1921 (“Favorites”) and a collection list 1922, which includes, for example, options 1922A for collection card sets and options for multiple collection web pages. Option 1922A includes the character “Xi’an Tourist Routes” as the title of the collection card set. Electronic device 100 can receive a touch operation (e.g., a click operation) on option 1922A, and in response to the touch operation, displays the specific content of the collection semantic aggregation card set, for example, displaying… Figure 19A The user interface 410 shown in (C) is (i.e.) Figure 4(A) shows the user interface 410.
[0298] Not limited to Figure 19A In another implementation, as in the example case, electronic device 100 may respond to a request for... Figure 19A Touch operation (e.g., click operation) of control 1911 in user interface 1910 shown in (A), in response to the touch operation, displays Figure 19B The user interface 1930 is shown. User interface 1930 includes multiple page options, such as page option 1931, page option 1932, and page option 1933. Page option 1931 triggers the display of a list of saved web pages, page option 1932 triggers the display of a list of saved card sets, and page option 1933 triggers the display of a list of other saved content. Page option 1932 in user interface 1930 is selected, indicating that a list 1934 of saved card sets is currently displayed. List 1934 includes, for example, option 1934A indicating a card set titled "Xi'an Travel Routes" and an option indicating a card set titled "Wuhan Travel Routes." Electronic device 100 can respond to a touch operation (e.g., a click operation) on option 1934A to display the specific content of the corresponding card set, such as displaying... Figure 4 The user interface 410 shown in (A) is shown.
[0299] In one implementation, on Figure 18 After the operations shown, users can view the semantic convergence card set again on the desktop. See the example below. Figure 20 .
[0300] like Figure 20 As shown in (A), the electronic device 100 can display a user interface 2010, for example, a desktop. Controls 2011 in the user interface 2010 are used to indicate a collection of cards. Controls 2011 include a title 2011A, application information 2011B, card controls 2011C, and page-turning controls 2011D. The title 2011A includes the characters "Xi'an Tourist Routes," which is the title of the collection of cards. The application information 2011B indicates that the collection of cards belongs to a browser application. The card controls 2011C are used to display text cards (i.e.,...) from the collection of cards. Figure 4 (A) shows the text card 412 in the user interface 410. The page-turning control 2011D is used to trigger a switch of the card type displayed in the card control 2011C. The control 2011 can switch the card type displayed in the card control 2011C at preset intervals; for example, after 5 seconds, the electronic device 100 can display... Figure 20User interface 2020 (B) is shown. Card control 2011C in control 2011 shown in user interface 2020 is used to display picture cards in the collected card set (i.e., Figure 4 (B) shows the picture card 421 in the user interface 420. The electronic device 100 can receive touch operations (e.g., click operations) on the control 2011 in the user interface 2010 or user interface 2020, and in response to the touch operation, display the specific content of the favorite semantic aggregation card set, such as displaying Figure 20 The user interface 410 shown in (C) is (i.e.) Figure 4 (A) shows the user interface 410.
[0301] The electronic device 100 can receive touch operations on the controls 2011 in the user interface 2010 or user interface 2020, such as left-right or up-down swipes. Figure 20 The following example illustrates the touch operation as a swipe from right to left. In response to this touch operation, the electronic device 100 displays a collection of other semantic aggregation cards, such as... Figure 20 User interface 2030 is shown in (D). User interface 2030 is similar to user interface 2010, except that the collection of cards indicated by control 2011 is different. In user interface 2030, the title 2031A in control 2011 includes the characters "Wuhan Tourist Routes", which is the title of the currently displayed card set. Card control 2031B in control 2011 is used to display the text cards in that card set.
[0302] In some examples, electronic device 100 can receive signals targeting... Figure 20 Touch operations (e.g., click operations) on the card control 2011C (for displaying text cards) in the user interface 2010 shown in (A) respond to the touch operation by displaying the text card, for example, displaying Figure 4 The user interface 410 shown in (A). In other examples, the electronic device 100 can receive signals for... Figure 20 In the user interface 2020 shown in (B), a touch operation (e.g., a click operation) of the card control 2011C (for displaying picture cards) displays the picture card in response to the touch operation, for example, displaying... Figure 4 User interface 420 is shown in (B). That is, the electronic device 100 may display different cards in response to different user operations on card controls. Similarly, the electronic device 100 may also display the video card in response to a touch operation (e.g., a click operation) on a card control used to display a video card, for example, displaying... Figure 4 The user interface 430 shown in (C) is shown.
[0303] In one implementation, on Figure 18 After the operation shown, users can view the semantic convergence card set again through the negative one screen application. See the example below. Figure 21 .
[0304] like Figure 21 As shown in (A), the electronic device 100 can display a user interface 2110 for an application on the negative one screen. The user interface 2110 may include multiple functional controls (such as controls for scanning, transit codes, payment codes, and health codes), application usage cards, parking status cards, and control 2111. Control 2111 and... Figure 20 Similar to control 2011 in user interface 2010 shown in (A), both are used to indicate a collection of cards and are currently used to display text cards in that collection. Control 2111 also includes page-turning control 2111A, which the electronic device 100 can receive touch operations (e.g., click operations) on page-turning control 2111A and, in response to the touch operation, display... Figure 21 User interface 2120 is shown in (B). Controls 2111 and... Figure 20 Similar to control 2011 in the desktop 2020 shown in (B), both are used to indicate a collection of cards and are currently used to display the image cards in that collection. Electronic device 100 can receive touch operations (e.g., click operations) on control 2111 in user interface 2110 or user interface 2120, and in response to such touch operations, display the specific content of the collection of semantically aggregated cards, such as displaying... Figure 21 The user interface 410 shown in (C) is (i.e.) Figure 4 (A) shows the user interface 410.
[0305] In some examples, electronic device 100 can receive touch operations on controls 2111 in user interface 2110 or user interface 2120, such as swiping left or right or up or down, and in response to the touch operation, display a collection of other semantic aggregation cards, for example, in the user interface of a negative one screen application. Figure 20 The control 2011 in the user interface 2030 shown in (D). Figure 21 The example shown and Figure 20 Similar to the example shown, when the card type displayed by the card control targeted by the user operation is different, the electronic device 100 may display different cards in response to the user operation. See the specific example below. Figure 20 The example shown will not be repeated.
[0306] Figure 20 Let's take the example of switching the displayed cards based on time to illustrate this. Figure 21Taking the switching of the cards displayed in the card control based on the touch operation of the page-turning control as an example, in other examples, the electronic device 100 can also switch the cards displayed in the card control in response to the swiping operation of the card control (such as swiping left or right or up or down). This application does not limit the specific triggering method.
[0307] Not limited to the examples above, in other examples, electronic device 100 may also be displayed in the user interface of other applications (such as the homepage or favorites interface of a browser application). Figure 20 The control shown is 2010, and / or the control above. Figure 21 The control 2111 shown is (for example, it can be understood as a widget that indicates the collection of cards).
[0308] In one implementation, on Figure 18 After the operations shown, users can view the semantic convergence card set again through the gallery application. See the example below. Figure 22 .
[0309] like Figure 22 As shown in (A), the electronic device 100 can display a user interface 2210 for a gallery application, which may include thumbnails of multiple images. The electronic device 100 can receive touch operations (e.g., click operations) on thumbnails 2211 among the multiple thumbnails, and in response to the touch operation, display the original image corresponding to the thumbnail 2211, for example, displaying... Figure 22 User interface 2220 is shown in (B). Image 2221 in user interface 2220 is used to indicate a collection of cards. Image 2221 includes a title 2221A, an image 2221B, and a QR code 2221C. The title 2221A includes the characters "Xi'an Tourist Routes," the title of the collection of cards. Image 2221B is the cover of the collection of cards (the first image included in the image cards of the collection, i.e....). Figure 4 (Taking the image content 4211 included in the image card 421 of the user interface 420 shown in (B) as an example), the QR code 2221C can include identification information of the collected card set to indicate the card set. The function bar at the bottom of the user interface 2220 includes an image recognition control 2222. The electronic device 100 can receive touch operations (e.g., click operations) on the image recognition control 2222, and in response to the touch operation, recognize the image 2221, such as recognizing the QR code 2221C in the image 2221. The electronic device 100 can display the recognition result, that is, the specific content of the semantic aggregation card set indicated by the image 2221, for example, displaying... Figure 22 The user interface 410 shown in (C) is (i.e.) Figure 4 (A) shows the user interface 410.
[0310] Not limited to the examples above, in other examples, users can also use the scan function of an electronic device to scan the image 2221, for example, to recognize the QR code 2221C within it, and display the specific content of the recognized semantic aggregation card set, for example, displaying... Figure 4 The user interface 410 shown in (A) does not limit the specific method of image recognition in this application.
[0311] The entry point for the secondary loading of the semantic aggregation card set is not limited to the example above. In other examples, the entry point for the secondary loading of the semantic aggregation card set can also be displayed in other applications such as Notepad. This application does not limit this.
[0312] In one implementation, on Figure 3 After the operation shown, the electronic device 100 can receive signals targeting... Figure 3 Touch operation (e.g., click operation) of any web page card in the user interface 320 shown in (B) responds to the touch operation by displaying the specific content of the web page indicated by the web page card. See the example below for details. Figure 23 .
[0313] like Figure 23 As shown in (A), the electronic device 100 can display Figure 3 The user interface 320 shown in (B) includes a list of web pages, for example, web page card 322 (indicating web page 1), web page card 323 (indicating web page 2), and web page card 324 (indicating web page 3). The electronic device 100 can receive a touch operation (e.g., a click operation) on web page card 322, and in response to the touch operation, displays the specific content of web page 1 indicated by web page card 322 (titled "Xi'an Tourist Route Map," URL "URL 111," and source "Source aaa"). See [link to documentation] for details. Figure 23 User interface 2300 is shown in (B). User interface 2300 and Figure 6 The user interface 600 shown in (B) is similar, except that the text content 4121 in user interface 600 is not highlighted in user interface 2300. Both card control 325 in user interface 320 and card control 2310 in user interface 2300 are used to trigger the display of a semantic convergence card set, but the triggered semantic convergence card sets can be different. Specifically, the semantic convergence card set triggered by card control 325 includes content extracted from at least one webpage obtained from the search, while the semantic convergence card set triggered by card control 2310 includes content extracted from webpage 1 selected by the user.
[0314] In one implementation, on Figure 23 After the operation shown, the electronic device 100 can receive signals targeting... Figure 23 Touch operations (e.g., click operations) on the card control 2310 in the user interface 2300 shown in (B) respond to the touch operation by displaying a semantic aggregation card set, as detailed in [reference]. Figure 24 The user interface shown.
[0315] Figure 24 and Figure 4 Similarly, both are used to display semantic convergence card sets, the difference being that... Figure 4 The semantic convergence card set shown includes content extracted from the top three search results: webpage 1, webpage 2, and webpage 3. Figure 24 The semantic convergence card set shown includes content extracted from webpage 1 selected by the user. The following is a description... Figure 24 The main introduction Figure 24 and Figure 4 For further details regarding the differences, please refer to the following explanations. Figure 4 Explanation.
[0316] like Figure 24 As shown in (A), the electronic device 100 can display a browser user interface 2410. The user interface 2410 may include the title 2411 (“Xi’an Tourist Route Map”), URL information, and source information 2412 (“URL 111 Source aaa”) of the webpage 1 selected by the user. The user interface 2410 is used to display text cards 2413 in a semantic convergence card set. The text cards 2413 include multiple text contents related to the search keywords in the webpage 1, such as text content 2413A (“Popular tourist routes include”), text content 2413B (“When going to Xi’an, you must visit the Mausoleum of the First Qin Emperor... The ticket price for the Mausoleum of the First Qin Emperor is 120 yuan... The transportation fee to the Mausoleum of the First Qin Emperor is 20 yuan...)” and text content 2413C (“Popular attractions in Xi’an…”), where text content 2413C is not listed in the search results. Figure 23 The user interface 2300 shown in (B) is illustrated.
[0317] The electronic device 100 can receive swipe operations on the text card 2413, such as vertical or horizontal swipes. Figure 24 This is illustrated using an example of a right-to-left swipe operation. The electronic device 100 responds to this user operation by displaying... Figure 24 User interface 2420 is shown in (B). User interface 2420 and Figure 24 Similar to the user interface 2410 shown in (A), except that the user interface 2420 is used to display image cards 2421 in the semantic convergence card set, which include image content related to the search keywords in webpage 1.
[0318] The electronic device 100 can receive swiping operations on the picture card 2421, such as swiping up and down or swiping left and right. Figure 24 This is illustrated using an example of a right-to-left swipe operation. The electronic device 100 responds to this user operation by displaying... Figure 24 User interface 2430 is shown in (C). User interface 2430 and Figure 24 Similar to the user interface 2410 shown in (A), except that the user interface 2430 is used to display video cards 2431 in the semantic convergence card set, which include video content related to the search keywords in webpage 1.
[0319] In one embodiment, the electronic device 100 displays the specific content of the webpage 1 (e.g., displays...). Figure 23 When the user interface 2300 shown in (B) is active, it can receive touch operations (e.g., long press) on any content in webpage 1, and in response to the touch operation, select the content. For a specific example, see [link to example]. Figure 25A The user interface 2300 shown in (A) is shown.
[0320] like Figure 25A As shown in (A), the electronic device 100 can display Figure 23 User interface 2300 is shown in (B). User interface 2300 may include text 2320 ("When you go to Xi'an, you must visit the Mausoleum of the First Qin Emperor... The ticket price for the Mausoleum of the First Qin Emperor is 120 yuan... The transportation fee to the Mausoleum of the First Qin Emperor is 20 yuan..."), where the text "Mausoleum of the First Qin Emperor" is selected. The above touch operation can be understood as a user operation to select the text "Mausoleum of the First Qin Emperor" in webpage 1. A function list 2330 may be displayed near the text "Mausoleum of the First Qin Emperor" in user interface 2300. Function list 2330 may include multiple function options for the selected text "Mausoleum of the First Qin Emperor", such as options for copying, searching, saving 2330A, and viewing more functions. Electronic device 100 can receive a touch operation (e.g., a click operation) for the save option 2330A, and in response to the touch operation, add the selected text "Mausoleum of the First Qin Emperor" and related text to a new card in the semantic convergence card set, at which time it can be displayed. Figure 25A The user interface 2510 shown in (B) is shown.
[0321] like Figure 25AAs shown in (B), the user interface 2510 may include title information 2511, which includes the title of the webpage 1 currently viewed by the user, "Xi'an Tourist Route Map", URL information "URL 111", and source information "Source aaa". This can indicate that the semantic convergence card set displayed by the user interface 2510 is generated based on the content of webpage 1. The user interface 2510 is used to display cards 2512 in the semantic convergence card set. Page options 2513 in the user interface 2510 are used to indicate that the semantic convergence card set includes four cards, and that the currently displayed card 2512 is the fourth card among these four cards. For example, the first three cards among these four cards are... Figure 24 The text card 2413, image card 2421, and video card 2431 are shown. Card 2512 may include a title (“Custom Card 2”) and multiple text contents, such as the selected text 2512A (“Qin Shi Huang Mausoleum”), related content 2512B (“Ticket to Qin Shi Huang Mausoleum: 120 yuan”), and related content 2512C (“Transportation fee to Qin Shi Huang Mausoleum: 20 yuan”). Among them, related content 2512B and related content 2512C are content in webpage 1 that is semantically related to text 2512A. Here, we take text as an example of the type of related content. In specific implementation, it can also be other types such as images and videos. This application does not limit the specific type of related content. Card 2512 also displays multiple deletion options corresponding to multiple text contents. For example, deletion option 2512D is used to delete the corresponding text 2512A, deletion option 2512E is used to delete the corresponding associated content 2512B, and deletion option 2512F is used to delete the corresponding associated content 2512C. The user interface 2510 also includes a confirm control 2514 and a cancel control 2515. The confirm control 2514 is used to save the currently displayed card 2512 to the semantic convergence card set, and the cancel control 2515 is used to cancel saving the currently displayed card 2512.
[0322] Electronic device 100 can receive a touch operation (e.g., a click operation) on the delete option 2512D. In response to the touch operation, text 2512A is deleted from card 2512. Then, electronic device 100 can receive a touch operation (e.g., a click operation) on the confirm control 2514. In response to the touch operation, card 2512 is saved, and at this time, it can be displayed. Figure 25A User interface 2520 is shown in (C). Card 2512 in user interface 2520 includes text content 2512G, which includes the characters "Ticket to Qin Shihuang Mausoleum: 120 yuan, Transportation fee to Qin Shihuang Mausoleum: 20 yuan", which includes the characters displayed in the aforementioned undeleted associated content 2512B and associated content 2512C, but does not include the characters displayed in the deleted text content 2512A.
[0323] Not limited to the examples above, in other examples, Figure 25A The user interface 2520 shown in (C) can also be replaced with Figure 25B The user interface 2530 shown includes cards 2512 that include the aforementioned undeleted associated content 2512B and associated content 2512C, but does not include the deleted text content 2512A.
[0324] In one implementation, the electronic device 100 can respond to an action on Figure 25B The touch operation (e.g., click operation) of the associated content 2512B in the user interface 2530 shown displays... Figure 25C The user interface shown is 2540. (As shown) Figure 25C As shown, the user interface 2540 is used to display the webpage 1 (with the URL "URL 111" and the source "Source aaa") to which the associated content 2512B belongs. The text 2320 of the associated content 2512B ("The ticket price for the Qin Shihuang Mausoleum is 120 yuan") is displayed above the user interface 2540. The associated content 2512B is highlighted in the user interface 2540 (e.g., highlighted).
[0325] In one implementation, on Figure 25A After the operation shown, the electronic device 100 can receive a touch operation (e.g., a swipe operation) on any content in the webpage 1, and in response to the touch operation, select that content. See the example below for details. Figure 26 .
[0326] like Figure 26 As shown in (A), the electronic device 100 can display Figure 23 User interface 2300 is shown in (B). User interface 2300 may include image 2340A, title 2340B of image 2340A (“Popular Tourist Attractions in Xi’an”), and description 2340C of image 2340A (“The above image mainly shows…”). Electronic device 100 can receive swipe operations applied to image 2340A, such as single-finger swipe, two-finger swipe, or knuckle swipe. Figure 26 The following example illustrates the sliding operation as a knuckle circling image 2340A. This sliding operation can be understood as a screenshot of image 2340A, or as a user action to select image 2340A on webpage 1. The electronic device can respond to this sliding operation and display... Figure 26User interface 2610 is shown in (B). User interface 2610 may include a save control 2611, an editing interface 2612, and a function bar 2613 located at the bottom, wherein the editing interface 2612 is used to display the user interface targeted by the user operation, i.e. Figure 26 User interface 2300 is shown in (A). The editing interface 2612 displays an editing box 2612A, which displays the image 2340A selected by the user. The user can manipulate the shape, size, and position of the editing box 2612A to change the selected content (i.e., the content displayed in the editing box 2612A). The function bar 2613 includes, for example, options for sharing, a graphic option 2613A, a rectangle option 2613B, a save option 2613C, and options for viewing more functions. The graphic option 2613A is used to set the shape of the editing box 2612A to a freeform shape. After setting this function, the user can manipulate the editing box 2612A to make it any regular or irregular shape. The rectangle option 2613B is used to set the shape of the editing box 2612A to a rectangle.
[0327] The electronic device 100 can receive touch operations (e.g., click operations) on the save control 2611 or save option 2613C, and in response to the touch operation, save the image 2340A and related content displayed in the edit box 2612A to... Figure 25A In the user interface 2520 shown in (C), card 2512 is displayed, for example. Figure 26 User interface 2620 is shown in (C). Cards 2512 in user interface 2620 include: previously saved text content 2512G, and a list of content to be selected 2512H. The list of content 2512H includes multiple items and multiple deletion options, wherein the multiple items include, for example, the image 2340A selected by the user, the title 2340B of image 2340A on webpage 1, and the description 2340C of image 2340A on webpage 1. Each deletion option corresponds to one item and is used to trigger the deletion of that item.
[0328] Not limited to Figure 26 The screenshot operation shown may also be triggered by voice input in some other examples. This application does not limit the specific type of screenshot operation.
[0329] Figure 25A This explanation will take saving the user-selected content to a newly created custom card in the semantic convergence card set as an example. Figure 26This example illustrates saving user-selected content to an existing custom card in a semantic convergence card set. In other examples, the card for saving the selected content can be determined based on its type. For instance, when the user selects text, the selected content and associated content are saved to a text card. This application does not limit the type of card used to save the selected content.
[0330] In another implementation, the user can also choose to save the selected content and associated cards. For example, on the... Figure 25A Following the operation shown, the electronic device 100 can receive a touch operation (e.g., a drag operation) on any content in the webpage 1. In response to the touch operation, an interface for selecting the display position of the content is displayed. For a specific example, see [link to example]. Figure 27A .
[0331] like Figure 27A As shown in (A), the electronic device 100 can display Figure 23 The user interface 2300 shown in (B) includes a card control 2310 and an image 2340A. The electronic device 100 can receive drag operations applied to the image 2340A, for example, a user operation of dragging to a specific location. Figure 27A The following example illustrates a user action of dragging image 2340A to the location of card control 2310. This drag operation can be understood as a user action to select image 2340A on webpage 1. In response to this drag operation, electronic device 100 displays... Figure 27A User interface 2700 is shown in (B). User interface 2700 is used to select and save the selected content and associated cards. The prompt box 2710 in user interface 2700 includes a title (“Save to Card”) and options for multiple cards. These options include, for example, options for a text card 2711, an image card 2712, a video card 2713, a card titled “Custom Card 2” (abbreviated as Custom Card 2) 2714, and a new card 2715. Custom Card 2 is... Figure 25ACard 2512 in user interface 2520 shown in (C). The selection control displayed in any of the above options is used to choose whether to save the selected content to the card corresponding to that option or to deselect it. In user interface 2700, the selection controls displayed in options 2711, 2712, 2713, and 2715 are all unselected, while the selection control 2714A displayed in option 2714 is selected, indicating that the selected content is currently saved to the custom card 2 indicated by option 2714. Understandably, more or fewer selection controls can be selected. Prompt box 2710 also includes a confirm control 2716 and a cancel control 2717. The confirm control 2716 is used to save the selected content and associated content to the selected card, and the cancel control 2717 is used to cancel saving the selected content and associated content to the semantic convergence card set. The electronic device 100 can receive a touch operation (e.g., a click operation) on the designated control 2716, and in response to the touch operation, saves the image 2340A and related content to the custom card 2 indicated by option 2714, at which time, for example, it displays... Figure 26 The user interface 2620 shown in (C) is shown.
[0332] Not limited to the examples above, in other examples, electronic device 100 may also respond to... Figure 27A The user action of dragging the image 2340A in the user interface 2300 shown in (A) to the location of the card control 2310 displays... Figure 26 The user interface 2610 shown in (B) or directly displayed Figure 26 The user interface 2620 is shown in (C). In other examples, the electronic device 100 may also respond to... Figure 25A The save option 2330A in the user interface 2300 shown in (A) is displayed via touch operation (e.g., click operation). Figure 27A User interface 2700 is shown in (B). In other examples, electronic device 100 may also respond to knuckle wrapping. Figure 26 The user operation circled in the image 2340A of the user interface 2300 shown in (A) indicates the user's interaction with the image. Figure 27A The user interface 2700 shown in (B) is also described. In other examples, the electronic device 100 may also respond to... Figure 26 Touch operation (e.g., click operation) of the save control 2611 or save option 2613C in the user interface 2610 shown in (B) displays Figure 27A User interface 2700 is shown in (B). It is understood that the above user operations are merely examples; for example, electronic device 100 may also respond to... Figure 26Other forms of screenshot operations (such as voice input) in the user interface 2300 shown in (A) of the image 2340A are displayed. Figure 27A The user interface 2700 shown in (B) is not limited in the form of user operation in this application.
[0333] Figure 25A , Figure 26 and Figure 27A Three user actions for selecting / selecting content on a webpage are shown. In other examples, it is also possible to... Figure 26 or Figure 27A The user operation shown selects text content on webpage 1. In other examples, the content on the webpage can also be selected via voice input. This application does not limit the specific user operation used to select content on the webpage.
[0334] Figure 25A The following example illustrates how an electronic device 100 generates four cards after receiving a user's action to select content on a webpage. These four cards are... Figure 24 The text card 2413, picture card 2421, video card 2431, and... Figure 25A The custom card 2512 shown in (B) is an example. However, it is not limited to this; in other examples, the electronic device 100 may also generate a custom card simply after receiving a user action to select content on a webpage. Figure 25A Custom card 2512 shown in (B) is not generated. Figure 24 The text card 2413, image card 2421, and video card 2431 shown are not limited in this application. In other examples, after receiving a user operation to select content on a webpage (hereinafter referred to as selected content), the electronic device 100 may also generate multiple cards to display the selected content and related content on the webpage (hereinafter referred to as associated content). Optionally, these multiple cards may be used to display different types of webpage content; see specific examples. Figure 27B .
[0335] Figure 27B Based on the selected content and the related content mentioned above Figure 26 Taking the content of card 2512 in the user interface 2620 shown in (C) as an example, the selected content and the associated content are specifically: text content 2512G (including text content 2512B (“Ticket to Qin Shihuang Mausoleum: 120 yuan”) and text content 2512C (“Transportation fee to Qin Shihuang Mausoleum: 20 yuan”)), title 2340B, image 2340A, and description 2340C in card 2512. The electronic device 100 can generate [data / function] based on the selected content and the associated content. Figure 27BThe text card 2811 in the user interface 2810 shown in (A), and Figure 27B The image card 2821 in the user interface 2820 shown in (B). Figure 27B As shown in (A), text card 2811 is used to display text content: text content 2512B, text content 2512C, title 2340B, and description 2340C. For example... Figure 27B As shown in (B), picture card 2821 is used to display picture content: picture 2340A.
[0336] Not limited to the cards in the examples above, in other examples, when displaying video content on a card, the title, annotations, descriptions and other relevant information of the video content may also be displayed. This application does not limit the specific way of displaying web page content on a card.
[0337] The search method described in this application is based on the above embodiments. This method can be applied to... Figure 1A The search system 10 shown. This method can be applied to... Figure 1B The search system 10 shown.
[0338] Please see Figure 28 , Figure 28 This is a flowchart illustrating a search method provided in an embodiment of this application. The method may include, but is not limited to, the following steps:
[0339] S101: The electronic device acquires the first search term entered by the user.
[0340] In one implementation, the electronic device can receive a first search term (also referred to as a first keyword or search term) input by a user, and receive a user operation to trigger a search function targeting the first keyword. The electronic device can then obtain the first keyword input by the user based on this user operation. For example, electronic device 100 can receive a search function targeting the first keyword. Figure 3 The user interface 310 shown in (A) receives the keyword "Xi'an travel routes" in the search bar 311, and then receives a touch operation (e.g., a click operation) on the search control 312 in the user interface 310. The electronic device can obtain the keyword "Xi'an travel routes" entered by the user based on the touch operation. This application does not limit the form of the first keyword, such as, but not limited to, text, images, audio, etc.
[0341] S102: The electronic device sends a first search request to the network device.
[0342] In one implementation, after the electronic device receives the first keyword input by the user, it can send a first search request to the network device. The first search request is used to request search results related to the first keyword, and optionally, the first search request may include, for example, but is not limited to, the aforementioned first keyword.
[0343] S103: The network device obtains the first set of web pages.
[0344] In one implementation, after receiving a first search request, the network device can obtain at least one webpage related to the first keyword, i.e., a first set of webpages. For example, the network device can perform semantic analysis on the first keyword and obtain at least one webpage (i.e., the first set of webpages) related to the first keyword from a webpage database.
[0345] S104: The network device sends the first set of web pages to the electronic device.
[0346] S105: The electronic device displays the first set of web pages.
[0347] In some examples, the first set of web pages described in S103-S105 includes Figure 3 The user interface 320 shown in (B) contains multiple webpage cards indicating webpages: webpage 1 indicated by webpage card 322 (titled "Xi'an Tourist Route Map"), webpage 2 indicated by webpage card 323 (titled "Xi'an Tourist Route - Guide"), and webpage 33 indicated by webpage card 324 (titled "Complete Xi'an Tourist Guide"). The first set of webpages is related to a first keyword, which is... Figure 3 The user interface 310 shown in (A) includes the search bar 311 displaying "Xi'an tourist routes".
[0348] In one implementation, the first set of web pages displayed by the electronic device is sorted, and optionally, web pages with higher relevance to the first keyword are given higher display priority. For example, the first keyword is... Figure 3 The user interface 310 shown in (A) includes the search bar 311 displaying "Xi'an tourist routes". Figure 3 User interface 320 shown in (B) displays summary information (which may be called webpage cards) of the top three webpages in the first set of webpages. Since the relevance of these three webpages to the first keyword is from high to low as follows: webpage 1 (titled "Xi'an Tourist Route Map"), webpage 2 (titled "Xi'an Tourist Route - Guide"), and webpage 3 (titled "Xi'an Complete Tourist Guide"), in user interface 320, in the order from top to bottom, are: webpage card 322 indicating webpage 1, webpage card 323 indicating webpage 2, and webpage card 324 indicating webpage 3.
[0349] S106: The electronic device receives the first user operation.
[0350] In one implementation, the form of the first user operation may be, but is not limited to, touch operation (e.g., click operation), voice input, motion posture (e.g., gesture), brainwaves, etc. For example, the first user operation is for... Figure 3 The touch operation of the card control 325 in the user interface 320 shown in (B) is described. This application does not limit the specific form of user operation.
[0351] S107: The electronic device obtains a first content set from the web page content included in the first web page set.
[0352] In one implementation, the electronic device can respond to a first user operation by filtering web page content (i.e., a first content set) from the web page content included in a first web page set that matches the user's search intent. The content included in the first content set is related to a first keyword; for example, the content included in the first content set consists of web page content included in the first web page set that is highly relevant to the first keyword.
[0353] The following example illustrates one way to obtain the first set of content.
[0354] First, the electronic device can extract the content of the top N web pages from the first set of web pages (which can be called the second content set), where N is a positive integer. For example, the electronic device can silently load these N web pages in the background and obtain their Hypertext Markup Language (HTML) code through JavaScript (JS) injection. Then, it can parse the HTML code of these N web pages to obtain various types of content, such as text, images, videos, audio, and documents. This obtained content can constitute the second content set. In one implementation, when the electronic device obtains non-text web page content such as images, videos, audio, and documents, it can simultaneously obtain text related to this content, such as names, titles, and annotations. In another implementation, when the electronic device cannot obtain the original files of the web page content to be downloaded, such as videos, audio, and documents, it can obtain address information for viewing the original files (e.g., hyperlinks to the original files, hyperlinks to the web page to which the content belongs), and / or identification information for indicating the web page content (e.g., titles, names, cover images, and thumbnails).
[0355] For example, such as Figure 29As shown, the second content set may include a text set, an image set, and a video set. The text set includes q text contents: text1, text2, ..., textq; the image set includes m image contents: image1, image2, ..., imagem; and the video set includes n video contents: video1, video2, ..., videon. q, m, and n are positive integers greater than 1.
[0356] The electronic device can then calculate the similarity between each piece of content in the second content set and the first keyword. In one implementation, calculating the similarity may include two steps:
[0357] First, the electronic device can convert the first keyword into an M-dimensional first feature vector and convert each piece of content in the second content set into an M-dimensional second feature vector, where M is a positive integer. In one implementation, if the first keyword belongs to a non-text type such as an image, video, audio, or document, the electronic device can first convert the first keyword into text, and then convert the text into the first feature vector. In another implementation, for text content in the second content set, the electronic device can directly convert the text content into the second feature vector; for non-text content such as images, videos, audio, and documents in the second content set, the electronic device can first convert the non-text content into text, and then convert the text into the second feature vector. The text obtained by converting non-text content includes, but is not limited to, names, titles, annotations, and other text related to non-text content, as well as text obtained after parsing non-text content.
[0358] For example, such as Figure 29 As shown, electronic devices can perform vector transformation operations based on a vector model. Figure 29 Taking M=128 as an example, and passing any one-dimensional vector through g... i (i is a positive integer less than or equal to 128) is used for characterization. The first feature vector (also called the keyword vector) obtained from the first keyword input vector model can be characterized as: (g1, g2, ..., g 128 ) p For the second content set, the text set including text1, text2, ..., textq, the second feature vector (also called the text vector) obtained from the input vector model can be represented as follows: The image set includes image 1, image 2, ..., image m. The second feature vector (also called the image vector) obtained from the input vector model can be represented as: The video set includes video 1, video 2, ..., video n. The second feature vector (also called the video vector) obtained from the input vector model can be represented as follows: The text vectors, image vectors, and video vectors mentioned above can form a second set of feature vectors.
[0359] Second, the electronic device can calculate the similarity between each second feature vector and the first feature vector.
[0360] For example, such as Figure 29 As shown, the electronic device can obtain the second eigenvector and the first eigenvector (1,2,…,…) through dot product calculation. 128 ) p The similarity between them. The text vector derived from the above text 1. To illustrate how similarity is calculated, we will use an example to show the similarity between the text vector and the first feature vector. Other similarities are similar. Therefore, the similarity (which can be called text similarity) between text 1, text 2, ..., text q in the text set can be characterized as follows: The similarity (which can be called image similarity) between images 1, 2, ..., m in the image set can be represented as: The similarity (which can be called video similarity) between video 1, video 2, ..., video n in the video set can be represented as: The text similarity, image similarity, and video similarity mentioned above can form a similarity set.
[0361] Finally, the electronic device can filter out the web page content corresponding to the second feature vector whose similarity to the first feature vector is greater than or equal to a preset threshold, and these filtered contents can constitute the first content set.
[0362] For example, such as Figure 29 As shown, electronic devices can filter similarity scores from a similarity set that are greater than or equal to a preset threshold. The webpage content corresponding to these similarities can constitute a first content set. Assuming that in the text similarity set, the text similarity scores of text 1, text 3, and text 4 are greater than or equal to the preset threshold, therefore, text 1, text 3, and text 4 can constitute a related text set. Assuming that in the image similarity set, the image similarity scores of image 1 and image 2 are greater than or equal to the preset threshold, therefore, image 1 and image 2 can constitute a related image set. Assuming that in the video similarity set, the video similarity scores of video 1 and video 3 are greater than or equal to the preset threshold, therefore, video 1 and video 3 can constitute a related video set. The aforementioned related text set, related image set, and related video set can constitute a first content set.
[0363] Based on the above-described method for obtaining the first content set, here's a scenario example: assuming the first keyword is... Figure 3The keyword "Xi'an travel routes" is displayed in the search bar 311 of the user interface 310 shown in (A). Assuming q is 4, m and n are 3, the text set in the second content set may include text 1 ("Popular travel routes include..."), text 2 ("Xi'an, formerly known as Chang'an..."), text 3 ("Scenic Route 1: Shaanxi History Museum - Bell and Drum Tower..."), and text 4 ("Travel Route: Xicang - Muslim Quarter..."). The image set may include image 1 (image of scenic spots in the travel route), image 2 (image of scenic spots in the travel route), and image 3 (image of local food). The video set may include video 1 (travel guide video, titled "Xi'an Travel Guide Video"), video 2 (tourist interview video, titled "Tourists Praise Xi'an"), and video 3 (travel guide video, titled "Xi'an 3-Day Tour Guide"). Since the similarity between text 1, text 3, text 4, image 1, image 2, video 1, and video 3 and the first keyword is greater than or equal to a preset threshold, the first content set includes... Figure 4 The user interface 410 shown in (A) contains text content 4121 (for displaying text 1), text content 4122 (for displaying text 4), and text content 4123 (for displaying text 3). Figure 4 The user interface 420 shown in (B) contains image content 4211 (for displaying image 1) and image content 4212 (for displaying image 2). Figure 4 The user interface 430 shown in (C) contains video content 4311 (for displaying video 1) and video content 4312 (for displaying video 3).
[0364] Not limited to the above-described method of obtaining the first content set, in another embodiment, the electronic device may, after calculating the similarity between each piece of content in the second content set and the first keyword, compare the similarity between web page content of the same type belonging to the same web page, and determine the web page content with the highest similarity (M is a positive integer). These determined web page contents can constitute the first content set. Optionally, M may be different for different types. For example, suppose the second content set includes text 1, text 2, image 1, image 2, and image 3 in web page 1. The similarity between text 1 and the first keyword is higher than that between text 2 and the first keyword. Images 1-3 are ordered from highest to lowest similarity with the first keyword as: image 3, image 1, and image 2. Assuming M is 1 for text and M is 2 for images, then the first content set includes text 1, image 1, and image 3. Alternatively, it may compare the similarity between web page content of the same type belonging to the same web page and determine the web page content with a similarity greater than or equal to a preset threshold. These determined web page contents can constitute the first content set. This application does not limit this approach.
[0365] In one implementation, prior to S107, the method further includes: an electronic device receiving a user operation, and in response to the user operation, selecting a second set of web pages from a first set of web pages. For example... Figure 5A In the illustrated embodiment, the electronic device can... Figure 5A In the user interface 510 shown in (A), webpage cards 511, 512, and 513 are selected. Therefore, the second webpage set consists of webpage 1 indicated by webpage card 511 (titled "Xi'an Tourist Route Map") and webpage 3 indicated by webpage card 513 (titled "Xi'an Tourist Complete Guide"). In this case, the method of obtaining the first content set is similar to the method of obtaining the first content set described above, except that the first N webpages in the first webpage set need to be replaced with the second webpage set. That is, the content of the webpages included in the second content set is the content of the webpages in the second webpage set. In other words, the first content set is obtained based on the second webpage set.
[0366] S108: Generate the first card set based on the first content set.
[0367] S109: The electronic device displays the first card set.
[0368] In one implementation, the first card set may include at least one card.
[0369] In one implementation, any card in the first card set may include a type of web page content. That is, different cards are used to display different types of web page content. For example, multiple types of web page content such as text, images, videos, audio, or documents are displayed on different cards. This is not limited to this. In other examples, the classification of types can be more granular. For example, static images and animated images are displayed on different cards. In other examples, the classification of types can be more coarse. For example, video, audio, and document files are displayed on the same card.
[0370] For example, suppose the first content set is as shown in S107: including text 1 (“Popular tourist routes include…”), text 3 (“Scenic Route 1: Shaanxi History Museum—Bell and Drum Tower…”), text 4 (“Tourist Route: Xicang—Muslim Quarter…”), image 1 (image of the scenic spot in the tourist route), image 2 (image of the scenic spot in the tourist route), video 1 (travel guide video, titled “Xi’an Travel Guide Video”), and video 3 (travel guide video, titled “Xi’an 3-Day Tour Guide”). Then the first card set described in S108-S109 may include three cards, which respectively include text content, image content, and video content. For cards including text content, see [link to relevant documentation]. Figure 4The text card 412 in the user interface 410 shown in (A), including cards with image content, can be seen in [reference]. Figure 4 Image cards 421 in the user interface 420 shown in (B), including cards with video content, can be seen in [reference]. Figure 4 The video card 431 in the user interface 430 shown in (C).
[0371] Not limited to this, in another embodiment, any card in the first card set may include content from a webpage; that is, content from different webpages is displayed on different cards. For example, suppose the first content set is as exemplified in S107: including text 1 (belonging to webpage 1), text 3 (belonging to webpage 2), text 4 (belonging to webpage 3), image 1 (belonging to webpage 1), image 2 (belonging to webpage 2), video 1 (belonging to webpage 2), and video 3 (belonging to webpage 1). Then, the first card set described in S108-S109 may include three cards, which respectively include content from webpage 1, webpage 2, and webpage 3. Specifically, the cards including content from webpage 1 include... Figure 4 The text content 4121 (used to display text 1) in the user interface 410 shown in (A) Figure 4 Image content 4211 (used to display image 1) in user interface 420 shown in (B) Figure 4 The video content 4312 (for displaying video 3) in the user interface 430 shown in (C) is included. Specifically, the cards containing the content of webpage 2 include text content 4123 (for displaying text 3) in user interface 410, image 4212 (for displaying image 2) in user interface 420, and video content 4311 (for displaying video 1) in user interface 430. Specifically, the cards containing the content of webpage 3 include text content 4122 (for displaying text 4) in user interface 410. This application does not limit the classification method of the cards.
[0372] In one implementation, when the electronic device displays non-text web page content such as images, videos, audio, and documents in the first card set, it can simultaneously display text related to this web page content, such as names, titles, and annotations.
[0373] In one implementation, for web page content such as videos, audio, and documents where the original files cannot be obtained, the electronic device can display identification information of this web page content in a first card set to indicate this content. The identification information includes, but is not limited to, titles, cover images, and thumbnails. For example, the first card set described in S108-S109 includes... Figure 4 The video card 431 in the user interface 430 shown in (C) displays video content 4311 and video content 4312 in the form of cover images.
[0374] In one implementation, for any card included in the first card set, the electronic device can determine the display order of the webpage content based on the relevance between the webpage content in that card and the first keyword (e.g., represented by similarity in S107). Optionally, the stronger the relevance, the higher the priority of the webpage content's display order in that card. For example, the first card set described in S108-S109 includes... Figure 4 The text card 412 in the user interface 410 shown in (A). According to the relevance to the first keyword "Xi'an tourist routes" from high to low, the multiple text contents displayed in the text card 412 are arranged from top to bottom as follows: text content 4121 ("Popular tourist routes include..."), text content 4122 ("Tourist route: Xicang - Muslim Quarter..."), and text content 4123 ("Attraction route one: Shaanxi History Museum - Bell and Drum Tower...").
[0375] Not limited to this, in another embodiment, for any card included in the first card set, the electronic device can determine the display order of web page content based on the display order of the web pages to which the web page content belongs in that card. Optionally, the higher the display order of the web page to which the web page content belongs, the higher the display order of the web page content in that card. The display order of the web pages is determined, for example, based on the relevance between the web page and the first keyword; the stronger the relevance, the higher the display order of the web page in the web page list. For example, the first card set described in S108-S109 includes... Figure 4 The user interface 420 shown in (B) includes picture cards 421. Figure 3 The user interface 320 shown in (B) includes a list of web pages, which, in descending order, are web page card 322 indicating web page 1, web page card 323 indicating web page 2, and web page card 324 indicating web page 3. Therefore, in image card 421, image content 4211 from web page 1 is displayed on top of image content 4212 from web page 2.
[0376] For example, suppose the second webpage set consists of webpages 1 and 3 selected by the user in the example in S107, and suppose the first content set obtained based on the second webpage set includes: text 1 from webpage 1 (“Popular tourist routes include…”) and text 4 from webpage 3 (“Tourist route: Xicang—Muslim Quarter…”), then the first card set described in S108-S109 includes… Figure 5A The text card 521 in the user interface 520 shown in (B). Figure 3The user interface 320 shown in (B) includes a list of web pages, which, in order from top to bottom, are web page card 322 indicating web page 1, web page card 323 indicating web page 2, and web page card 324 indicating web page 3. Therefore, in text card 521, text content 4121 (for displaying text 1) is displayed on top of text content 4122 (for displaying text 4).
[0377] In another implementation, for any card included in the first card set, the electronic device can determine the display order of multiple web page contents based on the display order of the web pages to which the web page content in that card belongs, and the relevance of the web page content to the first keyword (e.g., represented by similarity in S107). Optionally, for web page content belonging to different web pages, the higher the priority of the display order of the web page to which it belongs, the higher the display order of the web page content in that card; for web page content belonging to the same web page, the stronger the relevance to the first keyword, the higher the display order of the web page content in that card.
[0378] For example, suppose the first content set includes: content 1 (similar to the first keyword is 0.7) and content 2 (similar to the first keyword is 0.8) from webpage 1, content 3 (similar to the first keyword is 0.5) from webpage 2, and content 4 (similar to the first keyword is 0.9) from webpage 3. These contents are all displayed on card 1 of the semantic convergence card set. Assume the webpages are displayed in the following order from top to bottom: webpage 1, webpage 2, and webpage 3. Since the similarity of content 2 in webpage 1 is greater than that of content 1, the contents in card 1 are displayed in the following order from top to bottom: content 2, content 1, content 3, and content 4. In one case, content 1 and content 2 belong to the same type, such as both being text; in another case, content 1 and content 2 belong to different types, such as content 1 being text and content 2 being an image. In one implementation, prior to S108, the method further includes: an electronic device receiving a user operation, and in response to the user operation, determining the cards included in the first card set, such as, but not limited to, the number and type of cards, and the amount of web page content included in the cards. For example... Figure 5B In the embodiment shown, the electronic device determines that the first card set includes text cards, picture cards, and video cards, and that the text cards include a maximum of 3 text contents, the picture cards include a maximum of 2 picture contents, and the video cards include a maximum of 2 video contents.
[0379] In one embodiment, the method further includes: when the electronic device displays a first set of cards, it can receive a user operation on any content in the first set of cards; in response to the user operation, it displays detailed content of the webpage to which the content belongs; optionally, the electronic device can display webpage content related to the content; optionally, the webpage content can be positioned within the webpage to which the content belongs; optionally, the content can be highlighted (e.g., highlighted) in the interface displayed by the electronic device. For example... Figure 6 In the illustrated embodiment, the electronic device can respond to an action on Figure 6 The touch operation of the text content 4121 included in the text card 412 of the user interface 410 shown in (A) displays... Figure 6 The user interface 600 shown in (B) is an example. Figure 25B and Figure 25C In the embodiment shown, the electronic device 100 can respond to an action on Figure 25B Touch operations of associated content 2512B in the user interface 2530 shown are displayed. Figure 25C The user interface 2540 is shown. Optionally, the electronic device can jump to the content page of the webpage based on the recorded address information of the webpage (e.g., a Uniform Resource Locator, URL).
[0380] In one embodiment, the method further includes: when the electronic device displays a first set of cards, it can receive a user operation on any card in the first set of cards, and in response to the user operation, display other content in that card. For example, Figure 13 The user interface 1320 shown in (C) displays card 1321 with image content 4211 and image content 4212. The electronic device can receive [the image content]. Figure 13 A swipe operation on card 1321 in the user interface 1320 shown in (C) responds to the swipe operation, displaying other content in card 1321, such as... Figure 13 User interface 1320 shown in (D) Figure 13 The user interface 1320 shown in (D) displays text content 4121, text content 4122 and text content 4123 in picture card 421.
[0381] S110: The electronic device receives a second user operation.
[0382] S111: Electronic device modifies the first card set.
[0383] In one implementation, the electronic device may, in response to a second user operation, modify the first card set and display the modified first card set.
[0384] In one implementation, the electronic device can delete a card from the first card set in response to a second user operation targeting any card in the first card set. For example... Figure 7A In the illustrated embodiment, the electronic device can respond to... Figure 7A The drag-and-drop operation of the text card 412 in the user interface 410 shown deletes the text card 412, at which point it can be displayed. Figure 7A The user interface 700 shown in (B) is an example. Figure 7B In the embodiment shown, the electronic device can respond to... Figure 7B Clicking the delete control 4124 in the user interface 410 shown in (A) deletes the text card 412 corresponding to the delete control 4124, at which point the text card 412 can be displayed. Figure 7B The user interface 700 shown in (B) is shown.
[0385] In one implementation, the electronic device can adjust the display position of a card in the first card set in response to a second user operation targeting any card in the first card set. For example, the electronic device displays... Figure 13 When the user interface 410 shown in (A) is displayed, a drag operation can be received on the text card 412 in the user interface 410, for example, the drag operation is a left-right drag or a up-down drag, and the electronic device also displays when the user's finger leaves the screen. Figure 13 In the user interface 1310 shown in (B), the picture card 421, the electronic device responds to the drag operation by switching the display positions of the text card 412 and the picture card 421.
[0386] In one implementation, the electronic device can, in response to a second user operation targeting any card in the first card set, merge that card with other cards into a single card. For example... Figure 13 In the illustrated embodiment, the electronic device can receive signals targeting... Figure 13 The drag operation of the text card 412 in the user interface 410 shown in (A), and the electronic device also displays when the user's finger leaves the screen. Figure 13 In the user interface 1310 shown in (B), the picture card 421, in response to the drag operation, the electronic device merges the text card 412 and the picture card 421, and the merged card can be seen in [the image card]. Figure 13 Card 1321 in the user interface 1320 shown in (C) and (D).
[0387] In one implementation, the electronic device can display a user interface for editing a card in response to a user action on any card in a first card set. For example... Figure 8 In the illustrated embodiment, the electronic device can respond to... Figure 8A long press operation on the text card 412 in the user interface 410 shown in (A) displays the editing interface of the text card 412: Figure 8 The user interface shown in (B) is 800.
[0388] In one implementation, the electronic device can display an editing interface for any content in any card of a first card set in response to a second user operation, allowing the user to edit the content (e.g., add and delete). For example... Figure 9 In the embodiment shown, the electronic device can receive characters input by the user and add them to the text content 4121.
[0389] In one implementation, the electronic device can delete content from the first card set in response to a second user action targeting any content in any card of the first card set. For example... Figure 10 In the illustrated embodiment, the electronic device can respond to... Figure 10 Clicking the delete control 810 in the user interface 800 shown in (A) deletes the text content 4121 corresponding to the delete control 810 in the text card 810. At this time, it can be displayed. Figure 10 The user interface 1000 shown in (B) is shown.
[0390] In one implementation, the electronic device can adjust the display position of the content on the card in response to a second user operation targeting any content on any card in a first card set. For example... Figure 11 In the illustrated embodiment, the electronic device can respond to... Figure 11 The drag operation of text content 4122 in the user interface 800 shown in (A) switches the display position of text content 4121 and text content 4122.
[0391] In one implementation, the electronic device may, in response to a second user operation targeting any content on any card in a first card set, adjust the display card of that content (i.e., the card used to display the webpage content). This can also be understood as moving the webpage content to another card selected by the user, or adjusting the display position of the content in the first card set. For example... Figure 12 In the illustrated embodiment, the electronic device can receive signals targeting... Figure 12 The user interface 1210 shown in (A) includes dragging operations on text content 4121 in text cards 412, and the electronic device also displays when the user's finger leaves the screen. Figure 12In the user interface 1220 shown in (B), the electronic device responds to the drag operation by moving the text content 4121 onto the picture card 421 for display (that is, adjusting the display card of the text content 4121 from the text card 412 to the picture card 421).
[0392] In one implementation, the electronic device can create a new card (also referred to as a custom card) in the first card set in response to a second user operation on the first card set. For example... Figure 14 In the illustrated embodiment, the electronic device can respond to... Figure 14 The click operation of the newly added control 415 in the user interface 410 shown in (A) creates a new card, that is... Figure 14 Card 1410 in the user interface 1400 shown in (B).
[0393] In one implementation, the electronic device can respond to a user action by adding web page content from a first card set to a custom card set. The addition can be, but is not limited to, the following three methods:
[0394] In one scenario, an electronic device can add all the content of a user-selected card to a custom card. For example... Figure 15 In the embodiments shown, Figure 15 In the user interface 1510 shown in (A), the text card corresponding to option 1513A and the picture card corresponding to option 1514A have been selected by the user, and the electronic device can... Figure 4 The text card 412 and (A) in the user interface 410 shown Figure 4 The content of the picture card 421 in the user interface 420 shown in (B) is added to the custom card. At this time, the custom card is Figure 15 Card 1410 in the user interface 1520 shown in (B).
[0395] In another scenario, electronic devices can add content from a user-selected first card set to a custom card. For example... Figure 16 In the embodiments shown, Figure 16 In the user interface 1610 shown in (A), the text content 4121 corresponding to option 1613A and the image content 4211 corresponding to option 1614A have been selected by the user. The electronic device can add the text content 4121 and the image content 4211 to the custom card. At this time, the custom card is... Figure 16 Card 1410 in the user interface 1620 shown in (B).
[0396] In another scenario, the electronic device may, in response to a second user action targeting any content within any card in the first card set, move that content to a custom card. For example... Figure 17A In the illustrated embodiment, the electronic device can respond to... Figure 17A The user interface 1210 shown in (A) includes a drag operation of the text content 4121 in the text card 412, which moves the text content 4121 to a custom card for display. At this time, the custom card is... Figure 17A Card 1410 in the user interface 1710 shown in (B). For example Figure 17B In the embodiments shown, Figure 17B The user interface 1720 shown in (A) includes text content 4121 in text card 412, and Figure 17B In the user interface 1730 shown in (B), the image content 4211 in the image card 421 has been selected. The electronic device can respond to a drag operation on the image content 4211 by moving the selected text content 4121 and image content 4211 to a custom card for display. At this time, the custom card is... Figure 17B Card 1410 in the user interface 1740 shown in (C).
[0397] S112: The electronic device stores information about the first card set.
[0398] In one implementation, the electronic device may save information of the first card set in response to a user operation. For example, the electronic device may respond to a user action... Figure 4 The touch operation (e.g., click operation) of the save control 414 in the user interface 410 shown in (A) saves the information of the first card set.
[0399] In one implementation, the electronic device can save the information of the first card set to its memory, and subsequently retrieve the information from the memory for secondary loading of the first card set. In another implementation, the electronic device can send the information of the first card set to a cloud server for storage, and subsequently retrieve the information from the cloud server for secondary loading of the first card set.
[0400] In one implementation, the information stored in the first card set by the electronic device may include, but is not limited to, basic information, resource information, location information, and webpage information of the first card set. The basic information is the first keyword searched by the user. The resource information includes the number of cards in the first card set and multiple webpage contents (which can be understood as a collection of webpage contents) within the first card set. Optionally, the resource information includes the original files of the webpage contents. Optionally, the resource information includes relevant information about non-text webpage content such as images, videos, audio, and documents, such as, but not limited to, at least one of the following: name, title, annotations, cover image, thumbnail, and address information of the original file (such as a hyperlink). For example, for webpage content such as videos, audio, and documents where the original files cannot be obtained, the relevant information of these webpage contents can be stored as resource information. The location information includes the display position of the card in the first card set (e.g., which card in the first card set), and the display position of each webpage content in the first card set (e.g., which webpage content of which card in the first card set). Optionally, the location information can be used by the electronic device to determine the position of the drawn cards and webpage content when subsequently displaying the first card set. The webpage information includes the address information (e.g., URL) of the webpage to which each webpage content belongs. Optionally, the webpage information can be used to display the content page of the webpage to which the webpage content belongs. For example, an electronic device can respond to a double-click operation on any content in the first card set and use the address information of the webpage to which the content belongs in the webpage information to jump to the webpage, at which time the specific content of the webpage can be displayed.
[0401] For example, suppose the first card set consists of three cards: Figure 4 Text card 412 in user interface 410 shown in (A) Figure 4 The image cards 421 and (B) in the user interface 420 shown Figure 4The video card 431 in the user interface 430 shown in (C) is an example. Therefore, the basic information of the first card set stored by the electronic device is the keyword searched by the user, i.e., "Xi'an tourist routes" displayed in the title 411 of the user interface 410. The resource information of the first card set stored by the electronic device is a collection of web page content in the first card set, specifically including: text content 4121, text content 4122, and text content 4123 in text card 412; image content 4211 and image content 4212 in image card 421; and video content 4311 and video content 4312 in video card 431. The location information of the first card set stored by the electronic device includes the display position of the card in the first card set; for example, text card 412 is the first card in the first card set. The location information also includes the display position of each web page content in the resource information in the first card set; for example, text content 4121 is the first content in the first card (i.e., text card 412) of the first card set. The web page information of the first card set stored in the electronic device includes the address information of the web page to which each web page content belongs in the resource information, such as the URL of web page 1 to which text content 4121 belongs, that is, the "URL 111" included in the source information 4121A corresponding to text content 4121 in the user interface 410.
[0402] S113: The electronic device displays at least one entry control.
[0403] In one implementation, any one of the entry controls is used to trigger the display of the first card set. Optionally, the electronic device displaying at least one entry control can also be understood as the electronic device setting at least one way to reload the first card set, and any one entry control can implement one way to reload the first card set.
[0404] In one implementation, the electronic device can respond to a user operation and determine at least one of the aforementioned entry controls, which can be understood as an entry point where the user can select to reload the first card set. For example... Figure 18 In the embodiments shown, Figure 18 In the user interface 1800 shown in (B), the browser's favorites indicated by option 1811, the desktop indicated by option 1812, the negative one screen indicated by option 1813, and the gallery indicated by option 1814 have been selected by the user, which indicates that the electronic device will display an entry for reloading the first card set at the above-mentioned selected locations.
[0405] In one implementation, the entry control can be generated before the electronic device displays it, as shown in the following example:
[0406] For example, an electronic device can generate / create a clickable component (i.e., an entry control) in the browser application's favorites. This component can store identification information of a first set of cards. This identification information can be used by the electronic device to determine the first set of cards to be displayed / loaded when it receives a user action (such as a click) on the component.
[0407] For example, electronic devices can generate / create widget-style entry controls in desktop or negative one screen applications and store the correspondence between the entry controls and the identification information of the first card set. This identification information can be used by the electronic device to determine the first card set to be displayed / loaded when it receives a user operation on the entry control.
[0408] For example, an electronic device can generate an image from a gallery. This image may include a QR code or other forms of content. Taking a QR code as an example, the QR code contains identification information for a first card set. The electronic device can obtain the identification information of the first card set by recognizing the QR code, thereby determining the first card set to be displayed / loaded.
[0409] The following are some examples of entry controls for electronic devices:
[0410] For example Figure 19A In the embodiments shown, Figure 19A User interface 1920 shown in (B) is the favorites interface of the browser application. Option 1922A in user interface 1920 is an entry control that indicates the card set with the basic information "Xi'an tourist routes".
[0411] For example Figure 19B In the illustrated embodiment, the user interface 1930 is the favorites interface of a browser application. The list 1934 in the user interface 1930 includes an entry control (i.e., option 1934A) indicating the card set with the basic information "Xi'an tourist routes" and an entry control indicating the card set with the basic information "Wuhan tourist routes".
[0412] For example Figure 20 In the embodiments shown, Figure 20 The user interface 2010 shown in (A) is the desktop, and the control 2011 in the user interface 2010 is the entry control that indicates the card set with the basic information "Xi'an tourist routes".
[0413] For example Figure 21 In the embodiments shown, Figure 21 The user interface 2110 shown in (A) is the user interface of the negative one screen application. The control 2111 in the user interface 2110 is the entry control that indicates the card set with the basic information "Xi'an tourist routes".
[0414] For example Figure 22 In the embodiments shown, Figure 22 The user interface 2220 shown in (B) is the user interface of the gallery application. The image 2221 in the user interface 2220 is used to indicate the card set with the basic information "Xi'an tourist routes". The image recognition control 2222 in the user interface 2220 is the entry control for the card set.
[0415] S114: The electronic device receives a third user operation on the first entry control.
[0416] In one implementation, the first entry control is any one of the at least one entry control described above.
[0417] S115: Electronic device displays the first card set.
[0418] In one implementation, the electronic device may display a first card set in response to a third user operation. In some examples, the electronic device may open an application (e.g., a browser) that implements the display function of the first card set and display the first card set in the user interface of the application. In other examples, the electronic device may invoke a display component in the application where the first entry control is located to display the first card set.
[0419] Examples of scenarios S114-S115 are shown below:
[0420] For example Figure 19A In the illustrated embodiment, the electronic device can receive signals targeting... Figure 19A The touch operation of option 1922A in the user interface 1920 shown in (B) displays... Figure 19A The user interface 410 shown in (C) is shown.
[0421] For example Figure 19B In the illustrated embodiment, the electronic device can receive touch operations for option 1934A in the user interface 1930 and display... Figure 19A The user interface 410 shown in (C) is shown.
[0422] For example Figure 20 In the illustrated embodiment, the electronic device can receive signals targeting... Figure 20 The touch operation of the control 2011 in the user interface 2010 shown in (A) displays Figure 20 The user interface 410 shown in (C) is shown.
[0423] For example Figure 21 In the illustrated embodiment, the electronic device can receive signals targeting... Figure 21 The touch operation of the control 2111 in the user interface 2110 shown in (A) displays Figure 21The user interface 410 shown in (C) is shown.
[0424] For example Figure 22 In the illustrated embodiment, the electronic device can receive signals targeting... Figure 22 The touch operation of the image recognition control 2222 in the user interface 2220 shown in (B) displays... Figure 22 The user interface 410 is shown in (C). Not limited thereto, the electronic device can also respond to scanning... Figure 22 User interaction shown in picture 2221 of user interface 2220 (B) is displayed. Figure 22 The user interface 410 shown in (C) is used by electronic devices, such as those using the scan function in chat or payment applications.
[0425] In one implementation, if the third user operation is further used to select card 1 from the first card set, then S115 may include: the electronic device, in response to the third user operation, displaying card 1 from the first card set. For example... Figure 20 In the illustrated embodiment, the electronic device responds to... Figure 20 The card control 2011C (for displaying text cards) in the user interface 2010 shown in (A) displays... Figure 4 The user interface 410 shown in (A). The electronic device responds to... Figure 20 (B) shows the card control 2011C (used to display picture cards) in Desktop 2020, which displays... Figure 4 The user interface 420 shown in (B) is shown.
[0426] In one implementation, the method further includes: the electronic device being able to switch the set of cards displayed in the first entry control in response to a user operation on the first entry control. For example Figure 20 In the illustrated embodiment, the electronic device can respond to... Figure 20 The sliding operation of control 2011 (used to display the card set with the basic information "Xi'an tourist routes") in Desktop 2020 shown in (B) displays... Figure 20 User interface 2030 (D) is shown. Control 2011 in user interface 2030 is used to display a set of cards with the basic information "Wuhan tourist routes".
[0427] In one embodiment, S115 includes: the electronic device can obtain the stored information of the first card set according to the identification information of the first card set, and display the first card set according to the information. Optionally, the identification information of the first card set can be determined according to the first entry control. For example, the electronic device stores a correspondence between the identification information of the first entry control and the first card set. When a third user operation is received on the first entry control, the identification information of the first card set corresponding to the first entry control is determined according to the correspondence. Optionally, when the first entry control displays the content of card set 1, the identification information of card set 1 is determined according to the correspondence; when the first entry control displays the content of card set 2, the identification information of card set 2 is determined according to the correspondence.
[0428] For example, an electronic device can obtain a first keyword based on the basic information of a first card set, determine the number of cards included in the first card set and the web page content in each card based on the resource information of the first card set, determine the drawing position / order of the cards and web page content in the resource information based on the position information of the first card set, and realize the function of viewing the content page of the web page to which the web page content in the first card set belongs based on the web page information of the first card set.
[0429] In one implementation, the information of the first card set is stored in the memory of the electronic device, and the electronic device can retrieve the information of the first card set from the memory. In another implementation, the information of the first card set is stored in a cloud server, and the electronic device can send a request message (e.g., including the identification information of the first card set) to the cloud server and receive the information of the first card set returned by the cloud server based on the request message.
[0430] In one implementation, the user can still view and edit the first card set in S115, such as, but not limited to, double-clicking content to view the content page of the webpage to which it belongs, swiping to view more content in the card, dragging a card to delete it, dragging a card to adjust its display position, merging multiple cards into one card, long-pressing to enter the card's editing interface, clicking to enter the content's editing interface, clicking to delete content in the card, dragging content to adjust its display position in the card, dragging content to adjust the display card of that content, creating a new card, selecting content from the menu to add to the newly created card, dragging content to move to the newly created card, etc. For details, please refer to the description of S109-S111, which will not be repeated here.
[0431] Understandably, any webpage in the first webpage set can include content related to the first keyword, or it can include content unrelated to the first keyword, increasing the difficulty for users to find content that matches their search intent. This application, however, can filter content related to the first keyword from the webpages included in the first webpage set and display this filtered content through a first card set. This allows users to quickly obtain valuable content that matches their search intent from the search results through the first card set, without needing to click on multiple webpages or browse the entire webpage, reducing the time users spend organizing search results and improving search efficiency. Furthermore, the first card set can include various types of webpage content such as images, videos, audio, and documents, and is not limited to text, resulting in richer content, better meeting user needs, and providing a better user experience.
[0432] Meanwhile, this application supports viewing, modifying, saving, and re-viewing / loading the first card set, meeting users' personalized needs. Users no longer need to copy webpage content to Notepad or other applications for modification and saving, nor do they need to bookmark the entire webpage and then re-browse it to find the desired content (which is also impossible to modify). This reduces user operation and re-viewing / loading time. Furthermore, there are various ways to re-view / load (e.g., displaying entry points for re-loading the card set through browser bookmarks, desktop, negative one screen, and gallery applications), offering high flexibility and increasing the speed and accuracy of users retrieving the first card set, making it more convenient for users.
[0433] Please see Figure 30 , Figure 30 This is a flowchart illustrating another search method provided in an embodiment of this application. The method may include, but is not limited to, the following steps:
[0434] S201: The electronic device receives a fourth user operation for the first webpage in the first webpage set.
[0435] In one implementation, S201 is an optional step.
[0436] In one implementation, the first set of web pages is Figure 28 The first set of web pages described in S103-S105 shown.
[0437] In one implementation, prior to S201, the electronic device may perform... Figure 28 S101-S105 are shown.
[0438] In one implementation, the first webpage is any one of the webpages in the first set of webpages.
[0439] For example, Figure 23The webpage list in the user interface 320 shown in (A) displays summary information (which may be referred to as webpage cards) of three webpages in the first webpage set: webpage card 322 indicating webpage 1, webpage card 323 indicating webpage 2, and webpage card 324 indicating webpage 3. The electronic device can receive a touch operation on webpage card 322, where webpage 1 indicated by webpage card 322 is the first webpage.
[0440] S202: The electronic device requests the display data of the first webpage from the network device.
[0441] In one implementation, the electronic device may, in response to a fourth user action, send a request message to the network device to request the display data of the first webpage.
[0442] S203: The network device sends the first web page data to the electronic device.
[0443] In one implementation, the network device can send first webpage data, i.e., display data of the first webpage, to the electronic device based on a request message sent by the electronic device.
[0444] S204: The electronic device displays the first webpage based on the data from the first webpage.
[0445] For example, the electronic device receives a signal targeting... Figure 23 After a touch operation on the webpage card 322 in the user interface 320 shown in (A), the specific content of the webpage 1 indicated by the webpage card 322 can be displayed, that is, the content of the webpage 1 can be displayed. Figure 23 The user interface 2300 shown in (B) is shown.
[0446] S205: The electronic device receives a fifth user operation.
[0447] In one implementation, the fifth user action is used to trigger the viewing of a second set of cards for the currently displayed first webpage, the second set of cards including content from the first webpage. For example, the fifth user action is for... Figure 23 The click operation of the card control 2310 in the user interface 2300 shown in (B).
[0448] S206: The electronic device obtains a third set of content from the content of the first webpage.
[0449] In one implementation, the electronic device can filter a third set of content from the content of a first webpage that matches the user's search intent. In another implementation, the third set of content includes content that is related to the first keyword; for example, the third set of content includes content from the first webpage that is highly relevant to the first keyword.
[0450] The ways electronic devices obtain third-party content collections and Figure 28 The method for obtaining the first content set described in S107 is similar. The following example illustrates how the electronic device obtains the third content set. It should be noted that the main focus below is on the differences between the two methods; other explanations can be found in [link to relevant documentation]. Figure 28 Explanation of how to obtain the first content set in S107.
[0451] In one implementation, the electronic device can first calculate the similarity between each piece of content in the first webpage and the first keyword, and then filter out the webpage content with a similarity greater than or equal to a preset threshold. These filtered contents can constitute a third content set.
[0452] In another implementation, the electronic device can first calculate the similarity between each piece of content in the first webpage and the first keyword, then compare the similarity of webpage content belonging to the same type, and determine the webpage content with the highest similarity (M is a positive integer). These determined webpage contents can constitute a third content set.
[0453] S207: The electronic device generates a second card set based on the third content set.
[0454] S208: Electronic device displays second card set.
[0455] In one implementation, the second card set may include at least one card.
[0456] In one implementation, any card in the second card set may include one type of web page content, such as text, images, videos, audio, or documents, which are displayed on different cards. However, this is not the only implementation. In other examples, the classification of types may be more granular, such as displaying static images and animated images on different cards. In other examples, the classification of types may be more coarse, such as displaying video, audio, and document files on the same card.
[0457] For example, suppose the first webpage is Figure 23The webpage 1 displayed by the user interface 2300 shown in (B) includes the third content set described in S206-S207, which includes: text 1 (“Popular tourist routes include…”) and text 2 (“When going to Xi’an, you must visit the Mausoleum of the First Qin Emperor… The ticket price for the Mausoleum of the First Qin Emperor is 120 yuan… The transportation fee to the Mausoleum of the First Qin Emperor is 20 yuan…”) in the user interface 2300; text 3 (“Popular attractions in Xi’an”) in the webpage 1 (not shown in the user interface 2300); image 1 in the user interface 2300; and video 1 in the webpage 1 (not shown in the user interface 2300). Therefore, the second card set described in S207-S208 may include three cards, which respectively include text content, image content, and video content. For cards including text content, see… Figure 24 The text card 2413 (used to display text 1, text 2, and text 3) in the user interface 2410 shown in (A) can be seen as a card including image content. Figure 24 The image card 2421 (for displaying image 1) in the user interface 2420 shown in (B) includes a card containing video content, which can be seen in [reference]. Figure 24 The video card 2431 (for displaying video 1) in the user interface 2430 shown in (C).
[0458] In one implementation, for any card included in the second card set, the electronic device can determine the display order of the webpage content based on the relevance (e.g., represented by similarity) between the webpage content in that card and the first keyword. Optionally, the stronger the relevance, the higher the priority of the webpage content's display order in that card. For example, see... Figure 24 The text cards 2413 in the user interface 2410 shown in (A) are arranged from top to bottom according to their relevance to the first keyword "Xi'an tourist routes". The multiple text contents displayed in the text cards 2413 are: text content 2413A ("Popular tourist routes include..."), text content 2413B ("When you go to Xi'an, you must visit the Qin Shi Huang Mausoleum... The ticket price for the Qin Shi Huang Mausoleum is 120 yuan... The transportation fee to the Qin Shi Huang Mausoleum is 20 yuan...") and text content 2413C ("Popular attractions in Xi'an...").
[0459] In one implementation, users can view and edit the second card set, for example, but not limited to, double-clicking content to view the content page of the webpage to which it belongs, swiping to view more content in the card, dragging a card to delete it, dragging a card to adjust its display position, merging multiple cards into one card, long-pressing to enter the card's editing interface, clicking to enter the content's editing interface, clicking to delete content in the card, dragging content to adjust its display position in the card, dragging content to adjust the display card of that content, creating a new card, selecting content from the menu to add to the newly created card, and dragging content to move to the newly created card, etc. See details in [link to relevant documentation]. Figure 28 The description, specific examples, and... of the first card set in S109-S111 Figure 6 , Figure 7A , Figure 7B , Figures 8-16 , Figure 17A and Figure 17B Similarly, I will not elaborate further.
[0460] S209: The electronic device receives a sixth user operation for the first content in the first webpage.
[0461] In one implementation, the first content is the content of any webpage included in the first webpage.
[0462] The following examples illustrate some of the first content and the sixth user action:
[0463] For example Figure 25A In the embodiment shown, the first content is Figure 25A The text “Qin Shi Huang Mausoleum” in the user interface 2300 shown in (A) is the sixth user operation, which is a touch operation for the save option 2330A in the function list 2330 included in the user interface 2300.
[0464] For example Figure 26 In the embodiment shown, the first content is Figure 26 The sixth user operation includes a swiping operation on the image 2340A in the user interface 2300 shown in (A), and a swiping operation on the image 2340A. Figure 26 The touch operation of the save control 2611 or save option 2613C in the user interface 2610 shown in (B).
[0465] For example Figure 27A In the embodiment shown, the first content is Figure 27A The sixth user operation is a drag operation performed on the image 2340A in the user interface 2300 shown in (A).
[0466] S210: The electronic device obtains at least one second piece of content associated with the first content from the content of the first webpage.
[0467] In one implementation, the electronic device can acquire at least one second piece of content associated with the first content according to a preset rule. For example, the first content is... Figure 26 Image 2340A in the user interface 2300 shown in (A) can be used to obtain two second contents: the title 2340B of image 2340A shown in the user interface 2300 ("Popular tourist attractions in Xi'an") and the description 2340C of image 2340A ("The above image mainly shows...").
[0468] In another implementation, the second content can be webpage content that is highly relevant to the first content (e.g., characterized by similarity). In some examples, the electronic device can first calculate the similarity between each piece of content on the first webpage and the first content, and then filter out webpage content with a similarity greater than or equal to a preset threshold as the second content. An explanation of calculating similarity can be found in [link to documentation]. Figure 28 The explanation of similarity in S107. Not limited to this, in other examples, electronic devices can also filter out the webpage content ranked in the top M similarity positions as the second content (M is a positive integer). For example, if the first content is the text "Xi'an Tourist Route One:...", then the second content could be "Xi'an Tourist Route Two:...". For example, the first content is... Figure 25A The text 2320 in the user interface 2300 shown in (A) includes the text "Qin Shi Huang Mausoleum", which can then be used to obtain two second contents: the text 2320 includes the text "Qin Shi Huang Mausoleum ticket 120 yuan" and the text 2320 includes the text "bus ticket to Qin Shi Huang Mausoleum 20 yuan".
[0469] S211: The electronic device displays a second set of cards based on the first content and at least one of the aforementioned second contents.
[0470] In one implementation, the electronic device may first create a new card (referred to as a custom card) in the second card set, and display the first content and at least one of the aforementioned second contents in the custom card. The custom card is a card other than the cards included in the second card set in S208.
[0471] In one implementation, a custom card may contain only the content of a single webpage. For example, after receiving a sixth user operation on the first content of a first webpage, the electronic device can create a new custom card 1 in the second card set. Custom card 1 is used to display the content of the first webpage. After receiving a user operation on the content of a second webpage, the electronic device can create a new custom card 2 in the second card set. Custom card 2 is used to display the content of the second webpage. Optionally, the electronic device can display information about the first webpage when displaying custom card 1 to indicate that custom card 1 is used to display the content of the first webpage. For example, assuming the first webpage is... Figure 25A User interface 2300 shown in (A) displays webpage 1. Assuming the example in S210, the first content is the text "Qin Shi Huang Mausoleum," and the two second contents are the texts "Ticket to Qin Shi Huang Mausoleum: 120 yuan" and "Bus ticket to Qin Shi Huang Mausoleum: 20 yuan." The electronic device can... Figure 25A User interface 2510, as shown in (B), displays card 2512 (i.e., custom card 1). Card 2512 includes text content 2512A (for displaying first content), related content 2512B, and related content 2512C (for displaying two second contents). User interface 2510 also includes title information 2511, which displays the title of webpage 1, "Xi'an Tourist Route Map," URL information, "URL 111," and source information, "Source aaa."
[0472] In one implementation, the electronic device can display the first content and the second content in a custom card according to the display order of the first content and the second content on the first webpage, as shown in the following example:
[0473] For example Figure 25A In the embodiments shown, due to Figure 25A In the webpage 1 displayed by the user interface 2300 shown in (A), the text "Qin Shi Huang Mausoleum" appears before text 1 ("Ticket to Qin Shi Huang Mausoleum: 120 yuan"), and text 1 appears before text 2 ("Transportation fee to Qin Shi Huang Mausoleum: 20 yuan"). Therefore, Figure 25A The user interface 2510 shown in (B) includes custom cards 2512, which are displayed in the following order from top to bottom: text 2512A (for displaying the text "Qin Shi Huang Mausoleum"), associated content 2512B (for displaying text 1) and associated content 2512C (for displaying text 2).
[0474] For example Figure 26 In the embodiments shown, due to Figure 26In the webpage 1 displayed by user interface 2300 shown in (A), image 2340A has a title 2340B (“Popular Tourist Attractions in Xi’an”) above it and a description 2340C (“The above image mainly shows…”) below it. Therefore, Figure 26 The user interface 2620 shown in (B) includes custom cards 2512, which are displayed in the following order from top to bottom: image 2340A, title 2340B and description 2340C.
[0475] In another implementation, the electronic device may also determine the display order of the first content and the second content in the custom card based on the relevance of the first content, the second content and the first keyword (e.g., by similarity). Optionally, the stronger the relevance, the higher the priority of the web page content in the display order in the custom card.
[0476] Not limited to the examples above, in another implementation, the electronic device can also display the first and second content within existing cards in the second card set, in a manner similar to displaying the first and second content within custom cards as described above. Optionally, assuming that text, images, and videos are displayed on different cards in the second card set, the electronic device can determine which card to display the first and second content based on their types. For example, if the first content is text, the first and second content are displayed on the card containing the text content; or, if the first content is text and the second content is an image, the first content is displayed on the card containing the text content, and the second content is displayed on the card containing the image content.
[0477] In another implementation, the electronic device may also respond to a user action by determining which cards in the second card set are used to display the first and second content. For example... Figure 27A In the embodiments shown, Figure 27A In the user interface 2700 shown in (B), the selection control 2714A displayed in the options 2714 of the custom card is in a selected state, indicating that the custom card has been selected. The electronic device can save the first content and the second content to the custom card. At this time, the custom card is... Figure 26 The user interface 2620 shown in (C) is shown in card 2512.
[0478] Not limited to the method flow of the example above, in another implementation, the electronic device may not receive the fifth user operation (i.e., not execute S205), and may receive the sixth user operation (i.e., execute S209) after S204. In response to the sixth user operation, the electronic device may execute S206-S207 and S210, and then display the second card set (see the description of S208 and S211 for details). The order of S206-S207 and S210 is not limited. For example, according to Example 1 of S209, the sixth user operation is for... Figure 25A The user interface 2300 shown in (A) is clicked on the save option 2330A. The electronic device can, in response to the sixth user operation, generate a second card set, which includes four cards: Figure 24 Text card 2413 in user interface 2410 shown in (A), Figure 24 Image card 2421 in the user interface 2420 shown in (B) Figure 24 The video card 2431 in the user interface 2430 shown in (C) Figure 25A The user interface 2510 shown in (B) contains custom cards 2512, wherein the first three cards are used to display a third set of content, and the fourth card is used to display the first content and at least one of the aforementioned second content.
[0479] Not limited to the method flow of the above example, in another implementation, the electronic device may first execute S209-S211, and then execute S205-S208. Optionally, S211 specifically involves: the electronic device generating a second card set based on the first content and at least one second content. The second card set includes at least one card, which includes the first content and at least one other content. S207 specifically involves: the electronic device generating at least one card in the second card set based on a third content set. A description of this at least one card can be found in the description of the cards included in the second card set in S207. In some examples, S211 specifically includes: the electronic device generating a custom card based on the first content and at least one second content. This custom card includes the first content and at least one second content. For example, the custom card is... Figure 25A Custom card 2512 shown in (B), or Figure 26 The custom card 2512 shown in (C). In other examples, S211 specifically includes: the electronic device generating a plurality of cards based on first content and at least one second content, the plurality of cards including the first content and at least one second content, optionally, the plurality of cards being used to display different types of content, specifically described and Figure 28 The descriptions of the different cards in S109 for displaying different types of webpage content are similar and will not be repeated here. For example, these multiple cards are... Figure 27BThe text card 2811 in the user interface 2810 shown in (A), and Figure 27B The image card 2821 in the user interface 2820 shown in (B).
[0480] Not limited to the method flow of the example above, in another implementation, the electronic device may only execute S209-S211 and not execute S205-S208.
[0481] Not limited to the method flow of the above example, in another implementation, the electronic device may only execute S205-S208 and not execute S209-S211.
[0482] S212: The electronic device stores information about the second card set.
[0483] In one implementation, S212 and Figure 28 Similar to S112, see details. Figure 28 The description of S112. In one embodiment, the custom cards in the second card set only include the content of the first webpage. The electronic device can save the information of the first webpage, such as, but not limited to, the title and address information (such as URL) of the first webpage. The information of the first webpage can be used to display together when displaying custom cards (for a specific example, see the description in S211 that the electronic device can display the information of the first webpage when displaying custom card 1).
[0484] In one embodiment, the electronic device may also display at least one entry control (for triggering the display of a second card set), as detailed below. Figure 28 Similar to S113, it will not be described in detail again.
[0485] In one implementation, the electronic device can display a second set of cards in response to a user operation on any of the entry controls, as detailed below. Figure 28 Similar to S114-S115, they will not be described in detail here.
[0486] Not limited to the examples above, in one implementation, the electronic device can, in response to a user action, cancel the addition of the first content or any of the second content to the second card set, for example... Figure 25A In the embodiments shown, Figure 25AThe text card 2511 in the user interface 2510 shown in (B) includes text content 2512A (for displaying first content), text content 2512B (for displaying a second piece of content), and text content 2512C (for displaying another piece of second content). The delete option 2512D in the user interface 2510 triggers the deletion of text content 2512A, the delete option 2512E triggers the deletion of text content 2512B, and the delete option 2512F triggers the deletion of text content 2512C. In other words, the user can choose whether to retain the selected first content and any second content associated with it, making it more flexible and providing a better user experience.
[0487] Understandably, any webpage in the first set of webpages can include content related to the first keyword, or content unrelated to the first keyword, increasing the difficulty for users to find content matching their search intent. This application, however, can filter content related to the first keyword from the content of the first webpage after the user selects to view its specific content, and display this filtered content through a second card set. This allows users to quickly obtain valuable content from the first webpage that matches their search intent without having to browse the entire webpage, reducing the time spent organizing search results, improving search efficiency, and providing a better user experience. Like the first card set, the second card set can include various types of content and supports viewing, modifying, saving, and re-viewing / loading, thus having the same effect as the first card set. For details, please refer to [link to relevant documentation]. Figure 28 The effects of the first set of cards are not elaborated here.
[0488] Furthermore, this application supports user-defined addition of selected content from the first webpage to the second card set. This means that content automatically filtered by the electronic device and user-selected content from the same webpage can be saved in the same functional window (i.e., the second card set), offering high flexibility and greatly facilitating user reading and secondary viewing / loading. The electronic device can also filter out second content related to the first content from the first webpage and display both content through the second card set, eliminating the need for manual searching and adding of second content, further reducing the time spent obtaining content matching the user's search intent.
[0489] Not limited to the examples above, in other examples, electronic devices may not filter second content related to the first content, and the second card set may not display the second content. This application does not limit this.
[0490] Based on the above embodiments, it is understood that the electronic device can not only extract webpage content related to search keywords from multiple webpages returned by the search function, but also extract webpage content related to search keywords from webpages viewed by the user, and display this extracted content to the user in the form of a card set. Furthermore, the electronic device can also display the content selected by the user on a webpage content page, as well as the content associated with that selected content, together in the form of a card set. Therefore, users can quickly obtain content matching their search intent from the search results simply through the card set, greatly reducing the time users spend organizing search results and finding the required content. Moreover, this card set supports reading, viewing the original webpage to which the content belongs, performing editing operations such as adding, deleting, modifying, and rearranging the order, as well as saving and reloading functions, meeting various user needs and making it more convenient to use.
[0491] In the description of the embodiments of this application, unless otherwise stated, " / " means "or", for example, A / B can mean A or B; "and / or" in the text is merely a description of the relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of this application, "multiple" means two or more.
[0492] In the above description, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying relative importance or implicitly indicating the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.
[0493] The methods provided in the embodiments of this application can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. When implemented in software, they can be implemented, in whole or in part, in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disc (DWD), or a semiconductor medium (e.g., solid-state drive). (disk, SSD, etc.). The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it; although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A search method, characterized in that, Applied to electronic devices, the method includes: Get the first keyword entered by the user; Send a first search request to the network device, the first search request including the first keyword; Receive the set of search results sent by the network device based on the first search request; Displaying a first interface, the first interface includes the search results set, the search results set includes a first search result and a second search result, the first search result is related to a first webpage, and the second search result is related to a second webpage; Receive the first user's operation; In response to the first user operation, a first card set is generated. The first card set includes a first card, the first card includes first content and second content, the first webpage includes the first content, the second webpage includes the second content, and both the first content and the second content are associated with the first keyword. After the first user action, a second interface is displayed, which includes the first card.
2. The method as described in claim 1, characterized in that, The method further includes: Receive a second user action applied to the first search result in the first interface; Display the first webpage; Receive operations from third-party users; In response to the third user operation, a second card set is generated, the second card set includes a second card, the first card includes third content and fourth content, the third content and the fourth content are both contents of the first webpage; A third interface is displayed, which includes the second card.
3. The method as described in claim 2, characterized in that, The method further includes: Receive the user's selection operation on the first webpage; Obtain first information based on the selection operation; Receive a fourth user's operation; In response to the fourth user operation, a third card is generated. The third card is a card in the second card set. The third card includes fifth content and sixth content. The fifth content and the sixth content are both contents of the first webpage. The fifth content and the sixth content are both associated with the first information. A fourth interface is displayed, which includes the third card.
4. The method as described in claim 1, characterized in that, The first card set also includes a fourth card, the first card including content of a first type, and the fourth card including content of a second type, the first type and the second type being different.
5. The method as described in claim 1, characterized in that, The generation of the first card set includes: Receive the fifth user's operation; In response to the fifth user action, select the first search result and the second search result from the search result set; The first card set is generated based on the first search result and the second search result.
6. The method as described in claim 1, characterized in that, When the similarity between the first content and the first keyword is greater than the similarity between the second content and the first keyword, the first content is placed before the second content; or, When the first search result is located before the second search result, the first content is located before the second content.
7. The method according to any one of claims 1-6, characterized in that, After displaying the second interface, the method further includes: The fifth interface is displayed, which includes a first control. The fifth interface is the desktop of the electronic device, the negative one screen, or the collection interface of the first application. The first control is associated with the first card set. Receive the sixth user operation applied to the first control; The sixth interface is displayed, which includes the fifth card in the first card set.
8. The method according to any one of claims 1-6, characterized in that, The method further includes: Receive a seventh user operation applied to the first content in the second interface; The first webpage is displayed.
9. The method according to any one of claims 1-6, characterized in that, The method further includes: Receive the eighth user operation applied to the first card in the second interface; In response to the eighth user's operation, delete the first card; Alternatively, receive a ninth user action applied to the first content in the second interface; In response to the ninth user action, the first content is deleted.
10. The method according to any one of claims 1-6, characterized in that, The method further includes: Receive the tenth user operation applied to the first content in the second interface; In response to the tenth user operation, the first content is modified to the seventh content; The seventh content is displayed in the first card.
11. The method according to any one of claims 1-6, characterized in that, The first content in the first card precedes the second content; the method further includes: Receive the eleventh user operation applied to the first content in the second interface; In response to the eleventh user operation, adjust the display positions of the first content and the second content in the first card; The adjusted first card is displayed, and the first content in the adjusted first card is located after the second content.
12. The method according to any one of claims 1-6, characterized in that, The first card set also includes a sixth card; the method further includes: Receive the twelfth user operation applied to the first content in the second interface; In response to the twelfth user operation, the first content is moved from the first card to the sixth card; In response to the twelfth user operation, the first card does not include the first content, and the sixth card includes the first content.
13. The method according to any one of claims 1-6, characterized in that, The first card set also includes a seventh card; the method further includes: Receive the thirteenth user operation applied to the first card in the second interface; In response to the thirteenth user operation, the first card and the seventh card are merged into an eighth card, wherein the eighth card includes the contents of the first card and the contents of the seventh card.
14. The method according to any one of claims 1-6, characterized in that, The method further includes: Received the fourteenth user's operation; The seventh interface is displayed, which includes the contents of the cards in the first card set; Receive the fifteenth user operation applied to the seventh interface; According to the fifteenth user operation, the eighth content included in the ninth card of the first card set is obtained; Received the sixteenth user's operation; In response to the sixteenth user operation, a tenth card is generated, the tenth card being a card from the first card set, and the tenth card including the eighth content; The eighth interface is displayed, which includes the tenth card.
15. A search method, characterized in that, Applied to electronic devices, the method includes: Display the first webpage; Obtain first information related to the first webpage, wherein the first information is a first keyword used to search the first webpage, or the first information is information obtained based on the user's selection operation on the first webpage; Receive the first user's operation; In response to the first user operation, a first card set is generated. The first card set includes a first card. The first card includes first content and second content. The first content and the second content are both contents of the first webpage. The first content and the second content are both associated with the first information. After the first user operation, a first interface is displayed, which includes the first card.
16. The method as described in claim 15, characterized in that, The display of the first webpage includes: Obtain the first keyword input by the user; Send a first search request to the network device, the first search request including the first keyword; Receive the set of search results sent by the network device based on the first search request; A second interface is displayed, which includes the search results set. The search results set includes a first search result and a second search result. The first search result is related to the first webpage, and the second search result is related to the second webpage. Receive a second user action applied to the first search result; In response to the second user's action, the first webpage is displayed.
17. The method as described in claim 15, characterized in that, When the first information is information obtained based on a user's selection operation on the first webpage, the first information includes at least one of the text, images, audio, and video in the first webpage.
18. The method as described in claim 17, characterized in that, When the first information includes at least one of the text, images, audio, and video in the first webpage, the first card set also includes a second card, the first card including content of a first type, and the second card including content of a second type, wherein the first type and the second type are different.
19. The method as described in claim 15, characterized in that, When the similarity between the first content and the first information is greater than the similarity between the second content and the first information, the first content in the first card is placed before the second content; or, When the first content in the first webpage is located before the second content, the first content in the first card is located before the second content.
20. The method according to any one of claims 15-19, characterized in that, After displaying the first interface, the method further includes: The third interface is displayed, which includes a first control. The third interface is the desktop of the electronic device, the negative one screen, or the collection interface of the first application. The first control is associated with the first card set. Receive a third user operation applied to the first control; A fourth interface is displayed, which includes the third card in the first card set.
21. The method according to any one of claims 15-19, characterized in that, The method further includes: Receive a fourth user operation applied to the first content in the first interface; The first webpage is displayed.
22. The method according to any one of claims 15-19, characterized in that, The method further includes: Receive a fifth user operation applied to the first card in the first interface; In response to the fifth user's action, delete the first card; Alternatively, receive a sixth user operation applied to the first content in the first interface; In response to the sixth user action, delete the first content.
23. The method according to any one of claims 15-19, characterized in that, The method further includes: Receive a seventh user operation applied to the first content in the first interface; In response to the seventh user's operation, the first content is modified to the third content; The third content is displayed in the first card.
24. The method according to any one of claims 15-19, characterized in that, The first content in the first card precedes the second content; the method further includes: Receive the eighth user operation applied to the first content in the first interface; In response to the eighth user's operation, adjust the display positions of the first content and the second content in the first card; The adjusted first card is displayed, and the first content in the adjusted first card is located after the second content.
25. The method according to any one of claims 15-19, characterized in that, The first card set further includes a fourth card; the method further includes: Receive the ninth user operation applied to the first content in the first interface; In response to the ninth user operation, the first content is moved from the first card to the fourth card; In response to the ninth user action, the first card does not include the first content, and the fourth card includes the first content.
26. The method according to any one of claims 15-19, characterized in that, The first card set also includes a fifth card; the method further includes: Receive the tenth user operation applied to the first card in the first interface; In response to the tenth user operation, the first card and the fifth card are merged into a sixth card, wherein the sixth card includes the contents of the first card and the contents of the fifth card.
27. The method according to any one of claims 15-19, characterized in that, The method further includes: Receive the eleventh user's operation; The fifth interface is displayed, which includes the contents of the cards in the first card set; Receive the twelfth user operation applied to the fifth interface; According to the twelfth user operation, the fourth content included in the seventh card of the first card set is obtained; Received the operation from the thirteenth user; In response to the thirteenth user operation, an eighth card is generated, which is a card from the first card set and includes the fourth content; The sixth interface is displayed, which includes the eighth card.
28. An electronic device, characterized in that, It includes a transceiver, a processor, and a memory, the memory being used to store a computer program, and the processor calling the computer program to perform the method as described in any one of claims 1-27.
29. A computer storage medium, characterized in that, The computer storage medium stores a computer program, which, when executed by a processor, implements the method described in any one of claims 1-27.
Citation Information
Patent Citations
Search information processing method, browser terminal and server
CN103617241A
Search method and device, electronic equipment and storage medium
CN111949864A