Search method and apparatus, interaction method, device, medium, and program product

WO2026218931A1PCT designated stage Publication Date: 2026-10-22TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2026/085181
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-04-18
Filing Date
2026-03-23
Publication Date
2026-10-22

Smart Images

  • Figure CN2026085181_22102026_PF_FP_ABST
    Figure CN2026085181_22102026_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to a search method, comprising: displaying an interaction interface, wherein the interaction interface comprises display content and a content capture control (S202); in response to dragging the content capture control to a first position in the interaction interface, displaying at least one associative word control in the interaction interface, wherein each associative word control displays a different associative word, the associative word is determined by both the display content and first content, and the first content is the content in the display content located in the first position (S204); in response to a trigger operation on any one associative word control, displaying at least one search intent control in the interaction interface for the triggered associative word control, wherein each search intent control displays a different search intent (S206); and in response to a trigger operation on any one search intent control, displaying a corresponding search result in the interaction interface for the triggered search intent control (S208).
Need to check novelty before this filing date? Find Prior Art

Description

Search methods, interaction methods, devices, equipment, media, and program products

[0001] This application claims priority to Chinese patent application filed on April 18, 2025, with application number 202510496018.3, entitled "Search Method, Interaction Method, Apparatus, Device, Media and Program Product", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of computer technology, and in particular to a search method, apparatus, computer device, computer-readable storage medium, and computer program product. Background Technology

[0003] With the rapid development of computer and internet technologies, information is growing explosively, data volume is expanding rapidly, and the types of data are becoming increasingly complex. Therefore, information search has become a key means for people to obtain information.

[0004] In related technologies, users can manually input or copy and paste search terms into the search box to conduct a search. This method is not only inefficient in human-computer interaction, but also consumes computing resources and memory of the terminal device used for information search due to frequent redrawing of the information search interface. Summary of the Invention

[0005] This application provides a search method, including:

[0006] The interactive interface includes display content and content capture controls;

[0007] In response to dragging the content capture control to a first position in the interactive interface, at least one associated word control is displayed in the interactive interface, and each associated word control displays a different associated word. The associated word is determined based on the displayed content and a first content, wherein the first content is the content located at the first position in the displayed content.

[0008] In response to a triggering operation on any of the aforementioned word association controls, at least one search intent control is displayed in the interactive interface for the triggered word association control, and each of the search intent controls displays a different search intent;

[0009] In response to a triggering operation on any of the search intent controls, the corresponding search results are displayed in the interactive interface for the triggered search intent control.

[0010] This application also provides a search device, including:

[0011] The first interactive interface display module is used to display the interactive interface, which includes display content and content capture controls;

[0012] The word association control display module is used to respond to dragging the content capture control to a first position in the interactive interface, display at least one word association control in the interactive interface, each word association control displays a different word association, the word association is determined by the displayed content and a first content, the first content being the content located at the first position in the displayed content;

[0013] The search intent control display module is used to respond to the triggering operation of any of the associated word controls, and to display at least one search intent control in the interactive interface for the triggered associated word control, wherein each search intent control displays a different search intent;

[0014] The search results display module is configured to display the corresponding search results in the interactive interface in response to a triggering operation on any of the search intent controls.

[0015] This application also provides a computer device, including a memory and a processor, wherein the memory stores computer-readable instructions, and the processor executes the computer-readable instructions to implement the steps of the search method described above.

[0016] This application also provides a computer-readable storage medium storing computer-readable instructions thereon, which, when executed by a processor, implement the steps of the search method described above.

[0017] This application also provides a computer program product including computer-readable instructions that, when executed by a processor, implement the steps of the search method described above.

[0018] This application provides an interaction method, including:

[0019] The interactive interface includes display content and content capture controls.

[0020] In response to dragging the content capture control to a first position in the interactive interface, a first content corresponding to the first position is determined from the displayed content;

[0021] Recommended content matching the first content is displayed in at least a portion of the interactive interface.

[0022] This application provides an interactive device, including:

[0023] The second interactive interface display module is used to display the interactive interface, which includes display content and content capture controls.

[0024] The first content determination module is configured to determine, in response to dragging the content capture control to a first position in the interactive interface, a first content corresponding to the first position from the displayed content;

[0025] A recommended content display module is used to display recommended content that matches the first content in at least a portion of the interactive interface.

[0026] This application also provides a computer device, including a memory and a processor, wherein the memory stores computer-readable instructions, and the processor executes the computer-readable instructions to implement the steps of the above-described interaction method.

[0027] This application also provides a computer-readable storage medium storing computer-readable instructions thereon, which, when executed by a processor, implement the steps of the above-described interaction method.

[0028] This application also provides a computer program product including computer-readable instructions that, when executed by a processor, implement the steps of the above-described interactive method.

[0029] The embodiments of this application can improve the efficiency of human-computer interaction, and also save the computing resources and memory of the terminal device by avoiding frequent redrawing of the information search interface because real-time dynamic search is realized in the same interactive interface. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1 is an application environment diagram of the search method in an exemplary embodiment of this application;

[0032] Figure 2 is a flowchart illustrating the search method in an exemplary embodiment of this application;

[0033] Figure 3a is a schematic diagram of the interactive interface in an exemplary embodiment of this application;

[0034] Figure 3b is a schematic diagram of the interactive interface in another exemplary embodiment of this application;

[0035] Figure 4 is a schematic diagram of the interactive interface in another exemplary embodiment of this application;

[0036] Figure 5 is a schematic diagram of the display process of the word association control in an exemplary embodiment of this application;

[0037] Figure 6 is a flowchart illustrating the steps for determining the associated word control in an exemplary embodiment of this application;

[0038] Figure 7 is a flowchart illustrating the steps for determining the search intent control in an exemplary embodiment of this application;

[0039] Figure 8 is a schematic diagram of a pop-up window displaying content in an exemplary embodiment of this application;

[0040] Figure 9 is a schematic diagram of a pop-up window displaying content in another exemplary embodiment of this application;

[0041] Figure 10 is a schematic diagram showing the search intent control in an exemplary embodiment of this application;

[0042] Figure 11 is a schematic diagram showing search results in an exemplary embodiment of this application;

[0043] Figure 12 is a schematic diagram showing search results in another exemplary embodiment of this application;

[0044] Figure 13 is a schematic diagram showing search results in another exemplary embodiment of this application;

[0045] Figure 14 is a schematic diagram showing search results in another exemplary embodiment of this application;

[0046] Figure 15 is a schematic diagram of updating search results in an exemplary embodiment of this application;

[0047] Figure 16 is a flowchart illustrating the interaction method in an exemplary embodiment of this application;

[0048] Figure 17 is a schematic diagram of the content recommendation process in an exemplary embodiment of this application;

[0049] Figure 18 is a schematic diagram of the device interaction process during a search in an exemplary embodiment of this application;

[0050] Figure 19 is a timing diagram of the search process in an exemplary embodiment of this application;

[0051] Figure 20 is a structural block diagram of a search device in an exemplary embodiment of this application;

[0052] Figure 21 is a structural block diagram of an interactive device in an exemplary embodiment of this application;

[0053] Figure 22 is an internal structural diagram of a computer device in an exemplary embodiment of this application. Detailed Implementation

[0054] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0055] In related technologies, when users browse content and encounter content they don't understand or aren't interested in, they need to search for that content. This requires the user to first open a search engine, then manually enter the content, or copy the content, then open the search engine, paste it, and finally initiate the search. This process is clearly cumbersome, especially when the user needs to switch between different interfaces to open the search engine and back, creating a poor search experience. Not only is the human-computer interaction inefficient, but the frequent redrawing of the search interface also consumes significant computing resources and memory on the terminal device used for information searching. Furthermore, this search method is based on single content, only retrieving the meaning or related information of that content, failing to identify the user's search intent and providing accurate search results that match that intent, resulting in low search efficiency.

[0056] This application provides a search method that displays an interactive interface, including display content and content capture controls. In response to dragging the content capture controls to a first position in the interactive interface, the first content at that position in the display content is accurately captured. Then, at least one related word control is displayed in the interactive interface, providing the user with at least one related word control based on the first content and the display content in the interactive interface. Since the display content reflects the contextual information of the first content, different related words in the at least one related word control can accurately match the user's current potential search needs. Subsequently, by triggering any related word control, the associated words of interest to the user can be identified, and at least one corresponding search intent control is displayed in the interactive interface. Different search intents in the at least one search intent control can accurately match the user's current potential search intent. Then, in response to triggering any of the at least one search intent control, the corresponding search results can be displayed in the interactive interface according to the user's accurate search intent. The entire search process is based on real-time dynamic search interaction within a single interactive interface. It eliminates the need for manual input or copy-pasting of search terms, accurately captures the user's search intent, and provides precise search results matching that intent, thus improving search efficiency and enhancing the user experience. It also improves human-computer interaction efficiency and saves computing resources and memory on the terminal device by avoiding frequent redrawing of the information search interface due to real-time dynamic search within the same interface.

[0057] The search method provided in this application embodiment can be applied to the application environment shown in Figure 1. The terminal 110 communicates with the server 120 via a network. A data storage system can store the data that the server 120 needs to process. The data storage system can be integrated onto the server 120 or placed on a cloud or other network server. In Figure 1, the terminal 110 displays an interactive interface 100. The interactive interface 100 includes display content, such as text 1, title 1 of text 1, text 2, and title 2 of text 2. The interactive interface 100 also includes a content capture control 101. Users can drag the content capture control 101 to any position on the interactive interface 100 to initiate real-time dynamic interaction during the search process.

[0058] In one embodiment, terminal 110 displays an interactive interface 100, which includes display content and a content capture control 101. In response to dragging the content capture control 101 to a first position in the interactive interface 100, terminal 110 generates a suggested word generation request based on the first content and the display content, and sends it to server 120. The first content is the content located at the first position in the display content, for example, "Title 1" in Figure 1. Next, server 120 searches based on the display content and the first content carried in the suggested word generation request, determines at least one suggested word, and returns it to terminal 110 for display of the suggested word control. That is, at least one suggested word in the suggested word control is determined jointly based on the display content and the first content. In response to a trigger operation on any of the associated word control, terminal 110 generates a search intent generation request based on the associated words of the triggered associated word control and sends the search intent generation request to server 120. Server 120 determines at least one search intent based on the associated words of the triggered associated word control and returns it to terminal 110. Terminal 110 displays at least one search intent control. In response to a trigger operation on any search intent control, terminal 110 generates a search request based on the search intent in the triggered search intent control and sends it to server 120. Server 120 performs a search based on the search intent in the triggered search intent control, obtains search results, and returns the search results to terminal 110. Terminal 110 displays the search results in the interactive interface 100.

[0059] Among them, terminal 110 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and IoT devices. IoT devices can be smart TVs, smart in-vehicle devices, etc. Portable wearable devices can be smartwatches, smart bracelets, head-mounted devices, etc. Server 120 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0060] This application also provides some application scenarios for the search method. For example, it can be applied in document reading, video browsing, meeting recording, and search scenarios. The following descriptions use search and reading scenarios as examples:

[0061] In a search scenario: the terminal can display an information search interface, which includes a search box and a content capture control. In response to input to the search box, the interface displays the response information corresponding to the entered search term. In response to dragging the content capture control to a first position in the information search interface, the interface displays at least one related word control for the first content, which is the content located at the first position in the response information. The at least one related word control displays different related words, determined jointly by the response information and the first content. In response to triggering any related word control, the interface displays at least one search intent control corresponding to the triggered related word control, with each search intent control displaying a different search intent. In response to triggering any search intent control, the interface displays the search result corresponding to the triggered search intent control.

[0062] In a reading scenario: the terminal can display a reading interface, which includes the content of the target work and a content capture control. In response to dragging the content capture control to a first position in the reading interface, at least one associative word control related to the first content is displayed in the reading interface. The first content is the content located at the first position in the work content. At least one associative word control displays different associative words, which are determined jointly by the work content and the first content. In response to triggering any associative word control, at least one search intent control corresponding to the triggered associative word control is displayed in the reading interface, with each search intent control displaying a different search intent. In response to triggering any search intent control, the search result corresponding to the triggered search intent control is displayed in the reading interface.

[0063] In an exemplary embodiment, as shown in FIG2, a search method is provided. Taking the application of this method to terminal 110 in FIG1 as an example, the method includes the following steps S202 to S208. Wherein:

[0064] Step S202: Display the interactive interface, which includes display content and content capture controls.

[0065] The interactive interface is the interface displayed on the terminal that allows interaction with the user. In some embodiments, the interactive interface can be an information search interface, a reading interface, a purchasing interface, etc. The displayed content is the content presented on the interactive interface, and includes at least one modal content such as text, images, audio, and video.

[0066] In one embodiment, the interactive interface is an information search interface, displaying response information for a search term. In one embodiment, the interactive interface is a reading interface, displaying the text of the target work. In one embodiment, the interactive interface is a purchase interface, displaying product information such as product images and videos. In one embodiment, the interactive interface is a video interface, displaying a video.

[0067] A content capture control is a control that captures any specific content in an interactive interface. The content capture control can be dragged to any position on the interactive interface and is used to capture the content that the user wants to trigger a search for; in this embodiment, it is referred to as the first content. When the user drags the content capture control to the first position where the first content is located, a real-time dynamic search interaction for the first content can be initiated. In one embodiment, the content capture control can be dragged to any position on the interactive interface. In one embodiment, the content capture control can be a control of any shape; for example, it can be a control shaped like a magnifying glass (see content capture control 101 in Figure 1), or a control shaped like a circle, or a control shaped like a rectangle, etc., without any specific limitation.

[0068] The first content can be achieved through an object recognition model. For example, the object recognition model can identify the main content, core content, or most attention-grabbing element in the current interactive interface as the first content. Alternatively, the first content can be achieved by real-time tracking of the content capture control's position; the content at the first position where the content capture control rests after being dragged is the first content.

[0069] In one embodiment, the content capture control includes a capture area for capturing first content. The size of the capture area can be dynamically adjusted. If the capture area cannot completely capture the first content at a first position, the capture area is enlarged so that the adjusted capture area can capture the complete first content. If the capture area also includes irrelevant content other than the first content, the capture area can be reduced so that the adjusted capture area contains irrelevant content while still capturing the complete first content.

[0070] In one embodiment, in response to a trigger operation that initiates access to the interactive interface, the terminal displays content and content capture controls within the interface. This allows the content capture controls to be displayed directly upon the user opening the interface, facilitating rapid initial content capture. In another embodiment, a content capture confirmation pop-up is displayed within the interactive interface to confirm whether the content capture controls are enabled. In response to selecting a confirmation option in the content capture confirmation pop-up, the content capture controls are overlaid within the displayed content. This pre-confirmation of the user's content capture need through the content capture confirmation pop-up improves the user's search experience.

[0071] In one embodiment, the interactive interface is an information search interface, and the content displayed in the interactive interface is the response information for the search term. The terminal can display a search box in the information search interface; in response to a submission operation triggered after a search term is entered in the search box, the response information for the search term is displayed in the response area of ​​the information search interface.

[0072] The search box is used to enter search terms, and the response information is the search results obtained based on those search terms.

[0073] In one embodiment, the terminal may display a search box in the information search interface in response to a trigger operation that allows access to the information search interface. In response to an input operation to the search box, the terminal determines the input content, which includes at least one search term. The terminal triggers a submission operation for the at least one search term, generating a search request carrying the at least one search term, which is then sent to the search server. The search server performs a local search based on the at least one search term, obtains response information for the at least one search term, and sends it to the terminal. The terminal displays the response information in the response area of ​​the information search interface.

[0074] In one embodiment, the content capture control may be displayed on the information search interface after entering the information search interface, or it may be displayed on top of the reply information after the reply information is displayed.

[0075] Figure 3a is a schematic diagram of the interactive interface in an exemplary embodiment. The interactive interface 100 in Figure 3a is an information search interface. The interactive interface 100 displays a content capture control 101 and a search box 102. When “What to wear in autumn?” is entered in the search box 102, the search terms “autumn”, “wear”, and “what” are identified. The response information obtained based on the search terms includes text 1 about “hoodie” and text 2 about “trench coat”, etc.

[0076] In this embodiment, entering a search term in the search box of the information search interface can trigger a search for the search term and obtain a response. By displaying the response information in the information search interface, users can conveniently capture the first content from the response information based on their needs using the content capture control.

[0077] In one implementation, the interactive interface is a reading interface, and the content displayed in the reading interface is the content of the target work. The terminal can display the reading interface in response to a trigger operation on the target work, and the reading interface includes content capture controls. Figure 3b is a schematic diagram of the interactive interface in another exemplary embodiment. The interactive interface 100 in Figure 3b is a reading interface, which displays content capture controls 101 and the content of an article introducing artificial intelligence.

[0078] In one embodiment, displaying an interactive interface includes: displaying an information search interface in response to a triggering operation; displaying content related to the triggering time period of the triggering operation in the information search interface, wherein the displayed content is related to a preset search intent corresponding to the triggering time period of the triggering operation.

[0079] In some embodiments, the triggering operation can be a click operation to enter the information search interface, such as a user entering the information search interface through a "search" icon. The triggering time period can be any time of day, for example, breakfast time, travel time, lunch time, etc. The triggering time period can also be any time of year, for example, spring time, summer time, etc. The preset search intent corresponding to the triggering time period is used to reflect the potential search intent when entering the interactive interface during the triggering time period. In some embodiments, different triggering time periods can be set, corresponding to different preset search intents. In some embodiments, each triggering time period can also correspond to multiple different preset search intents. Specifically, the terminal can query the corresponding preset search intent according to the triggering time period, and directly display content related to the queried preset search intent in the information search interface according to the preset search intent.

[0080] For example, if the trigger time period is from 7:00 AM to 9:00 AM, the corresponding preset search intent could be searching for breakfast shops, taxis, navigation information, or weather forecasts. Then, even before the user enters any search terms, the terminal can query the corresponding preset search intent based on this trigger time period. After finding the relevant preset search intent, it will directly display content related to "breakfast shops," "taxi," "map," and "weather forecast" on the information search interface. The format of this content is not limited; it can be images, text, animated GIFs, icons, etc.

[0081] For example, if the trigger time period is from 11 a.m. to 1 p.m., the corresponding preset search intent could be to search for lunch, to search for trending news, or to search for meeting agenda information. In this case, even if the user has not entered any search terms, the terminal can query the corresponding preset search intent based on the trigger time period. After querying the corresponding preset search intent, the terminal can directly display the content related to "lunch restaurant", "news" and "meeting agenda" in the information search interface.

[0082] In some embodiments, in response to a trigger operation that enters the interactive interface within a trigger time period, the terminal queries a corresponding preset search intent based on the trigger time period, generates a search statement based on the preset search intent, and sends the search statement to the search server. The search server performs a search based on the preset search intent carried by the search statement, determines the relevant display content, and returns it to the terminal, so that the terminal displays the search statement and the corresponding display content in the interactive interface. For example, the terminal obtains a pre-set mapping relationship between trigger time periods and preset search intents, and determines the preset search intent corresponding to the trigger time period based on this mapping relationship.

[0083] In some embodiments, the interactive interface can be an information search interface. Figure 4 is a schematic diagram of the interactive interface in an exemplary embodiment. The interactive interface 100 in Figure 4 is an information search interface. For example, after a user opens the search application in interface 130 at 11:45, and determines that the search application was opened during the lunch period (11:00 to 12:00), in response to the search application being opened during the lunch period, if the preset search intent corresponding to the lunch period is found to be lunch query, then the search box 102 in the interactive interface 100 of the search application displays the search statement "What to eat for lunch", and the content capture control 101 is displayed. Based on the preset search intent carried by the search statement, a search is performed and the displayed content is presented, including text 3 about "noodles" and text 4 about "rice", etc.

[0084] In this embodiment, by triggering the interactive interface during a trigger time period, the preset search intent associated with the trigger time period is automatically identified, and the corresponding display content is obtained based on the preset search intent and displayed on the information search interface. The entire process does not require any user input, which simplifies the user operation process and improves the user search experience.

[0085] In step S204, in response to dragging the content capture control to the first position in the interactive interface, at least one associated word control is displayed in the interactive interface, and different associated words are displayed in each associated word control. The associated words are determined together based on the displayed content and the first content, where the first content is the content located at the first position in the displayed content.

[0086] The first position can be any location within the interactive interface. The first content is the content displayed at the first position, which can be in the form of text, image, video, audio, etc. Text can be a word, sentence, or paragraph. Associated words are text obtained by performing an associative search on the displayed content and the first content at the first position. Associative search is the process of finding results related to the displayed content and the first content in the current interactive interface. Associative search is used to perform preliminary filtering of search intent, narrowing the scope of search intent and improving search efficiency. It should be noted that based on the displayed content in the interactive interface, the contextual information of the first content can be determined. Therefore, associative search based on the first content and the displayed content can also be understood as a deep search based on the first content combined with its contextual information. For example, if the first content is "trench coat" and the displayed content includes contextual information such as "hoodie" and "shirt," the associated words obtained after performing an associative search for "trench coat" include "brand," "outfit," and "accessories."

[0087] In some embodiments, in response to dragging a content capture control to a first position in the interactive interface, when the terminal detects that the first position is in a non-blank area, it displays at least one associative word control related to the first content in the interactive interface. Here, a non-blank area refers to an area containing content, such as text, images, audio, or video. It is understood that when the first position is detected to be in a blank area, meaning there is no content at the first position, at least one movement route can be displayed. The starting point of each movement route is the first position, and the corresponding ending point is a position adjacent to the first position, which is in a non-blank area, and the distance between this position and the first position is less than or equal to a distance threshold. Thus, the user can select a movement route from the at least one movement route and continue dragging the content capture control. In response to dragging the content capture control to the corresponding position, at least one associative word control related to that position is displayed. In some embodiments, the step of identifying whether the first position is in a non-blank area includes: capturing the coordinate information of the first position, querying whether content exists based on the coordinate information, and if it exists, confirming that it is in a non-blank area; if it does not exist, confirming that it is in a blank area.

[0088] In some embodiments, displaying at least one related word control in the interactive interface in response to dragging the content capture control to a first position in the interactive interface includes: displaying at least one related word control about the first content in the interactive interface in response to dragging the content capture control to the first position in the interactive interface and detecting that the related search conditions are met.

[0089] The search association criteria refer to the conditions that trigger a search association. Essentially, detecting that the search association criteria are met indicates that the user needs to perform a search association. In one embodiment, the search association criteria can be: detecting a confirmation voice command to perform a search association when dragging the content capture control to a first position on the interactive interface; or the duration of the dragged content capture control at the first position being greater than or equal to a set threshold; or the detection of a set trigger operation at the first position, such as a double-click or long-press. In this embodiment, at least one associated word control related to the first content is displayed only when the content capture control is in the first position and the search association criteria are met. This avoids the resource consumption problem caused by performing a search association without setting any conditions.

[0090] In one embodiment, after the terminal responds to dragging the content capture control to a first position in the interactive interface, if the dwell time at the first position is greater than or equal to a duration threshold, at least one associative word control about the first content is displayed in the interactive interface.

[0091] In one embodiment, after the terminal responds to dragging the content capture control to the first position, if the associated search conditions are not met, it initiates a search request based on the first content at the first position and sends it to the search server. The search server directly performs a semantic search based on the first content and returns the semantic search results to the terminal for display.

[0092] In one embodiment, when the terminal responds to dragging the content capture control to a first position in the interactive interface and detects that the suggested search conditions are met, it can fix the content capture control in the first position until the search results corresponding to the search intent control are subsequently displayed. Only then can the content capture control at the first position be dragged further, allowing it to be moved to other positions. Alternatively, after the search results corresponding to the search intent control are subsequently displayed, the content capture control can be directly de-displayed in the interactive interface. This way, fixing the content capture control in the first position or de-displaying it when the suggested search conditions are met can prevent incorrect search results caused by accidental movement of the content capture control during the suggested search process.

[0093] In some embodiments, after the terminal responds to dragging the content capture control to the first position, if the associated search criteria are not met, it allows dragging the content capture control to other positions.

[0094] In some embodiments, displaying at least one associative word control about the first content in the interactive interface includes: displaying at least one associative word control associated with the first content in an area surrounding the first content in the interactive interface.

[0095] Figure 5 is a schematic diagram of the display process of the associated word control in an exemplary embodiment. In Figure 5, the interactive interface 100 is an information search interface, which includes a search box 102. When "what to wear in autumn" is entered into the search box 102, the interactive interface 100 displays the answer information about "what to wear in autumn". At this time, the displayed content includes the entered search term and the answer information. The answer information includes "hoodie" and "text 1" about "hoodie", "trench coat" and "text 2" about "trench coat". After dragging the content capture control 101 to the first position, based on the first content "trench coat" at the first position, three associated word controls 103 are displayed. The associated words in the three associated word controls 103 are "M brand", "outfit", and "single item", respectively. The three associated word controls 103 are respectively in the area surrounding the first content "trench coat".

[0096] In some embodiments, the display area of ​​each associated word control is determined based on its historical frequency of occurrence within the area surrounding the first content. The historical frequency of occurrence is determined based on the historical search records of the currently dragging object account. A higher historical frequency indicates that the object account is more focused on searching for the corresponding associated word, thus resulting in a larger display area for the corresponding associated word control.

[0097] In this embodiment, at least one associative word control is displayed in the area surrounding the first content to highlight it and facilitate quick selection from at least one associative word control.

[0098] Figure 6 is a flowchart illustrating the process of determining the associated word control in an exemplary embodiment. Referring to Figure 6, at least one associated word control about the first content is displayed in the interactive interface, including:

[0099] Step S602: Send a suggested word generation request to the search server. The suggested word generation request carries the currently logged-in account, the content displayed in the interactive interface, and the first content.

[0100] Step S604: Receive at least one associated word from the search server in response to the associated word generation request. The associated word is determined by the search server based on the semantic analysis results obtained from the semantic analysis of the displayed content and the first content, and then based on the historical search records of the object account and the semantic analysis results.

[0101] The object account refers to the user account that performs the drag and drop operation.

[0102] In some embodiments, after receiving a suggested word generation request, the search server extracts the entities of the first content in the suggested word generation request. Using the entities in the first content and the displayed content, the search server performs semantic analysis through a context association model to obtain the semantic analysis result. The context association model is used to associate the context information of the first content in the displayed content with the first content before performing semantic analysis. In one embodiment, the context association model can be a BERT (Bidirectional Encoder Representations from Transformers) model, or a CLIP (Contrastive Language-Image Pretraining) model, etc.

[0103] In some embodiments, the interactive interface is an information search interface, and the suggested term generation request also includes the input search term. Therefore, the search server can perform semantic analysis using a context association model based on the entities in the first content, the search term, and the displayed content to obtain the semantic analysis result. To ensure the accuracy of the semantic analysis, the terminal also sends the current operation scenario and the suggested term generation request to the search server. The search server performs semantic analysis using a context association model based on the current operation scenario, the entities in the first content, the search term, and the displayed content to obtain the semantic analysis result. The current operation scenario reflects the operation type of the interactive interface. For example, if the interactive interface is an information search interface, the current operation scenario is a search scenario; if the interactive interface is a reading interface, the current operation scenario is a reading scenario.

[0104] In some embodiments, the search server determines object description information based on the historical search records of the object account that triggered the drag operation, and generates a search strategy based on the semantic analysis results and the object description information. Based on the search strategy, the search server performs parallel queries from the local database (cached content) and the cloud search engine to obtain multiple candidate related word combinations, each including at least one candidate related word. The search server uses a result ranking algorithm to score each candidate related word combination from the dimensions of timeliness and object relevance, selects a predetermined number of candidate related word combinations with the highest scores, and sends the selected candidate related word combinations to the terminal.

[0105] Step S606: Based on the received at least one associated word, display at least one associated word control about the first content in the interactive interface.

[0106] For example, the terminal determines the corresponding associated word control based on the received candidate suggested word combinations. The terminal displays at least one associated word control related to the first content in the interactive interface.

[0107] In this embodiment, by sending a suggested word generation request to the search server, the search server can perform a suggested search based on the first content carried by the suggested word generation request and the displayed content to initially find the approximate range of the search intent. Based on the suggested words in the initially found approximate range, the corresponding suggested word control is determined, which is beneficial for accurately locating the user's actual search intent in the subsequent process.

[0108] Step S206: In response to the triggering operation of any of the associated word controls, at least one search intent control is displayed in the interactive interface for the triggered associated word control, and different search intents are displayed in each search intent control.

[0109] For example, the search intent displayed in the search intent control is associated with the associated words in the triggered associated word control. Different search intents displayed in at least one search intent control can be regarded as detailed classifications of associated words in the triggered associated word control. For example, if the associated words in the triggered associated word control are regarded as categories, then different search intents displayed in at least one related search intent control can be regarded as subcategories under that category.

[0110] In one embodiment, in response to a triggering operation on any of the associated word controls, the terminal obtains the mapping relationship between the associated word controls and the search intent controls, and determines at least one search intent control corresponding to the triggered associated word control based on the mapping relationship.

[0111] In one embodiment, as shown in Figure 7, a flowchart illustrating the steps for determining a search intent control is presented. At least one search intent control corresponding to the triggered associated word control is displayed in the interactive interface, including:

[0112] Step S702: Send a search intent generation request to the search server. The search intent generation request carries the displayed content in the interactive interface and the associated words in the triggered associated word control.

[0113] Step S704: Receive at least one search intent from the search server in response to the search intent generation request. The search intent is inferred by the search server based on the displayed content and the associated words in the triggered associated word control.

[0114] In one embodiment, after receiving a search intent generation request from a terminal, the search server invokes an intent prediction model. Based on the displayed content carried in the search intent generation request and the associated words in the triggered associated word control, the intent prediction model is used to infer the intent and obtain at least one search intent.

[0115] In one embodiment, the search server, based on the received associated word controls and displayed content, filters at least one matching search intent control from all candidate search intents and returns it to the terminal. Exemplarily, the search server obtains a template of intent recognition prompt text, which includes guiding text that includes all candidate search intents. The search server inputs the received associated word controls and displayed content into this template, generates intent recognition prompt text, and calls a large language model to perform semantic understanding on the intent recognition prompt text to obtain at least one search intent control corresponding to the triggered associated word control.

[0116] Step S706: Based on the received search intent, display at least one search intent control corresponding to the triggered associated word control in the interactive interface.

[0117] For example, after receiving at least one search intent, the terminal uses each search intent as the name of a search intent control to create a corresponding search intent control. The terminal then displays at least one search intent control corresponding to the triggered suggested words control in the interactive interface.

[0118] In this embodiment, by sending a search intent generation request to the search server, the search server can selectively filter at least one search intent based on the triggered associated word control and the displayed content. This narrows down the scope of search intents, accurately perceives the user's search intent, and achieves precise search, thereby improving search efficiency.

[0119] In one embodiment, in response to a triggering operation on any of the associated word controls, displaying at least one search intent control in the interactive interface for the triggered associated word control includes: in response to a triggering operation on any of the associated word controls, displaying a content pop-up window in the interactive interface for the triggered associated word control, the content pop-up window presenting a search object corresponding to the associated word in the triggered associated word control; and displaying at least one search intent control in the area surrounding the content pop-up window in the interactive interface, each search intent control presenting a different search intent for the search object.

[0120] In one embodiment, in response to a triggering operation on any of the suggested search terms controls, the terminal displays a content pop-up window in the interactive interface for the triggered suggested search terms control. The content in the pop-up window includes at least one search object, which is associated with the suggested search terms in the triggered suggested search terms control. For example, for the suggested search terms in the triggered suggested search terms control, the associated search object can be an object in the search results after searching with that suggested search term. For example, if the suggested search term is "M brand", then the associated search object is each style of trench coat from the M brand.

[0121] In one embodiment, the content in the pop-up window can be at least one of images, text and images, or videos. The content formats of the pop-ups corresponding to different suggested word controls can be the same or different. For example, Figure 8 illustrates a schematic diagram of displaying a content pop-up window in one embodiment. The interactive interface 100 in Figure 8 is an information search interface. Clicking the suggested word control for "Brand M" in the interactive interface 100 displays a content pop-up window 104, which shows a trench coat of Brand M as the search object. For example, Figure 9 illustrates a schematic diagram of displaying a content pop-up window in another embodiment. The interactive interface 100 in Figure 9 is an information search interface. Clicking the suggested word control for "outfit" in the interactive interface 100 displays a content pop-up window 104, which shows an outfit video. A playback icon 105 for opening the outfit video can also be set on the content pop-up window 104.

[0122] In one embodiment, the terminal may, in response to a triggering operation on any of the at least one search object in the content pop-up, display at least one search intent control corresponding to the triggered search object in the area surrounding the content pop-up in the interactive interface.

[0123] For example, as shown in Figure 10, this is a schematic diagram of displaying search intent controls in one embodiment. In Figure 10, the content pop-up window 104 in the interactive interface 100 displays the search object as a certain style of trench coat from brand M. In response to a trigger operation on the search object, four associated search intent controls 106 are displayed in the area surrounding the center of the content pop-up window. The search intents of the four search intent controls 106 are "purchase", "scenario consultation" (to consult how to match the trench coat), "city temperature query", and "material comparison".

[0124] In one embodiment, when the content pop-up is a video, in response to a triggering operation on any search object in the target video frame, at least one search intent control corresponding to the target video frame and the triggered search object is displayed in the area surrounding the content pop-up in the interactive interface. The target video frame is any video frame in the video.

[0125] In this embodiment, in response to a trigger operation on any associated word, a content pop-up window is displayed in the interactive interface for the triggered associated word control. Since the content pop-up window contains search objects corresponding to the associated words in the associated word control, at least one search intent control matching the associated word is quickly and accurately found, thereby further narrowing the scope of the search intent and ensuring the accuracy of the search.

[0126] In one embodiment, displaying at least one search intent control in the area surrounding the content pop-up in the interactive interface includes: in response to an interactive operation on a search object within the content pop-up, displaying at least one search intent control related to the search object in the area surrounding the content pop-up in the interactive interface.

[0127] Interactive actions are used to indicate whether an individual is interested in the search result. In one embodiment, interactive actions may include actions such as adding to favorites, liking, sharing, and editing the search result.

[0128] In one embodiment, there are multiple preset interactive operations targeting a search object, each with a corresponding level of importance. The terminal can respond to the target interactive operation on the search object within the content pop-up window by displaying at least one search intent control related to the search object in the area surrounding the content pop-up window in the interactive interface. The target interactive operation is one of multiple interactive operations targeting the search object, and the number of search intent controls related to the search object is related to the importance of the target interactive operation; the higher the importance, the more search intent controls are available. For example, there are four operations: favorite, like, share, and edit. Their importance, from highest to lowest, is: favorite, edit, share, like, with 4, 3, 2, and 1 search intent controls respectively.

[0129] In one embodiment, in response to an interactive operation targeting at least one search object within a content pop-up window, the terminal may sequentially display at least one search intent control corresponding to at least one search object in the area surrounding the content pop-up window in the interactive interface. The at least one search intent control is determined jointly based on at least one search object.

[0130] In this embodiment, the terminal can respond to interactive operations on the search object within the content pop-up window, and highlight at least one search intent control related to the search object in the area surrounding the content pop-up window in the interactive interface. This facilitates more intuitive browsing for the user and makes it easier for the user to trigger the search intent control, thereby improving the user's search experience.

[0131] In one embodiment, the terminal may, in response to an interactive operation on a search object within a content pop-up window, cancel the display of at least one related word control other than the triggered related word control in the interactive interface.

[0132] In this embodiment, after performing an interactive operation on the search object, other related word controls are hidden to make it easier for users to clearly view at least one search intent control, thus simplifying the interactive interface.

[0133] In one embodiment, the terminal may, in response to a triggering operation of any search intent control, display a predictive search return control in the interactive interface; and, in response to a triggering operation of the predictive search return control, display at least one predictive word control related to the first content again in the interactive interface.

[0134] In this embodiment, the associative search return control is used to redisplay at least one associative word control in the interactive interface. This allows users to reselect other associative word controls even after the search intent control has been triggered, without needing to regenerate them, thus improving search convenience.

[0135] In step S208, in response to the triggering operation of any search intent control, the corresponding search results are displayed in the interactive interface for the triggered search intent control.

[0136] The search results can be recommended content, which can take the form of images, videos, text and images, purchase pages, etc.

[0137] In one embodiment, in response to a triggering operation of any search intent control, the terminal initiates a search request for the triggered search intent control, sends the search request to the search server, the search server performs a search based on the search intent of the triggered search intent control, obtains the search results, returns the search results to the terminal, and the terminal displays the search results corresponding to the triggered search intent control in the interactive interface.

[0138] In one embodiment, in response to a triggering operation on any search intent control, displaying the corresponding search results in the interactive interface for the triggered search intent control includes: in response to a triggering operation on any search intent control, displaying a preview area in the interactive interface, and presenting the search results corresponding to the triggered search intent control in the preview area.

[0139] For example, as shown in Figure 11, this is a schematic diagram of displaying search results in one embodiment. Clicking one of the search intent controls, namely "Purchase," in the interactive interface 100 displays a corresponding preview area 107. Preview area 107 includes search result 1 corresponding to "Purchase," which includes images of trench coats in two colors, detailed information, a favorites control, purchase amount details (222.2 yuan), customer service controls, etc. For example, as shown in Figure 12, this is a schematic diagram of displaying search results in another embodiment. Clicking one of the search intent controls, namely "Material Comparison," in the interactive interface 100 displays a corresponding preview area 107. Preview area 107 includes search result 2 corresponding to the search intent "Material Comparison," which includes information such as the trench coat's material 1 content being 100%, a favorites control for material comparison details, a comparison control for material 1 and material 2 comparison details, and a comparison control for material 1 and material 3 comparison details, etc. In response to a trigger operation on any comparison control, the corresponding comparison result is displayed.

[0140] In this embodiment, in response to the triggering operation of any search intent control, a preview area is displayed in the interactive interface. Thus, without switching to other interfaces, users can directly browse search results in the interactive interface, avoiding interface switching operations and improving the user search experience.

[0141] In one embodiment, the terminal may, in response to a triggering operation on another search intent control, display the search results corresponding to the other triggered search intent control in the preview area.

[0142] For example, as shown in Figure 13, this is a schematic diagram of displaying search results in another embodiment. First, if a search intent control with the search intent of "purchase" is selected, a corresponding preview area 107 is displayed in the interactive interface 100. This preview area 107 includes search result 1 corresponding to the search intent of "purchase". The information contained in search result 1 can be seen in Figure 11. During the display of search result 1, if a search intent control with the search intent of "material comparison" is reselected, search result 1 is de-displayed in the preview area 107, and search result 2 is displayed. The information contained in search result 2 can be seen in Figure 12.

[0143] In this embodiment, in response to the triggering operation of other search intent controls, the search results corresponding to the other triggered search intent controls are directly displayed in the preview area, which makes it convenient for users to switch and view the search results of different search intent controls in real time according to their needs, thereby improving the user search experience.

[0144] In one embodiment, the terminal may, in response to a selection operation of at least one search intent control, display an intent merging control for the at least one search intent control in the interactive interface; and in response to a trigger operation of the intent merging control, display search results in the interactive interface, the search results being obtained based on at least one search intent in the at least one search intent control.

[0145] The intent merging control is used to merge at least two search intent controls.

[0146] For example, in response to the selection of at least one search intent control, an intent merging control for the selected at least one search intent control is displayed in the interactive interface. In response to a triggering operation of the intent merging control, the terminal merges the individual search intents of the selected at least one search intent to obtain a merged search intent. The terminal sends a search request carrying the merged search intent to the search server. The search server performs a search based on the merged search intent, obtains search results for the merged search intent, and returns them to the terminal. The terminal displays the search results in a preview area.

[0147] In this embodiment, by selecting at least one search intent control, an intent merging control is displayed. Based on this, a comprehensive search is performed by combining the search intents of the selected at least one search intent control, thereby improving the flexibility of the search.

[0148] In one embodiment, the interactive interface displaying at least one search intent control further includes an intent query control. In response to a triggering operation on the intent query control, the terminal can display a statement input box, which includes a query statement about the first content. The query statement is a question generated based on the first content and the associated words in the triggered associated word control. In response to a triggering operation on the query statement, a newly added search intent control is displayed. The search intent in the newly added search intent control is generated based on the first content, the associated words in the triggered associated word control, and the historical search records of other object accounts. In response to a triggering operation on the newly added search intent control, the search results corresponding to the triggered newly added search intent control are displayed in the interactive interface.

[0149] Among them, the intent query control is used to generate new search intent controls.

[0150] In one embodiment, in response to a triggering operation of an intent query control, the terminal displays a statement input box in the interactive interface. The query statement in the statement input box is a question automatically generated by the terminal based on the first content, the associated words in the triggered word association control, and at least one displayed search intent control. For example, the query statement could be in the form of: "Please query the associated words for the first content and the triggered word association control, and retrieve any newly added search intent controls in addition to the at least one displayed search intent control." That is, when there is no actual user search intent in at least one search intent control, a query statement is automatically generated by triggering the intent query control to regenerate the newly added search intent control.

[0151] In one embodiment, in response to a triggered query statement, the terminal sends the query statement to the search server. The search server retrieves the historical search records of other object accounts, generates query prompt text based on these historical search records and the query statement, calls a large language model to perform semantic understanding on the query prompt text, outputs a newly added search intent control, and returns it to the terminal. The terminal displays the newly added search intent control. Thus, in response to a triggered operation on the newly added search intent control, the search results corresponding to the newly added search intent control are displayed in the interactive interface.

[0152] In one embodiment, the terminal can display an intent query control in the interactive interface in response to a closing operation of each of the multiple intent search controls. Thus, upon detecting a closing operation of each intent search control, it indicates that none of the multiple intent search controls represent the user's actual search intent, and therefore, the intent query control is displayed in the interactive interface.

[0153] In one embodiment, once the display duration of each intent search control in the interactive interface reaches a duration threshold, the display of multiple intent search controls in the interactive interface is canceled, indicating that none of the multiple intent search controls represent the user's actual search intent. At this time, an intent query control is displayed in the interactive interface.

[0154] In this embodiment, in response to the triggering operation of the intent query control, the newly added search intent control can be regenerated, providing users with additional search intent options without the need for manual input, thus improving the user search experience.

[0155] In the above search method, an interactive interface is displayed, which includes display content and content capture controls. In response to dragging the content capture control to a first position in the interactive interface, the first content at that first position in the display content is accurately captured. Then, at least one related word control is displayed in the interactive interface, providing the user with at least one related word control based on the first content and the display content in the interactive interface. Since the display content reflects the contextual information of the first content, different related words in the at least one related word control can accurately match the user's current potential search needs. Subsequently, by triggering any related word control, the related words that the user is interested in can be identified, and at least one corresponding search intent control is displayed in the interactive interface. Different search intents in the at least one search intent control can accurately match the user's current potential search intent. Then, in response to triggering any of the at least one search intent control, the corresponding search results can be displayed in the interactive interface according to the user's accurate search intent. The entire search process is based on real-time dynamic search interaction on a single interactive interface. It eliminates the need for manual input or copy-pasting of search terms, accurately captures the user's search intent, and provides accurate search results that match that intent, thus improving search efficiency and enhancing the user's search experience.

[0156] In one embodiment, the terminal may respond to dragging a content capture control to a first position in the interactive interface, display at least one search intent control in the interactive interface for the first content, the at least one search intent control being determined jointly based on the first content and the displayed content; and respond to a triggering operation on any search intent control, display the search results corresponding to the triggered search intent control in the interactive interface.

[0157] In one embodiment, in response to dragging a content capture control to a first position in the interactive interface, the terminal sends a search intent generation request carrying first content and displayed content to the search server. Based on the first content and displayed content, the search server filters out multiple matching candidate search intents from a set of candidate search intents, determines at least one search intent control based on the filtered candidate search intents, and returns it to the terminal.

[0158] For example, as shown in Figure 14, this is a schematic diagram of displaying search results in another embodiment. In response to dragging the content capture control 101 to a first position on the interactive interface 100, where the first content at the first position is "trench coat," the terminal displays four search intent controls on the interactive interface 100 for the first content. The search intents of the four search intent controls are respectively "purchase," "scene consultation," "city temperature query," and "material comparison." In response to triggering an operation on the search intent control corresponding to "purchase," a preview area 107 is displayed on the interactive interface. This preview area 107 includes search result 1 corresponding to the search intent "purchase."

[0159] In this embodiment, in response to dragging the content capture control to the first position, at least one search intent control is determined directly based on the first content and the displayed content, thereby enabling quick acquisition of search results and improving search efficiency.

[0160] In one embodiment, the terminal may update the search results for the current first content in the interactive interface in response to dragging the content capture control from a first position to a second position. The search results for the current first content are determined jointly based on the current first content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control. The current first content is the content located in the second position of the displayed content.

[0161] The second position refers to any other position in the interactive interface besides the first position, and the current first content is the content displayed in the second position.

[0162] In one embodiment, after moving the content capture control from the first position to the second position, if the entity of the first content at the first position and the entity of the first content at the second position belong to different entities of the same attribute, such as "trench coat" and "hoodie" belonging to the clothing attribute, then the process returns to continue execution in response to the step of dragging the content capture control from the first position to the second position.

[0163] In one embodiment, if the content capture control does not belong to different attributes, for example, "trench coat" and "shoes" belong to the clothing attribute and footwear attribute respectively, then after moving the content capture control from the first position to the second position, the terminal can display at least one associative word control about the first content at the second position in the interactive interface. The different associative words in the at least one associative word control are determined jointly based on the first content at the second position and the displayed content. Then, the process returns to step S206 to continue execution.

[0164] For example, as shown in Figure 15, this is a schematic diagram of updating search results in one embodiment. During the process of displaying the search results for "trench coat" in the preview area 107 of the interactive interface 100, after dragging the content capture control from the first position where "trench coat" is located to the second position where "hoodie" is located, following the dragging path indicated by the dotted arrow in Figure 15, the search results for "hoodie" are directly displayed in the preview area 107. These search results show images of two styles of hoodies and details of the purchase amount (120 yuan). Since the search results for "trench coat" are generated based on "trench coat," "M brand," and "purchase," the search results for "hoodie" are also generated based on "M brand," "purchase," and "hoodie."

[0165] In this embodiment, in response to dragging the content capture control from the first position to the second position, the search results of the first content at the second position are directly displayed in the interactive interface. This eliminates the need for the user to select the related word control and search intent control one by one, simplifying the search process at the second position and improving search efficiency.

[0166] In one embodiment, as shown in FIG16, an interaction method is provided. Taking the application of this method to terminal 110 in FIG1 as an example, the method includes the following steps S1602 to S1606:

[0167] Step S1602: Display the interactive interface, which includes display content and content capture controls.

[0168] Step S1604: In response to dragging the content capture control to the first position in the interactive interface, determine the first content corresponding to the first position from the displayed content.

[0169] Step S1606: Display recommended content that matches the first content in at least a portion of the interactive interface.

[0170] The recommended content can take the form of images, videos, text and images, purchase pages, etc. In one embodiment, the recommended content is associated with the first content. For example, if the first content is "trench coat," then the recommended content is a video or text and images recommending a trench coat. Or, if the first content is "thirsty," then the recommended content is a beverage purchase interface. In one embodiment, the recommended content can be content obtained through AI search based on the first content. Figure 17 illustrates a schematic diagram of the content recommendation process in one embodiment. The interactive interface 100 displays content including the text 1 for "hoodie" and the text 2 for "trench coat." After dragging the content capture control 101 to the first position, the first content at the first position is determined to be "trench coat." At this time, a preview area 107 is displayed in the interactive interface 100. The preview area 107 is used to display the recommended content for "trench coat," which includes detailed information and purchase controls for the "trench coat."

[0171] In one embodiment, in response to dragging a content capture control to a first position in the interactive interface, determining the first content corresponding to the first position from the displayed content includes: in response to sequentially dragging the content capture control to a plurality of first positions in the interactive interface, determining a plurality of first contents corresponding to the plurality of first positions from the displayed content.

[0172] In one embodiment, after dragging the content capture control sequentially to multiple first positions in the interactive interface, and if a recommendation trigger operation is detected at each first position, multiple first contents corresponding to the multiple first positions are determined from the displayed content. Here, the recommendation trigger operation refers to recommending content at the corresponding position. For example, the recommendation trigger operation can be a long press, a pause operation, a double-click operation, etc. For instance, in response to a double-click operation after each dragging of the content capture control to the corresponding first position, the first content at that position is determined.

[0173] In this embodiment, by dragging the content capture control sequentially to multiple first positions in the interactive interface, multiple first positions can be anchored. Therefore, subsequent joint recommendations can be made based on multiple first positions to ensure the recommendation effect.

[0174] In one embodiment, displaying recommended content matching the first content in at least a portion of the interactive interface includes: generating a promotion request based on the content corresponding to each location; sending the promotion request to a promotion server; receiving recommended content from the promotion server in response to the promotion request; and displaying the received recommended content in at least a portion of the interactive interface.

[0175] The promotion request carries multiple pieces of first content. In one embodiment, after receiving the promotion request from the terminal, the promotion server determines the corresponding recommended content based on at least the multiple pieces of first content in the promotion request. For example, the promotion server can obtain object information of the account performing the drag-and-drop operation, and determine the corresponding recommended content based on the object information and the multiple pieces of first content. In one embodiment, after the terminal obtains the recommended content, the terminal can generate a search request based on the multiple pieces of first content, send the search request to the search server, receive the search results returned by the search server in response to the search request, and display the search results and recommended content in the interactive interface.

[0176] In this embodiment, in response to dragging the content capture control sequentially to multiple first positions in the interactive interface, joint recommendations can be made based on the first content corresponding to each first position, ensuring the recommendation effect.

[0177] In one embodiment, the interactive interface is an information search interface, displaying response information for a search term; in response to dragging a content capture control to a first position in the interactive interface, determining first content corresponding to the first position from the displayed content includes: in response to dragging the content capture control to the first position in the information search interface, determining the text located at the first position from the response information. Displaying recommended content matching the first content in at least a portion of the interactive interface includes: displaying recommended content matching the target text in at least a portion of the information search interface.

[0178] In one embodiment, after determining the target text, the terminal generates a promotion request based on the content corresponding to each location; sends the promotion request to the promotion server; receives recommended content from the promotion server in response to the promotion request; and displays the received recommended content, which is content matching the target text, in at least a portion of the interactive interface. In this embodiment, by sending a promotion request to the promotion server, the promotion server can make accurate recommendations based on the target text, thereby improving recommendation accuracy.

[0179] In this embodiment, entering a search term in the search box of the information search interface can trigger a search for the search term and obtain a response. By displaying the response information in the information search interface, users can conveniently capture target text from the response information based on their needs using the content capture control.

[0180] In one embodiment, the interactive interface is a video playback interface, and the displayed content includes the video frame of the target video being played; in response to dragging the content capture control to a first position in the interactive interface, determining the first content corresponding to the first position from the displayed content includes: in response to dragging the content capture control to the first position in the video frame, pausing the playback of the target video, and determining the first content corresponding to the first position from the paused video frame.

[0181] The first element can be a person in the video, their clothing, a building, or words in the subtitles, etc.

[0182] In this embodiment, the content capture control can be used to select any position in any frame of the video. This allows for real-time recommendation of the first content dragged to the first position by the content capture control, thus realizing content recommendation in the video scene.

[0183] In one embodiment, determining the first content corresponding to a first position from a paused video frame includes: taking a screenshot of the paused video frame to obtain a screenshot image, the screenshot image including a content capture control; performing image recognition on the screenshot image to obtain the first content at the first position where the content capture control is located in the video frame; and displaying recommended content matching the first content in at least a portion of the interactive interface, including: displaying recommended content matching the first content in at least a portion of the video playback interface.

[0184] For example, in response to dragging the content capture control to a first position in the video frame, a screenshot of the paused video frame is taken with the first position as the center, resulting in a screenshot image of a preset size. The preset size is less than or equal to the size of the video frame. For example, the terminal sends a promotion request carrying the first content to a promotion server, and the promotion server filters out recommended content related to the first content from multiple candidate recommended content based on the first content.

[0185] In this embodiment, by taking a screenshot of the paused video frame, a screenshot image containing the content capture control is obtained. Thus, the first position can be determined by recognizing the content capture control, thereby obtaining the first content at the first position. This allows recommended content matching the first content to be displayed in at least a portion of the video playback interface.

[0186] In the above interaction method, an interactive interface is displayed, which includes display content and a content capture control. Thus, in response to dragging the content capture control to a first position in the interactive interface, the first piece of content located at that first position in the display content is accurately captured. This allows for accurate content recommendations to be made to the user based on the first piece of content, and recommends content matching the first piece of content is directly displayed in at least a portion of the interactive interface, improving the user's interactive experience.

[0187] In one specific embodiment, as shown in Figure 18, it is a schematic diagram of the device interaction process during a search. Figure 18 mainly illustrates the interaction process between the terminal and the search server. The terminal in Figure 18 includes an interactive result presentation layer, which includes an embedded display unit and a multimodal interaction unit. The embedded display unit is used to overlay and display the results corresponding to each triggered operation on the current interface in the form of floating cards, supporting quick preview and interaction. The multimodal interaction unit is used to support the display of multiple types such as text, video, and icons. After responding to the triggered operation, the terminal sends a response request to the search server to instruct the search server to perform corresponding processing. The terminal renders and displays the results returned by the search server in the interactive interface. The search server can be used for first content recognition, semantic analysis, and search. The search server can also perform local searches from the local database and return local results, and perform cloud searches from the cloud search engine and return cloud results. The search server can also sort the search results (local results and cloud results) according to the result sorting algorithm to present them to the user through interactive results. The search server is used to process user requests, coordinate the workflow of each execution step, and is responsible for communication with the external cloud server interface to obtain corresponding data and services. The search server also provides an external cloud server interface to offer additional data resources and computing power, supporting complex searches and semantic analysis. Figure 19 shows a timing diagram of the search process in one embodiment. The search process is described with reference to Figures 19 and 18, and the specific implementation steps are as follows:

[0188] Step S1901: The user performs the first drag operation on the content capture control.

[0189] The first drag operation is the operation of dragging the content capture control to the first position in the interactive interface.

[0190] In some embodiments, after the user performs a first drag operation on the content capture control, the terminal sends a first content recognition request to the search server in response to dragging the content capture control to a first position on the interactive interface. The first drag event refers to the event where the user drags the content capture control to the first position. Based on the first position carried in the first content recognition request, the search server identifies the first content at the first position and returns it to the terminal. In this embodiment, the search server may have a focus content recognition function, which identifies the focus content at the focus point in the interface. The focus point is the position of the content capture control on the interface, such as the first position described above. The focus content can be considered as the first content at the first position where the content capture control is located.

[0191] In other embodiments, the terminal also communicates with a focus content recognition server via a network. To this end, in response to dragging a content capture control to a first position in the interactive interface, the terminal sends a first content recognition request to the focus content recognition server. The focus content recognition server, based on the first position carried in the first content recognition request, identifies the first content at the first position and returns it to the terminal. This focus content recognition server is used to identify the first content at the location of the content capture control. The first position can be determined by coordinate capture performed by a computer vision unit in the focus recognition layer of the terminal. The focus recognition layer is deployed on the terminal and has the function of capturing the coordinate information of the content capture control in the interactive interface to determine the first position.

[0192] In some embodiments, the terminal displays an interactive interface, which shows content and content capture controls.

[0193] For example, the interactive interface is an information search interface, and the displayed content in the interactive interface is the response information for the search term. The terminal can display the information search interface, which includes a search box; in response to a submission operation triggered after a search term is entered in the search box, the response information for the search term is displayed in the response area of ​​the information search interface, and the response information is the displayed content.

[0194] For example, the interactive interface is an information search interface. The terminal can display the information search interface in response to a trigger operation; the information search interface displays content related to the trigger time period of the trigger operation, and the displayed content is related to a preset search intent corresponding to the trigger time period of the trigger operation.

[0195] Step S1902: The terminal generates a suggested word generation request.

[0196] In some embodiments, after determining the first content at the first location, the terminal responds by dragging the content capture control to the first location in the interactive interface and generating a word association generation request. The word association generation request carries the user's object account, the displayed content in the interactive interface, and the first content.

[0197] Step S1903: The terminal sends a request to generate associated words.

[0198] For example, the terminal sends a suggested word generation request to the search server.

[0199] Step S1904: The search server generates at least one related word.

[0200] In some embodiments, after the search server performs semantic analysis based on the displayed content and the first content to obtain semantic analysis results, it determines the target account based on its historical search records and the semantic analysis results. For example, the upper and lower modeling layers in the search server perform semantic analysis based on the displayed content and the first content in the associated word generation request, and generate a search strategy based on the semantic analysis results and the historical search records of the target account executing the drag-and-drop. The dynamic retrieval layer in the search server performs local retrieval from the local database based on the search strategy, returning local results, and performs cloud retrieval from the cloud search engine based on the search strategy, returning cloud results. The search server determines at least one associated word based on the local results and the cloud search results.

[0201] Step S1905: The search server sends at least one related word.

[0202] In some embodiments, the search server sends at least one associated word determined about the first content to the terminal.

[0203] Step S1906: The terminal displays at least one associated word control on the interactive interface based on at least one associated word.

[0204] In some embodiments, after acquiring at least one associated word control, in response to dragging a content capture control to a first position in the interactive interface, if the terminal detects that the associated search conditions are met at the first position, it displays at least one associated word control related to the first content in the interactive interface. For example, displaying at least one associated word control related to the first content in the interactive interface includes: displaying at least one associated word control associated with the first content in a surrounding area centered on the first content in the interactive interface. The terminal's behavior analysis engine can deduce whether the user's intent is an associated search intent based on whether the associated search conditions are detected to be met.

[0205] Step S1907: The user performs a trigger operation on any of the associated word controls.

[0206] Step S1908: The terminal generates a search intent generation request.

[0207] In some embodiments, in response to a triggering operation on any of the suggested word controls, the terminal generates a search intent generation request. This search intent generation request carries the displayed content in the interactive interface and the suggested words from the triggered suggested word controls.

[0208] Step S1909: The terminal sends a search intent generation request.

[0209] In some embodiments, the terminal sends a search intent generation request to the search server.

[0210] Step S1910: The search server generates at least one search intent.

[0211] In some embodiments, the search server infers intent based on the displayed content and the associated words in the triggered associated word control to obtain at least one search intent corresponding to the triggered associated word control.

[0212] Step S1911: The search server sends at least one search intent.

[0213] In some embodiments, the search server sends at least one search intent corresponding to the triggered associated word control to the terminal.

[0214] Step S1912: The terminal displays at least one search intent control in the interactive interface based on at least one search intent.

[0215] In some embodiments, after determining at least one search intent control, the terminal, in response to a triggering operation on any of the associated word controls, displays a content pop-up window in the interactive interface for the triggered associated word control, and the content pop-up window presents the search object corresponding to the associated word in the triggered associated word control; in the interactive interface, at least one search intent control is displayed in the area surrounding the content pop-up window, and each search intent control presents a different search intent for the search object.

[0216] In some embodiments, at least one search intent control is displayed in the area surrounding the content pop-up in the interactive interface, including: in response to an interactive operation on a search object within the content pop-up, displaying at least one search intent control related to the search object in the area surrounding the content pop-up in the interactive interface.

[0217] In some embodiments, the terminal may, in response to an interactive operation on a search object within a content pop-up window, cancel the display of at least one associated word control other than the triggered associated word control in the interactive interface; the terminal may also, in response to a triggering operation on any search intent control, display an associated search return control in the interactive interface; and in response to a triggering operation on the associated search return control, display at least one associated word control related to the first content again in the interactive interface.

[0218] Step S1913: The user performs a trigger operation on any search intent control.

[0219] Step S1914: The terminal generates a search request.

[0220] In some embodiments, the terminal generates a search request in response to a triggering operation on any search intent control, the search request carrying the triggered search intent control.

[0221] Step S1915: The terminal sends a search request.

[0222] In some embodiments, the terminal sends a search request to the search server.

[0223] Step S1916: The search server determines the search results.

[0224] In some embodiments, the search server searches from a local database and a cloud search engine based on the search intent corresponding to the triggered search intent control to determine the search results for the triggered search intent control.

[0225] Step S1917: The search server sends the search results.

[0226] In some embodiments, the search server sends search results to the terminal.

[0227] Step S1918: The terminal displays the search results on the interactive interface.

[0228] In some embodiments, after the terminal obtains the search results, the terminal responds to the triggering operation of any search intent control by displaying a preview area in the interactive interface and presenting the search results corresponding to the triggered search intent control in the preview area; the terminal may also respond to the triggering operation of other search intent controls by presenting the search results corresponding to the other triggered search intent controls in the preview area.

[0229] In some embodiments, after performing step S1912, the terminal may also, in response to the selection operation of at least one search intent control, display an intent merging control for at least one search intent control in the interactive interface; and in response to the triggering operation of the intent merging control, display search results in the interactive interface, the search results being obtained based on at least one search intent in at least one search intent control.

[0230] In some embodiments, after step S1912 is executed, the interactive interface of the terminal displaying at least one search intent control further includes an intent query control. In response to a triggering operation on the intent query control, the terminal displays a statement input box, which includes a query statement about the first content. The query statement is a question generated based on the first content and the associated words in the triggered associated word control. In response to a triggering operation on the query statement, a newly added search intent control is displayed. The search intent in the newly added search intent control is generated based on the first content, the associated words in the triggered associated word control, and the historical search records of other object accounts. In response to a triggering operation on the newly added search intent control, the search results corresponding to the triggered newly added search intent control are displayed in the interactive interface.

[0231] In some embodiments, after step S1918 is executed, the terminal responds to dragging the content capture control from the first position to the second position and updates the search results for the current first content in the interactive interface. The search results for the current first content are determined together based on the current first content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control. The current first content is the content located in the second position of the displayed content.

[0232] In some embodiments, after step S1901 is executed, the terminal responds by dragging the content capture control to a first position in the interactive interface, and displays at least one search intent control for the first content in the interactive interface. The at least one search intent control is determined jointly based on the first content and the displayed content. In response to a triggering operation on any search intent control, the terminal displays the search results corresponding to the triggered search intent control in the interactive interface.

[0233] In this embodiment, an interactive interface is displayed, which includes display content and content capture controls. In response to dragging the content capture controls to a first position in the interactive interface, the first content at that position in the display content is accurately captured. Then, at least one related word control is displayed in the interactive interface, providing the user with at least one related word control based on the first content and the display content in the interactive interface. Since the display content reflects the contextual information of the first content, different related words in the at least one related word control can accurately match the user's current potential search needs. Subsequently, by triggering any related word control, the related words that the user is interested in can be identified, and at least one corresponding search intent control is displayed in the interactive interface. Different search intents in the at least one search intent control can accurately match the user's current potential search intent. Then, in response to triggering any of the at least one search intent control, the corresponding search results can be displayed in the interactive interface according to the user's accurate search intent. The entire search process is based on real-time dynamic search interaction within a single interactive interface. It eliminates the need for manual input or copy-pasting of search terms, accurately captures the user's search intent, and provides precise search results matching that intent, thus improving search efficiency and enhancing the user experience. Furthermore, it can perform searches based on the specific scenarios involved in the interactive interface, further improving efficiency. Moreover, the use of contextual information in the displayed content for associative search ensures the accuracy of search results and increases click-through rates. Additionally, the entire process is triggered naturally, enhancing the user search experience.

[0234] In one specific embodiment, an interaction method is provided, comprising the following steps: A terminal displays an interactive interface, which includes display content and a content capture control. In response to dragging the content capture control to at least one first position in the interactive interface, first content corresponding to the at least one first position is determined from the display content. The terminal generates a promotion request based on the content corresponding to each position; sends the promotion request to a promotion server; receives recommended content from the promotion server in response to the promotion request; and displays the received recommended content in at least a portion of the interactive interface.

[0235] The following examples illustrate the interaction process in search and video playback scenarios: When the interaction interface is an information search interface, the displayed content is the response information for the search term; at this time, in response to dragging the content capture control to the first position in the information search interface, the text located at the first position is determined from the response information, and recommended content matching the text is displayed in at least a part of the information search interface.

[0236] When the interactive interface is a video playback interface, the displayed content includes the video frame of the target video being played. At this time, in response to dragging the content capture control to a first position in the video frame, the playback of the target video is paused, and a screenshot is taken of the paused video frame, resulting in a screenshot image including the content capture control. Image recognition is performed on the screenshot image to obtain the first content at the first position of the content capture control in the video frame. Recommended content matching the first content is displayed in at least a portion of the video playback interface.

[0237] In this embodiment, an interactive interface is displayed, which includes display content and a content capture control. Thus, in response to dragging the content capture control to a first position in the interactive interface, the first content located at the first position in the display content is accurately captured. This allows for accurate content recommendations to be made to the user based on the first content, and recommends content matching the first content is directly displayed in at least a portion of the interactive interface, improving the user's interactive experience.

[0238] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0239] Based on the same inventive concept, this application also provides a search apparatus for implementing the search method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, specific limitations in one or more search apparatus embodiments provided below can be found in the limitations of the search method described above, and will not be repeated here.

[0240] In an exemplary embodiment, as shown in FIG20, a search device 2000 is provided, including: a first interactive interface display module 2002, a word association control display module 2004, a search intent control display module 2006, and a search result display module 2008, wherein:

[0241] The first interactive interface display module 2002 is used to display the interactive interface, which includes display content and content capture controls.

[0242] The word association control display module 2004 is used to respond to dragging the content capture control to a first position in the interactive interface, and to display at least one word association control about the first content in the interactive interface. The first content is the content located at the first position in the displayed content, and different words in the at least one word association control are determined together based on the displayed content and the first content.

[0243] The search intent control display module 2006 is used to display at least one search intent control corresponding to the triggered associated word control in the interactive interface in response to the triggering operation of any associated word control.

[0244] The search results display module 2008 is used to display the search results corresponding to the triggered search intent control in the interactive interface in response to the triggering operation of any search intent control.

[0245] In one embodiment, the interactive interface is an information search interface, and the interactive interface includes display content that is response information for the search term. The first interactive interface display module 2002 is also used to display a search box in the information search interface; in response to triggering a submission operation for the search term after entering a search term in the search box, the response information for the search term is displayed in the response area of ​​the information search interface.

[0246] In one embodiment, the first interactive interface display module 2002 is further configured to display an information search interface in response to a trigger operation; the information search interface displays display content related to the trigger time period of the trigger operation, and the display content is related to the preset search intent corresponding to the trigger time period of the trigger operation.

[0247] In one embodiment, the word association control display module 2004 is configured to display at least one word association control about the first content in the interactive interface after dragging the content capture control to a first position in the interactive interface and detecting that the word association search conditions are met at the first position.

[0248] In one embodiment, the word association control display module 2004 is used to display at least one word association control associated with the first content in an area surrounding the first content in the interactive interface.

[0249] In one embodiment, the associated word control display module 2004 is configured to send an associated word generation request to the search server, the associated word generation request carrying the currently logged-in object account, the display content presented in the interactive interface, and the first content; receive at least one associated word from the search server in response to the associated word generation request, the associated word being determined by the search server based on the semantic analysis results obtained from the semantic analysis of the display content and the first content, and then based on the historical search records of the object account and the semantic analysis results; and display at least one associated word control related to the first content in the interactive interface according to the received at least one associated word.

[0250] In one embodiment, the search intent control display module 2006 is configured to, in response to a triggering operation of any associated word control, display a content pop-up window in the interactive interface for the triggered associated word control, the content pop-up window presenting a search object corresponding to the associated word in the triggered associated word control; and display at least one search intent control in the area surrounding the content pop-up window in the interactive interface, each search intent control presenting a different search intent for the search object.

[0251] In one embodiment, the search intent control display module 2006 is configured to, in response to an interactive operation on a search object within a content pop-up window, display at least one search intent control related to the search object in the area surrounding the content pop-up window in the interactive interface.

[0252] In one embodiment, the apparatus further includes a word association control display cancellation module, configured to, in response to an interactive operation on a search object within a content pop-up window, cancel the display of at least one word association control other than the triggered word association control in the interactive interface; the word association control display module 2004 is further configured to, in response to a triggering operation on any search intent control, display a word association search return control in the interactive interface; and, in response to a triggering operation on the word association search return control, re-display at least one word association control related to the first content in the interactive interface.

[0253] In one embodiment, the search intent control display module 2006 is configured to send a search intent generation request to a search server, the search intent generation request carrying the display content presented in the interactive interface and the associated words in the triggered associated word control; receive at least one search intent fed back by the search server in response to the search intent generation request, the search intent being inferred by the search server based on the display content and the associated words in the triggered associated word control; and display at least one search intent control corresponding to the triggered associated word control in the interactive interface according to the received at least one search intent.

[0254] In one embodiment, the search result display module 2008 is configured to, in response to dragging a content capture control to a first position in the interactive interface, display at least one search intent control in the interactive interface for the first content, wherein the at least one search intent control is determined jointly based on the first content and the displayed content; and in response to a triggering operation on any search intent control, display the search result corresponding to the triggered search intent control in the interactive interface.

[0255] In one embodiment, the search result display module 2008 is configured to display a preview area in the interactive interface in response to a triggering operation of any search intent control, and present the search result corresponding to the triggered search intent control in the preview area; the search result display module 2008 is also configured to present the search result corresponding to the other triggered search intent controls in the preview area in response to a triggering operation of other search intent controls.

[0256] In one embodiment, the search result display module 2008 is further configured to, in response to a selection operation of at least one search intent control, display an intent merging control for at least one search intent control in the interactive interface; and, in response to a trigger operation of the intent merging control, display search results in the interactive interface, the search results being obtained based on at least one search intent in at least one search intent control.

[0257] In one embodiment, the interactive interface displaying at least one search intent control further includes an intent query control. The search results display module 2008 is further configured to, in response to a triggering operation of the intent query control, display a statement input box, the statement input box including a query statement about the first content, the query statement being a question generated based on the first content and the associated words in the triggered associated word control; in response to a triggering operation of the query statement, display a newly added search intent control, the search intent in the newly added search intent control being generated based on the first content, the associated words in the triggered associated word control, and the historical search records of other object accounts; and in response to a triggering operation of the newly added search intent control, display the search results corresponding to the triggered newly added search intent control in the interactive interface.

[0258] In one embodiment, the search results display module 2008 is further configured to update the search results for the current first content in the interactive interface in response to dragging the content capture control from the first position to the second position. The search results for the current first content are determined jointly based on the current first content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control. The current first content is the content located in the second position of the displayed content.

[0259] In an exemplary embodiment, as shown in FIG21, an interactive device 2100 is provided, including: a second interactive interface display module 2102, a first content determination module 2104, and a recommended content display module 2106, wherein:

[0260] The second interactive interface display module 2102 is used to display the interactive interface, which includes display content and content capture controls.

[0261] The first content determination module 2104 is used to determine the first content corresponding to the first position from the displayed content in response to dragging the content capture control to the first position in the interactive interface;

[0262] The recommended content display module 2106 is used to display recommended content that matches the first content in at least a portion of the interactive interface.

[0263] In one embodiment, the first content determination module 2104 is configured to determine multiple first contents corresponding to the multiple first positions from the displayed content in response to sequentially dragging the content capture control to multiple first positions in the interactive interface.

[0264] In one embodiment, the recommended content display module 2106 is configured to generate a promotion request based on a plurality of first contents; send the promotion request to a promotion server; receive the recommended content fed back by the promotion server in response to the promotion request; and display the received recommended content in at least a portion of the interactive interface.

[0265] In one embodiment, the interactive interface is an information search interface, and the displayed content is the response information for the search term; the first content determination module 2104 is used to determine the text located at the first position from the response information in response to dragging the content capture control to a first position in the information search interface; the recommended content display module 2106 is used to display recommended content that matches the target text in at least a portion of the information search interface.

[0266] In one embodiment, the interactive interface is a video playback interface, and the displayed content includes the video frame of the target video that is being played; the first content determination module 2104 is used to pause the playback of the target video in response to dragging the content capture control to a first position in the video frame, and determine the first content corresponding to the first position from the paused video frame.

[0267] In one embodiment, the first content determination module 2104 is used to take a screenshot of the paused video frame to obtain a screenshot image, the screenshot image including a content capture control; perform image recognition on the screenshot image to obtain the first content at the first position of the content capture control in the video frame; and the recommended content display module 2106 is used to display recommended content that matches the first content in at least a portion of the video playback interface.

[0268] The modules in the aforementioned search and interaction devices can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0269] In an exemplary embodiment, a computer device is provided, which can be a server or a terminal, and its internal structure diagram is shown in Figure 22. The computer device includes a processor, memory, input / output interfaces (I / O), and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is connected to the system bus via the I / O interfaces. The processor of the computer device provides computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and computer-readable instructions. The internal memory provides an environment for the operation of the operating system and computer-readable instructions in the non-volatile storage medium. The I / O interfaces of the computer device are used for exchanging information between the processor and external devices. The communication interface of the computer device is used for communication with external terminals via a network connection. When the computer-readable instructions are executed by the processor, they implement a search method and an interaction method.

[0270] Those skilled in the art will understand that the structure shown in Figure 22 is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0271] In one embodiment, a computer device is also provided, including a memory and a processor, the memory storing computer-readable instructions, the processor executing the computer-readable instructions to implement the steps in the above method embodiments.

[0272] In one embodiment, a computer-readable storage medium is provided that stores computer-readable instructions that, when executed by a processor, implement the steps in the above method embodiments.

[0273] In one embodiment, a computer program product is provided, including computer-readable instructions that, when executed by a processor, implement the steps in the above method embodiments.

[0274] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0275] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing related hardware through computer-readable instructions. These computer-readable instructions can be stored in a non-volatile computer-readable storage medium. When executed, these computer-readable instructions can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0276] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0277] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0278] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0279] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A search method performed by a computer device, the method comprising: The interactive interface includes display content and content capture controls; In response to dragging the content capture control to a first position in the interactive interface, at least one associated word control is displayed in the interactive interface, and each associated word control displays a different associated word. The associated word is determined based on the displayed content and a first content, wherein the first content is the content located at the first position in the displayed content. In response to a triggering operation on any of the aforementioned word association controls, at least one search intent control is displayed in the interactive interface for the triggered word association control, and each of the search intent controls displays a different search intent; In response to a triggering operation on any of the search intent controls, the corresponding search results are displayed in the interactive interface for the triggered search intent control.

2. The method according to claim 1, wherein the interactive interface is an information search interface, and the display interactive interface includes: Display an information search interface, which includes a search box; In response to the submission of a search term after it is entered in the search box, a response message for the search term is displayed in the information search interface, and the response message is the displayed content.

3. The method according to claim 1, wherein the interactive interface is an information search interface, and the display interactive interface includes: In response to a triggered action, display the information search interface; The information search interface displays content related to the triggering time period of the triggering operation, and the displayed content is related to the preset search intent corresponding to the triggering time period of the triggering operation.

4. The method according to claim 1, wherein displaying at least one related word control in the interactive interface in response to dragging the content capture control to a first position in the interactive interface comprises: In response to dragging the content capture control to a first position in the interactive interface and detecting that the associative search conditions are met, at least one associative word control about the first content is displayed in the interactive interface.

5. The method according to claim 4, wherein displaying at least one associative word control about the first content in the interactive interface comprises: In the interactive interface, at least one associative word control related to the first content is displayed in the area surrounding the first content.

6. The method according to claim 1, wherein in response to a triggering operation on any of the associated word controls, displaying at least one search intent control in the interactive interface for the triggered associated word control includes: In response to a trigger operation on any of the associated word controls, a content pop-up window is displayed in the interactive interface for the triggered associated word control, and the content pop-up window presents the search object corresponding to the associated word in the triggered associated word control; In the interactive interface, at least one search intent control is displayed in the area surrounding the content pop-up, and each search intent control presents a different search intent for the search object.

7. The method according to claim 6, wherein displaying at least one search intent control in the area surrounding the content pop-up window in the interactive interface includes: In response to an interactive operation targeting a search object within the content pop-up, at least one search intent control related to the search object is displayed in the area surrounding the content pop-up in the interactive interface.

8. The method according to claim 6, further comprising: In response to an interactive operation on the search object within the content pop-up window, the other associated word controls in the at least one associated word control, except for the triggered associated word control, are de-displayed in the interactive interface. In response to a triggering operation on any search intent control, a search return control is displayed in the interactive interface; In response to a triggering operation of the associative search return control, at least one associative word control about the first content is displayed again in the interactive interface.

9. The method according to claim 1, further comprising: In response to dragging the content capture control to a first position in the interactive interface, at least one search intent control is displayed in the interactive interface for the first content, the at least one search intent control being determined based on the first content and the displayed content; In response to a triggering operation on any search intent control, the corresponding search results are displayed in the interactive interface for the triggered search intent control.

10. The method according to claim 1, wherein displaying the corresponding search results in the interactive interface in response to a triggering operation on any search intent control comprises: In response to a triggering operation of any search intent control, a preview area is displayed in the interactive interface, and the search results corresponding to the triggered search intent control are presented in the preview area; The method further includes: In response to a triggering action on another search intent control, the search results corresponding to the triggered other search intent controls are displayed in the preview area.

11. The method according to claim 1, further comprising: In response to the selection of at least one search intent control, an intent merging control for at least one search intent control is displayed in the interactive interface; In response to a triggering operation of the intent merging control, search results are displayed in the interactive interface, the search results being obtained based on at least one search intent from the at least one search intent control.

12. The method according to claim 1, wherein the interactive interface further includes an intent query control, and the method further includes: In response to a triggering operation of the intent query control, a statement input box is displayed, the statement input box including a query statement about the first content, the query statement being a question generated based on the first content and the associated words in the triggered associated word control; In response to the triggering operation of the query statement, a newly added search intent control is displayed. The search intent in the newly added search intent control is generated based on the first content, the associated words in the triggered associated word control, and the historical search records of other object accounts. In response to the triggering operation of the newly added search intent control, the search results corresponding to the triggered newly added search intent control are displayed in the interactive interface.

13. The method according to any one of claims 1 to 12, further comprising: In response to dragging the content capture control from the first position to the second position, the search results for the current first content are updated in the interactive interface. The search results for the current first content are determined jointly based on the current first content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control. The current first content is the content located in the second position of the displayed content.

14. An interaction method performed by a computer device, the method comprising: The interactive interface includes display content and content capture controls. In response to dragging the content capture control to a first position in the interactive interface, a first content corresponding to the first position is determined from the displayed content; Recommended content matching the first content is displayed in at least a portion of the interactive interface.

15. The method of claim 14, wherein determining the first content corresponding to the first position from the displayed content in response to dragging the content capture control to a first position in the interactive interface comprises: In response to sequentially dragging the content capture control to multiple positions in the interactive interface, the content corresponding to each of the displayed positions is determined from the displayed content.

16. The method according to claim 14, wherein the interactive interface is an information search interface, and the displayed content is response information for the search term; The step of responding to dragging the content capture control to a first position in the interactive interface and determining the first content corresponding to the first position from the displayed content includes: In response to dragging the content capture control to a first position in the information search interface, the text located at the first position is determined from the response information; Displaying recommended content matching the first content in at least a portion of the interactive interface includes: Recommended content matching the text is displayed in at least a portion of the information search interface.

17. A search device, the device comprising: The first interactive interface display module is used to display the interactive interface, which includes display content and content capture controls. The word association control display module is used to respond to dragging the content capture control to a first position in the interactive interface, and to display at least one word association control about the first content in the interactive interface, wherein the first content is the content located at the first position in the displayed content, and different word associations in the at least one word association control are determined together based on the displayed content and the first content; The search intent control display module is used to display at least one search intent control corresponding to the triggered associated word control in the interactive interface in response to the triggering operation of any associated word control. The search results display module is used to display the search results corresponding to the triggered search intent control in the interactive interface in response to a triggering operation of any search intent control.

18. An interactive device, the device comprising: The second interactive interface display module is used to display the interactive interface, which includes display content and content capture controls. The first content determination module is configured to determine, in response to dragging the content capture control to a first position in the interactive interface, a first content corresponding to the first position from the displayed content; A recommended content display module is used to display recommended content that matches the first content in at least a portion of the interactive interface.

19. A computer device comprising a memory and a processor, the memory storing computer-readable instructions, characterized in that, When the processor executes the computer-readable instructions, it implements the steps of the method according to any one of claims 1 to 16.

20. A computer-readable storage medium having stored thereon computer-readable instructions that, when executed by a processor, implement the steps of the method according to any one of claims 1 to 16.