Search method, interaction method, device, equipment, medium and program product

Abstract

The application relates to a search method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: displaying an interactive interface, the interactive interface comprising display content and a content capture control; in response to dragging the content capture control to a first position in the interactive interface, displaying a plurality of association word controls about target content in the interactive interface, the target content being content in the display content located at the first position, different association words in the plurality of association word controls being determined according to the display content and the target content; in response to a triggering operation on any association word control, displaying a plurality of search intent controls corresponding to the triggered association word control in the interactive interface; and in response to a triggering operation on any search intent control, embedding and displaying a search result corresponding to the triggered search intent control in the interactive interface. In this way, the search efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a search method, apparatus, computer device, computer-readable storage medium, and computer program product. Background Technology

[0002] With the rapid development of computer and internet technologies, information is growing explosively, data volume is expanding rapidly, and the types of data are becoming increasingly complex. Therefore, searching has become a key means for people to obtain information.

[0003] In related technologies, users typically need to manually input or copy and paste search terms into the search box before searching. This method cannot detect the user's search intent, cannot provide users with search results of interest in a timely manner, results in a poor user search experience, and is also relatively cumbersome, thus affecting search efficiency. Summary of the Invention

[0004] Therefore, it is necessary to provide a search method, apparatus, computer device, computer-readable storage medium, and computer program product that can improve search efficiency in response to the above-mentioned technical problems.

[0005] This application provides a search method, including:

[0006] The interactive interface includes display content and content capture controls.

[0007] In response to dragging the content capture control to a first position in the interactive interface, multiple related word controls about the target content are displayed in the interactive interface. The target content is the content located at the first position in the displayed content. Different related words in the multiple related word controls are determined together based on the displayed content and the target content.

[0008] In response to a triggering operation on any of the associated word controls, multiple search intent controls corresponding to the triggered associated word controls are displayed in the interactive interface;

[0009] In response to a triggering operation on any search intent control, the search results corresponding to the triggered search intent control are embedded and displayed in the interactive interface.

[0010] This application also provides a search device, including:

[0011] The first interactive interface display module is used to display the interactive interface, which includes display content and content capture controls.

[0012] The word association control display module is used to respond to dragging the content capture control to a first position in the interactive interface, and to display multiple word association controls related to target content in the interactive interface. The target content is the content located at the first position in the displayed content. Different word associations in the multiple word association controls are determined together based on the displayed content and the target content.

[0013] The search intent control display module is used to display multiple search intent controls corresponding to the triggered associated word control in the interactive interface in response to the triggering operation of any associated word control.

[0014] The search results display module is used to embed and display the search results corresponding to the triggered search intent control in the interactive interface in response to a triggering operation of any search intent control.

[0015] In one embodiment, the interactive interface is a search interface, and the interactive interface includes display content that is response information for the search term. The first interactive interface display module is further configured to display a search box in the search interface; in response to triggering a submission operation for the search term after entering a search term in the search box, the response information for the search term is displayed in the response area of ​​the search interface.

[0016] In one embodiment, the first interactive interface display module is further configured to display the interactive interface in response to a trigger operation that enters the interactive interface within a preset time period, wherein the content displayed in the interactive interface is related to the information query intent corresponding to the preset time period.

[0017] In one embodiment, the associative word control display module is configured to display multiple associative word controls about the target content in the interactive interface in response to a detected associative search trigger operation at the first position after dragging the content capture control to a first position in the interactive interface.

[0018] In one embodiment, the associative word control display module is used to display multiple associative word controls associated with the target content in the surrounding area of ​​the target content in the interactive interface.

[0019] In one embodiment, the associated word control display module is configured to send an associated word generation request to a search server, the associated word generation request carrying the currently logged-in object account, the display content presented in the interactive interface, and the target content; receive multiple associated words from the search server in response to the associated word generation request, the associated words being determined by the search server based on semantic analysis results obtained from semantic analysis of the display content and the target content, and then based on the historical search records of the object account and the semantic analysis results; and display multiple associated word controls related to the target content in the interactive interface according to the received multiple associated words.

[0020] In one embodiment, a search intent control display module is configured to, in response to a triggering operation of any associated word control, display a content pop-up window in the interactive interface for the triggered associated word control, the content pop-up window presenting a search object corresponding to the associated word in the triggered associated word control; and display multiple search intent controls in the area surrounding the content pop-up window in the interactive interface, each search intent control presenting a different search intent for the search object.

[0021] In one embodiment, a search intent control display module is configured to, in response to an interactive operation on a search object within the content pop-up, display a plurality of search intent controls related to the search object in the interactive interface surrounding the content pop-up.

[0022] In one embodiment, the device further includes a predictive word control display cancellation module, configured to, in response to an interactive operation on a search object within the content pop-up window, cancel the display of other predictive word controls among the plurality of predictive word controls except for the triggered predictive word control in the interactive interface; the predictive word control display module is further configured to, in response to a triggering operation on any search intent control, display a predictive search return control in the interactive interface; and, in response to a triggering operation on the predictive search return control, re-display the plurality of predictive word controls related to the target content in the interactive interface.

[0023] In one embodiment, the search intent control display module is configured to send a search intent generation request to a search server, the search intent generation request carrying the display content presented in the interactive interface and the associated words in the triggered associated word control; receive multiple search intents fed back by the search server in response to the search intent generation request, the search intents being inferred by the search server based on the display content and the associated words in the triggered associated word control; and display multiple search intent controls corresponding to the triggered associated word control in the interactive interface according to the received multiple search intents.

[0024] In one embodiment, the search results display module is configured to, in response to dragging the content capture control to a first position in the interactive interface, display a plurality of search intent controls in the interactive interface for the target content, the plurality of search intent controls being jointly determined based on the target content and the displayed content; and, in response to a triggering operation on any search intent control, embed and display the search results corresponding to the triggered search intent control in the interactive interface.

[0025] In one embodiment, the search results display module is configured to, in response to a triggering operation of any search intent control, embed a preview area in the interactive interface and present the search results corresponding to the triggered search intent control in the preview area; the search results display module is further configured to, in response to a triggering operation of other search intent controls, present the search results corresponding to the other triggered search intent controls in the preview area.

[0026] In one embodiment, the search results display module is further configured to, in response to a selection operation of multiple search intent controls, display an intent merging control for the multiple search intent controls in the interactive interface; and, in response to a trigger operation of the intent merging control, embed and display search results in the interactive interface, the search results being obtained based on multiple search intents among the multiple search intent controls.

[0027] In one embodiment, the interactive interface displaying multiple search intent controls further includes an intent query control. The search results display module is further configured to, in response to a triggering operation of the intent query control, display a statement input box, the statement input box including a query statement about the target content, the query statement being a question generated based on the target content and the associated words in the triggered associated word control; in response to a triggering operation of the query statement, display a newly added search intent control, the search intent in the newly added search intent control being generated based on the target content, the associated words in the triggered associated word control, and the historical search records of other object accounts; and in response to a triggering operation of the newly added search intent control, embed and display the search results corresponding to the triggered newly added search intent control in the interactive interface.

[0028] In one embodiment, the search results display module is further configured to update the search results for the current target content in the interactive interface in response to dragging the content capture control from the first position to the second position. The search results for the current target content are determined jointly based on the current target content, the associated words in the associated word control triggered when the content capture control is located at the first position, and the search intent in the search intent control. The current target content is the content located at the second position in the displayed content.

[0029] This application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the search method described above.

[0030] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the search method described above.

[0031] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the search method described above.

[0032] The aforementioned search method, apparatus, computer device, computer-readable storage medium, and computer program product display an interactive interface containing display content and content capture controls. In response to dragging a content capture control to a first position on the interactive interface, the target content at that first position in the display content is accurately captured. Then, multiple related word controls are displayed on the interactive interface, providing the user with multiple related word controls based on the target content and the display content on the interactive interface. Since the display content reflects the contextual information of the target content, different related words in these multiple related word controls can accurately match the user's current potential and possible search needs. Subsequently, by triggering any related word control, the associated words of interest to the user can be identified, and multiple corresponding search intent controls are displayed on the interactive interface. Different search intents in these multiple search intent controls can accurately match the user's current potential and possible search intents. Then, in response to triggering any of the multiple search intent controls, the corresponding search results can be embedded and displayed on the interactive interface according to the user's precise search intent. The entire search process is based on real-time dynamic search interaction on a single interactive interface. It eliminates the need for manual input or copy-pasting of search terms, accurately captures the user's search intent, and provides accurate search results that match that intent, thus improving search efficiency and enhancing the user's search experience.

[0033] This application provides an interaction method, including:

[0034] The interactive interface includes display content and content capture controls.

[0035] In response to dragging the content capture control to a target position in the interactive interface, the target content corresponding to the target position is determined from the displayed content;

[0036] Recommended content matching the target content is displayed in at least a portion of the interactive interface.

[0037] This application provides an interactive device, including:

[0038] The second interactive interface display module is used to display the interactive interface, which includes display content and content capture controls.

[0039] The target content determination module is used to determine the target content corresponding to the target position from the displayed content in response to dragging the content capture control to the target position in the interactive interface;

[0040] A recommended content display module is used to display recommended content that matches the target content in at least a portion of the interactive interface.

[0041] In one embodiment, the target content determination module is configured to determine multiple target contents corresponding to the multiple target locations from the displayed content in response to sequentially dragging the content capture control to multiple target locations in the interactive interface.

[0042] In one embodiment, the recommended content display module is configured to generate a promotion request based on the plurality of target contents; send the promotion request to a promotion server; receive recommended content from the promotion server in response to the promotion request; and display the received recommended content in at least a portion of the interactive interface.

[0043] In one embodiment, the interactive interface is a search interface, and the displayed content is response information for the search term; the target content determination module is used to determine the target text corresponding to the target position from the response information in response to dragging the content capture control to the target position in the search interface; the recommended content display module is used to display recommended content matching the target text in at least a portion of the search interface.

[0044] In one embodiment, the interactive interface is a video playback interface, and the displayed content includes the video frame of the target video that is being played; the target content determination module is used to pause the playback of the target video in response to dragging the content capture control to the target position in the video frame, and determine the target content corresponding to the target position from the paused video frame.

[0045] In one embodiment, the target content determination module is used to take a screenshot of the paused video frame to obtain a screenshot image, the screenshot image including the content capture control; perform image recognition on the screenshot image to obtain the target content at the target location of the content capture control in the video frame; the recommended content display module is used to display recommended content matching the target content in at least a portion of the video playback interface.

[0046] This application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the above-described interactive method.

[0047] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the above-described interaction method.

[0048] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the above-described interactive method.

[0049] The aforementioned interactive method, apparatus, computer device, computer-readable storage medium, and computer program product display an interactive interface, which includes display content and a content capture control. In response to dragging the content capture control to a target position in the interactive interface, the target content located at a first position within the displayed content is accurately captured. This enables accurate content recommendations to be made to the user based on the target content, and directly displays recommended content matching the target content in at least a portion of the interactive interface, thus improving the user's interactive experience. Attached Figure Description

[0050] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0051] Figure 1 This is a diagram illustrating the application environment of the search method in one embodiment;

[0052] Figure 2 This is a flowchart illustrating the search method in one embodiment;

[0053] Figure 3a This is a schematic diagram showing the interactive interface in one embodiment;

[0054] Figure 3bThis is a schematic diagram showing the interactive interface in another embodiment;

[0055] Figure 4 This is a schematic diagram showing the interactive interface in another embodiment;

[0056] Figure 5 This is a schematic diagram illustrating the display process of the word association control in one embodiment;

[0057] Figure 6 This is a flowchart illustrating the steps for determining the associated word control in one embodiment;

[0058] Figure 7 This is a flowchart illustrating the steps for determining the search intent control in one embodiment;

[0059] Figure 8 This is a schematic diagram of a pop-up window displaying content in one embodiment;

[0060] Figure 9 This is a schematic diagram of a pop-up window displaying content in another embodiment;

[0061] Figure 10 This is a schematic diagram showing the search intent control in one embodiment;

[0062] Figure 11 This is a schematic diagram showing search results in one embodiment;

[0063] Figure 12 This is a schematic diagram showing search results in another embodiment;

[0064] Figure 13 This is a schematic diagram showing search results in another embodiment;

[0065] Figure 14 This is a schematic diagram showing search results in another embodiment;

[0066] Figure 15 This is a schematic diagram illustrating the updating of search results in one embodiment;

[0067] Figure 16 This is a flowchart illustrating the interaction method in one embodiment;

[0068] Figure 17 This is a schematic diagram of the content recommendation process in one embodiment;

[0069] Figure 18 This is a schematic diagram of the device interaction process during a search in one embodiment;

[0070] Figure 19 This is a timing diagram of the search process in one embodiment;

[0071] Figure 20This is a structural block diagram of the search device in one embodiment;

[0072] Figure 21 This is a structural block diagram of the interactive device in one embodiment;

[0073] Figure 22 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0074] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0075] In related technologies, when users browse content and encounter content they don't fully understand or aren't interested in, they need to search for that content. This requires either opening a search engine, manually entering the content, or copying the content, pasting it into the search engine, and then initiating the search. This process is clearly cumbersome, especially when users need to switch between different interfaces to open the search engine and back, creating a poor search experience. Furthermore, this method searches based on a single piece of content, only retrieving its meaning or related information, failing to identify the user's search intent and providing accurate search results that match that intent.

[0076] Based on this, the present application provides a search method that displays an interactive interface, which includes display content and content capture controls. In response to dragging the content capture control to a first position in the interactive interface, the target content located at the first position in the display content is accurately captured. Then, multiple related word controls are displayed in the interactive interface, providing the user with multiple related word controls based on the target content and the display content in the interactive interface. Since the display content reflects the contextual information of the target content, different related words in the multiple related word controls can accurately match the user's current potential and possible search needs. Subsequently, by triggering any related word control, the related words that the user is interested in can be identified, and multiple corresponding search intent controls are displayed in the interactive interface. Different search intents in these multiple search intent controls can accurately match the user's current potential and possible search intents. Then, in response to triggering any of the multiple search intent controls, the corresponding search results can be embedded and displayed in the interactive interface according to the user's accurate search intent. The entire search process is based on real-time dynamic search interaction on a single interactive interface. It eliminates the need for manual input or copy-pasting of search terms, accurately captures the user's search intent, and provides accurate search results that match that intent, thus improving search efficiency and enhancing the user's search experience.

[0077] The search method provided in this application embodiment can be applied to, for example, Figure 1 The application environment shown is illustrated. Terminal 110 communicates with server 120 via a network. A data storage system can store the data that server 120 needs to process. The data storage system can be integrated onto server 120, or it can be located in the cloud or on another network server. Figure 1 The terminal 110 displays an interactive interface 100, which includes display content, such as text 1, title 1 of text 1, text 2, and title 2 of text 2. The interactive interface 100 also includes a content capture control 101, which users can drag to any position in the interactive interface 100 to enable real-time dynamic interaction during the search process.

[0078] In one embodiment, terminal 110 displays an interactive interface 100, which includes display content and a content capture control 101. In response to dragging the content capture control 101 to a first position in the interactive interface 100, terminal 110 generates a related word generation request based on the target content and the display content, and sends it to server 120. The target content is the content located at the first position in the display content; for example, the target content is... Figure 1The first part is titled "Title 1". Next, server 120 searches based on the display content and target content carried in the suggested word generation request, determines multiple suggested words, and returns them to terminal 110 for display in the suggested word control. That is, the different suggested words in multiple suggested word controls are determined jointly by the display content and target content. In response to a trigger operation on any suggested word control, terminal 110 generates a search intent generation request based on the suggested words of the triggered suggested word control and sends the search intent generation request to server 120. Server 120 determines multiple search intents based on the suggested words of the triggered suggested word control and returns them to terminal 110, which then displays multiple search intent controls. In response to a trigger operation on any search intent control, terminal 110 generates a search request based on the search intent in the triggered search intent control and sends it to server 120. Server 120 searches based on the search intent in the triggered search intent control, obtains search results, and returns the search results to terminal 110, which embeds and displays the search results in the interactive interface 100.

[0079] Among them, terminal 110 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and IoT devices. IoT devices can be smart TVs, smart in-vehicle devices, etc. Portable wearable devices can be smartwatches, smart bracelets, head-mounted devices, etc. Server 120 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0080] This application also provides some application scenarios for the search method. For example, it can be applied in document reading, video browsing, meeting recording, and search scenarios. The following descriptions use search and reading scenarios as examples:

[0081] In a search scenario: A search interface is displayed, including a search box and content capture controls. In response to input to the search box, the search interface displays the response information corresponding to the entered search term. In response to dragging a content capture control to the first position in the search interface, multiple related keyword controls are displayed, where the target content is the content in the first position of the response information. Different related keywords in the multiple related keyword controls are determined jointly based on the response information and the target content. In response to triggering any related keyword control, multiple search intent controls corresponding to the triggered related keyword control are displayed in the search interface. In response to triggering any search intent control, the search results corresponding to the triggered search intent control are embedded and displayed in the search interface.

[0082] In a reading scenario: A reading interface is displayed, including the content of the target work and content capture controls. In response to dragging a content capture control to the first position in the reading interface, multiple related keyword controls are displayed. The target content is the content located in the first position within the work content. The different related keywords in the multiple related keyword controls are determined jointly based on the work content and the target content. In response to triggering any related keyword control, multiple search intent controls corresponding to the triggered related keyword control are displayed in the reading interface. In response to triggering any search intent control, the search results corresponding to the triggered search intent control are embedded and displayed in the reading interface.

[0083] In one exemplary embodiment, such as Figure 2 As shown, a search method is provided, which is applied to Figure 1 Taking terminal 110 as an example, the explanation includes the following steps S202 to S208. Wherein:

[0084] Step S202: Display the interactive interface, which includes display content and content capture controls.

[0085] The interactive interface is the interface displayed on the terminal that allows interaction with the user. In some embodiments, the interactive interface may be a search interface, a reading interface, or a purchase interface, etc. The displayed content is the content presented on the interactive interface, which includes at least one modal content such as text, images, audio, and video. In one embodiment, when the interactive interface is a search interface, the displayed content is the response information corresponding to the search term; when the interactive interface is a reading interface, the displayed content is the text of the target work; when the interactive interface is a purchase interface, the displayed content is product information (such as product images, product videos, etc.); and when the interactive interface is a video interface, the displayed content is the video. The content capture control is a control that captures target content. The content capture control can be dragged to any position on the interactive interface and is used to capture the content that the user wants to trigger a search for, i.e., the target content, thereby enabling real-time dynamic interaction with the target content. In one embodiment, the content capture control can be dragged to any position on the interactive interface. In one embodiment, the content capture control can be a control of any shape, for example, a control shaped like a magnifying glass, see reference. Figure 1The content capture control 101 can be a circle-shaped control, a rectangle-shaped control, etc., and is not specifically limited. Target content recognition can be achieved through AI or by real-time tracking of the content capture control's position. In one embodiment, the content capture control includes a capture area for capturing the target content. The size of the capture area can be adjusted. If the capture area cannot completely capture the target content at the first position, the capture area is enlarged so that the adjusted capture area can capture the complete target content. Of course, the capture area also includes irrelevant content other than the target content. The capture area can be reduced so that the adjusted capture area includes irrelevant content while still capturing the complete target content.

[0086] In one embodiment, in response to a trigger operation that initiates access to the interactive interface, the terminal displays the content and content capture controls within the interface. This allows the content capture controls to be displayed directly upon the user opening the interface, facilitating rapid target content capture. In another embodiment, a display content and target content capture confirmation pop-up are displayed in the interactive interface. This pop-up confirms whether the content capture controls are enabled within the interactive interface. In response to selecting the confirmation option in the target content capture confirmation pop-up, the content capture controls are overlaid on the displayed content. This pre-confirmation of the user's target content capture need through the target content capture confirmation pop-up improves the user's search experience.

[0087] In one embodiment, the interactive interface is a search interface, and the content displayed in the interactive interface is the response information for the search term. The method further includes: displaying a search box in the search interface; and in response to triggering a submission operation for the search term after entering a search term in the search box, displaying the response information for the search term in the response area of ​​the search interface.

[0088] The search box is used to enter search terms, and the response information is the search results obtained based on those search terms.

[0089] In one embodiment, in response to a triggering operation to enter the search interface, a search box is displayed in the search interface. In response to an input operation to the search box, the input content is determined, including at least one search term. The terminal triggers a submission operation for the at least one search term, generating a search request carrying the at least one search term, which is then sent to the search server. The search server performs a local search based on the at least one search term, obtains response information for the at least one search term, and sends it to the terminal. The terminal displays the response information in the response area of ​​the search interface. In one embodiment, the content capture control may be displayed on the search interface upon entry, or it may be overlaid on the response information after confirmation.

[0090] For example, such as Figure 3a The diagram shown is a schematic representation of an interactive interface in one embodiment. Figure 3a The interactive interface 100 is a search interface. The interactive interface 100 displays a content capture control 101 and a search box 102. When “What to wear in autumn?” is entered in the search box 102, the search terms “autumn”, “wear”, and “what” are identified. The response information obtained based on the search terms includes text 1 about “hoodie” and text 2 about “trench coat”, etc.

[0091] In this embodiment, entering a search term in the search box of the search interface can trigger a search for the search term and obtain response information. By displaying the response information in the search interface, users can conveniently capture target content from the response information based on their needs using the content capture control.

[0092] In one implementation, the interactive interface is a reading interface, and the content displayed in the reading interface is the content of the target work. The method further includes: displaying the reading interface in response to a trigger operation on the target work, the reading interface including a content capture control. For example, as shown... Figure 3b The diagram shown is a schematic representation of an interactive interface in another embodiment. Figure 3b The interactive interface 100 is a reading interface, which displays content capture control 101 and the content of an article about artificial intelligence.

[0093] In one embodiment, displaying an interactive interface includes: responding to a trigger operation that enters the interactive interface within a preset time period, displaying the interactive interface, wherein the content displayed in the interactive interface is related to the information query intent corresponding to the preset time period.

[0094] The preset time period can be any time of day, such as breakfast time, travel time, or lunch time. It can also be any time of year, such as spring or summer. The information query intent is the query intent related to the preset time period, reflecting the query intent when entering the interactive interface during that time period. For example, if the preset time period is breakfast time, the information query intent is breakfast query intent. If the preset time period is travel time, the information query intent is travel route query intent.

[0095] In one embodiment, in response to a trigger operation that enters the interactive interface within a preset time period, the terminal determines the information query intent based on the preset time period, generates a query statement based on the information query intent, and sends the query statement to the search server. The search server performs a search based on the information query intent carried in the query statement, determines the relevant display content, and returns it to the terminal, so that the terminal displays the query statement and the corresponding display content in the interactive interface. For example, the terminal obtains a pre-set mapping relationship between time periods and information query intents, and determines the information query intent corresponding to the preset time period based on this mapping relationship.

[0096] In one embodiment, the interactive interface can be a search interface, such as... Figure 4 The diagram shown is a schematic representation of an interactive interface in another embodiment. Figure 4 The interactive interface 100 is a search interface. When a user opens the search application on interface 130 at 11:45, confirming that the application was opened during the lunch period (11:00 to 12:00), the search intent is determined to be a lunch query. Therefore, the search box 102 in the interactive interface 100 displays the query "What to eat for lunch," and the content capture control 101 is displayed. Based on the query intent carried by the query statement, the displayed content is determined, including text 3 about "noodles" and text 4 about "rice," etc.

[0097] In this embodiment, by triggering an interaction with the interface within a preset time period, the system automatically identifies the information query intent associated with that time period, retrieves the corresponding content, and displays the interactive interface including that content. The entire process requires no user input, simplifying the user workflow and improving the user search experience.

[0098] In step S204, in response to dragging the content capture control to the first position in the interactive interface, multiple related word controls about the target content are displayed in the interactive interface. The target content is the content located in the first position of the displayed content. The different related words in the multiple related word controls are determined together based on the displayed content and the target content.

[0099] The first position can be any location within the interactive interface. The target content is the content displayed in the first position, which can be text, images, videos, audio, etc. Text can be a word, sentence, or paragraph. Associated words are words obtained by associating the displayed content with the target content. Associated search retrieves results related to both the displayed and target content. Associated search is used to initially identify the general scope of the search intent, i.e., to perform preliminary filtering of the search intent, narrowing the scope to facilitate precise identification of the user's actual search intent later. It should be noted that based on the multiple multimedia types included in the displayed content, the contextual information of the target content can be determined. Therefore, associative search based on the target content and the displayed content can also be understood as a deep search based on the target content and its context. For example, if the target content is "trench coat" and the displayed content includes contextual information such as "hoodie" and "shirt," the associated words obtained after an associative search would be "brand," "outfit," and "accessories."

[0100] In one embodiment, in response to dragging a content capture control to a first position in the interactive interface, when the terminal detects that the first position is in a non-blank area, it displays multiple associative word controls related to the target content in the interactive interface. Here, a non-blank area refers to an area containing content, such as text, images, audio, or video. It is understood that when the first position is detected as a blank area, meaning there is no content at the first position, at least one movement route can be displayed. The starting point of each movement route is the first position, and the corresponding ending point is a neighboring position adjacent to the first position. This neighboring position is in a non-blank area, and the distance between the neighboring position and the first position is less than or equal to a distance threshold. Thus, in response to dragging the content capture control to the corresponding neighboring position according to the selected movement route, multiple associative word controls related to the neighboring position are displayed. In one embodiment, the step of identifying whether the first position is in a non-blank area includes: capturing the coordinate information of the first position, querying whether content exists based on the coordinate information, and confirming that it is in a non-blank area if it exists, and confirming that it is in a blank area if it does not exist.

[0101] In one embodiment, in response to dragging a content capture control to a first position in the interactive interface, displaying multiple related word controls about the target content in the interactive interface includes: in response to detecting a related search trigger operation at the first position after dragging the content capture control to the first position in the interactive interface, displaying multiple related word controls about the target content in the interactive interface.

[0102] The "associative search trigger operation" refers to the operation that triggers an associative search. It can be understood that detecting an associative search trigger operation indicates an intent to perform an associative search. In one embodiment, the associative search trigger operation can be an interactive operation at a first location, or it can be a voice command confirming an associative search. For example, this interactive operation can be a double-click, long-press, or pause operation at the first location.

[0103] In one embodiment, after the terminal responds to dragging the content capture control to a first position in the interactive interface, if the duration of the content capture control at the first position is greater than or equal to a duration threshold, multiple associated word controls about the target content are displayed in the interactive interface.

[0104] In one embodiment, in response to dragging the content capture control to the first position, if no associative search trigger operation is detected for the first position within a preset time period, a search request is initiated based on the target content of the first position and sent to the search server. The search server directly performs a semantic search based on the target content and returns the semantic search results to the terminal for display.

[0105] In one embodiment, when an associative search trigger is detected for the first location, the content capture control is fixed in the first location until the search result corresponding to the search intent control is subsequently displayed. Afterward, the content capture control can be dragged to other locations, or its display can be canceled in the interactive interface. If no associative search trigger is detected for the first location, the content capture control can be dragged to other locations, or its display can remain unchanged. This way, when an associative search intent is confirmed, the content capture control is either canceled or locked in the first location, preventing search errors caused by accidental movement of the content capture control during the associative search process.

[0106] In this embodiment, after the content capture control is in the first position, if an associative search trigger operation is detected at the first position, multiple associative word controls about the target content will be displayed only after confirming that the user has an associative search intent, thus ensuring search accuracy.

[0107] In one embodiment, displaying multiple associative word controls about target content in an interactive interface includes: displaying multiple associative word controls associated with the target content in a surrounding area centered on the target content in the interactive interface.

[0108] For example, such as Figure 5 The image shown is a schematic diagram illustrating the display process of the associated word control in one embodiment. Figure 5In the illustrated embodiment, the interactive interface 100 is a search interface, which includes a search box 102. When "what to wear in autumn" is entered into the search box 102, the interactive interface 100 displays answer information about "what to wear in autumn". The displayed content includes the entered search term and the answer information. The answer information includes "hoodie" and "text 1" about "hoodie", "trench coat" and "text 2" about "trench coat". After dragging the content capture control 101 to the first position, based on the target content "trench coat" at the first position, three related word controls 103 are displayed. The related words in the three related word controls 103 are "M brand", "outfit", and "item". The three related word controls 103 are deployed in the area surrounding the target content "trench coat".

[0109] In one embodiment, the display area of ​​each associated keyword control is determined based on its historical frequency of occurrence within the area surrounding the target content. The historical frequency of occurrence is determined based on the historical search records of the currently dragging object account. A higher historical frequency indicates that the object account is more focused on searching for the corresponding associated keyword, thus resulting in a larger display area for the corresponding associated keyword control.

[0110] In this embodiment, multiple word association controls are displayed in the area surrounding the target content for highlighting and facilitating quick selection from multiple word association controls.

[0111] In one embodiment, such as Figure 6 The diagram shown illustrates the flowchart of the word association control determination step in one embodiment. Multiple word association controls related to the target content are displayed in the interactive interface, including:

[0112] Step S602: Send a suggested word generation request to the search server. The suggested word generation request carries the currently logged-in account, the content displayed in the interactive interface, and the target content.

[0113] Step S604: Receive multiple suggested terms from the search server in response to the suggested term generation request. The suggested terms are determined by the search server based on the semantic analysis results obtained from the semantic analysis of the displayed content and the target content, and then based on the historical search records of the target account and the semantic analysis results.

[0114] The object account refers to the user account that performs the drag and drop operation.

[0115] In one embodiment, after receiving a suggested word generation request, the search server extracts the entities of the target content from the request. Using these entities and the displayed content, it performs semantic analysis through a context association model to obtain the semantic analysis results. The context association model is used to associate the target content with its contextual information within the displayed content before performing semantic analysis. In one embodiment, the context association model can be a BERT (Bidirectional Encoder Representations from Transformers) model, or a CLIP (Contrastive Language-Image Pretraining) model, etc.

[0116] In one embodiment, when the interactive interface is a search interface, the suggested word generation request also includes the input search term. To this end, the search server can perform semantic analysis using a context association model based on the entities in the target content, the search term, and the displayed content to obtain the semantic analysis result. Of course, to ensure the accuracy of the semantic analysis, the terminal also sends the current operation scenario and the suggested word generation request to the search server. The search server then performs semantic analysis using a context association model based on the current operation scenario, the entities in the target content, the search term, and the displayed content to obtain the semantic analysis result. The current operation scenario reflects the operation type of the interactive interface. For example, if the interactive interface is a search interface, the current operation scenario is a search scenario; if the interactive interface is a reading interface, the current operation scenario is a reading scenario.

[0117] In one embodiment, the search server determines object description information based on the historical search records of the object account that triggered the drag-and-drop operation, and generates a search strategy based on the semantic analysis results and the object description information. Based on the search strategy, the search server performs parallel queries from the local database (cached content) and the cloud search engine to obtain multiple candidate related word combinations, each including at least one candidate related word. The search server uses a result ranking algorithm to score each candidate related word combination from the dimensions of timeliness and object relevance, selects a predetermined number of candidate related word combinations with the highest scores, and sends the selected candidate related word combinations to the terminal.

[0118] Step S606: Based on the received multiple associated words, display multiple associated word controls related to the target content in the interactive interface.

[0119] For example, the terminal determines the corresponding suggested word controls based on the received combinations of candidate suggested words. The terminal then displays multiple suggested word controls related to the target content in the interactive interface.

[0120] In this embodiment, by sending a suggested word generation request to the search server, the search server can perform a suggested search based on the target content and displayed content carried in the suggested word generation request, so as to initially find the approximate range of the search intent. Based on the suggested words in the approximate range found in the initial search, the corresponding suggested word control is determined, which is conducive to accurately locating the user's actual search intent in the subsequent process.

[0121] Step S206: In response to the triggering operation of any associated word control, display multiple search intent controls corresponding to the triggered associated word control in the interactive interface.

[0122] The search intent controls are determined based on at least one search intent, and each of the multiple search intent controls reflects a different search intent. For example, the multiple search intent controls are associated with the triggered associated word controls, and the multiple search intent controls can be regarded as a fine classification of the triggered associated word controls. For example, if the triggered associated word controls are regarded as categories, then the related multiple search intent controls can be regarded as subcategories under that category.

[0123] In one embodiment, in response to a triggering operation on any of the suggested word controls, the terminal obtains the mapping relationship between the suggested word controls and the search intent controls, and determines multiple search intent controls corresponding to the triggered suggested word controls based on the mapping relationship.

[0124] In one embodiment, such as Figure 7 The diagram shown illustrates the process of determining search intent controls in one embodiment. Multiple search intent controls corresponding to the triggered associated word control are displayed in the interactive interface, including:

[0125] Step S702: Send a search intent generation request to the search server. The search intent generation request carries the displayed content in the interactive interface and the associated words in the triggered associated word control.

[0126] Step S704: Receive multiple search intents from the search server in response to the search intent generation request. The search intents are inferred by the search server based on the displayed content and the associated words in the triggered associated word control.

[0127] In one embodiment, after receiving a search intent generation request from a terminal, the search server invokes an intent prediction model. Based on the displayed content carried in the search intent generation request and the associated words in the triggered associated word control, the intent prediction model is used to infer the intent and obtain multiple search intents.

[0128] In one embodiment, the search server, based on the received associated word controls and displayed content, filters out multiple matching search intent controls from all candidate search intents and returns them to the terminal. Exemplarily, the search server obtains a template of intent recognition prompt text, which includes guiding text that includes all candidate search intents. The search server inputs the received associated word controls and displayed content into this template, generates intent recognition prompt text, and calls a large language model to perform semantic understanding on the intent recognition prompt text to obtain multiple search intent controls corresponding to the triggered associated word controls.

[0129] Step S706: Based on the received multiple search intents, display multiple search intent controls corresponding to the triggered associated word control in the interactive interface.

[0130] For example, after receiving multiple search intents, the terminal uses each search intent as the name of a search intent control to create a corresponding search intent control. The terminal then displays multiple search intent controls corresponding to the triggered suggested words control in the interactive interface.

[0131] In this embodiment, by sending a search intent generation request to the search server, the search server can selectively filter out multiple search intents based on the triggered associated word control and the displayed content. This narrows down the scope of search intents, accurately perceives the user's search intent, and achieves precise search, thereby improving search efficiency.

[0132] In one embodiment, in response to a triggering operation on any of the associated word controls, multiple search intent controls corresponding to the triggered associated word controls are displayed in the interactive interface, including: in response to a triggering operation on any of the associated word controls, a content pop-up window is displayed in the interactive interface for the triggered associated word control, the content pop-up window presents the search object corresponding to the associated word in the triggered associated word control; and multiple search intent controls are displayed in the area surrounding the content pop-up window in the interactive interface, each search intent control presenting a different search intent for the search object.

[0133] In one embodiment, in response to a triggering operation on any of the suggested search terms controls, the terminal displays a content pop-up window in the interactive interface for the triggered suggested search terms control. The content in the pop-up window includes at least one search object, which is associated with the suggested search terms in the triggered suggested search terms control. For example, for the suggested search terms in the triggered suggested search terms control, the associated search object can be an object in the search results after searching with that suggested search term. For example, if the suggested search term is "M brand", then the associated search object is each style of trench coat from the M brand.

[0134] In one embodiment, the content in the pop-up window can be at least one of images, text and images, or videos. The content formats of the pop-ups corresponding to different word association controls can be the same or different. For example, such as... Figure 8 The image shown is a schematic diagram of a pop-up window displaying content in one embodiment. Figure 8 The interactive interface 100 is a search interface. Clicking the suggested keyword control for "Brand M" in the interactive interface 100 will display a content pop-up window 104, which shows a specific style of trench coat from Brand M as the search object. For example, as shown... Figure 9 The image shown is a schematic diagram of a pop-up window displaying content in another embodiment. Figure 9 The interactive interface 100 is a search interface. Clicking the suggested word control with the suggested word "outfit" in the interactive interface 100 will display a content pop-up window 104 in the interactive interface 100. The content pop-up window 104 displays an outfit video. The content pop-up window 104 can also be set with a playback icon 105 for opening the outfit video.

[0135] In one embodiment, in response to a triggering operation on any one of the search objects in at least one search object in the content pop-up, multiple search intent controls corresponding to the triggered search object are displayed in the area surrounding the content pop-up in the interactive interface.

[0136] For example, such as Figure 10 The image shown is a schematic diagram illustrating the search intent control in one embodiment. Figure 10 In the interactive interface 100, a content pop-up window 104 displays the search object as a certain style of trench coat from brand M. In response to the trigger operation on the search object, four related search intent controls 106 are displayed in the area surrounding the center of the content pop-up window. The search intents of the four search intent controls 106 are "purchase", "scenario consultation" (to consult how to match the trench coat), "city temperature query", and "material comparison".

[0137] In one embodiment, when the content pop-up is a video, in response to a triggering operation on any search object in the target video frame, multiple search intent controls corresponding to the target video frame and the triggered search object are displayed in the area surrounding the content pop-up in the interactive interface. The target video frame is any video frame in the video.

[0138] In this embodiment, in response to a trigger operation on any associated word, a content pop-up window is displayed in the interactive interface for the triggered associated word control. Since the content pop-up window contains search objects corresponding to the associated words in the associated word control, multiple search intent controls matching the associated word are quickly and accurately searched, thereby further narrowing the scope of the search intent and ensuring the accuracy of the search.

[0139] In one embodiment, multiple search intent controls are displayed in the area surrounding the content pop-up in the interactive interface, including: in response to an interactive operation on a search object within the content pop-up, multiple search intent controls related to the search object are displayed in the area surrounding the content pop-up in the interactive interface.

[0140] Interactive actions are used to indicate whether an individual is interested in the search result. In one embodiment, interactive actions may include actions such as adding to favorites, liking, sharing, and editing the search result.

[0141] In one embodiment, there are multiple preset interactive operations targeting a search object, each with a corresponding level of importance. In response to a target interactive operation on the search object within a content pop-up window, multiple search intent controls related to the search object are displayed in the area surrounding the content pop-up window in the interactive interface. The target interactive operation is one of the multiple interactive operations targeting the search object, and the number of search intent controls related to the search object is related to the importance of the target interactive operation; the higher the importance, the more search intent controls are displayed. For example, there are four operations: favorite, like, share, and edit. Their importance, from highest to lowest, is: favorite, edit, share, like, with 4, 3, 2, and 1 search intent controls respectively.

[0142] In one embodiment, in response to an interactive operation targeting at least one search object within a content pop-up window, multiple search intent controls corresponding to at least one search object are sequentially displayed in the area surrounding the content pop-up window in the interactive interface. The multiple search intent controls are determined jointly based on at least one search object.

[0143] In this embodiment, in response to interactive operations on the search object within the content pop-up window, multiple search intent controls related to the search object can be highlighted in the area surrounding the content pop-up window in the interactive interface. This facilitates more intuitive browsing for users and makes it easier for users to trigger the search intent controls, thereby improving the user search experience.

[0144] In one embodiment, the method further includes: in response to an interactive operation on a search object within a content pop-up, canceling the display of other associated word controls among a plurality of associated word controls in the interactive interface, excluding the triggered associated word control.

[0145] In this embodiment, after performing an interactive operation on the search object, other related word controls are hidden to make it easier for users to browse multiple search intent controls more clearly, thus simplifying the interactive interface.

[0146] In one embodiment, the method further includes: displaying a search association return control in the interactive interface in response to a triggering operation on any search intent control; and displaying multiple related word controls about the target content again in the interactive interface in response to a triggering operation on the search association return control.

[0147] In this embodiment, the associative search return control is used to redisplay multiple associative word controls in the interactive interface. This allows users to reselect other associative word controls even after the search intent control has been triggered, without needing to regenerate them, thus improving search convenience.

[0148] In step S208, in response to the triggering operation of any search intent control, the search results corresponding to the triggered search intent control are embedded and displayed in the interactive interface.

[0149] The search results can be recommended content, which can take the form of images, videos, text and images, purchase pages, etc.

[0150] In one embodiment, in response to a triggering operation of any search intent control, the terminal initiates a search request for the triggered search intent control, sends the search request to the search server, the search server performs a search based on the search intent of the triggered search intent control, obtains the search results, returns the search results to the terminal, and the terminal embeds and displays the search results corresponding to the triggered search intent control in the interactive interface.

[0151] In one embodiment, in response to a triggering operation on any search intent control, embedding and displaying the search results corresponding to the triggered search intent control in the interactive interface includes: in response to a triggering operation on any search intent control, embedding a preview area in the interactive interface, and presenting the search results corresponding to the triggered search intent control in the preview area.

[0152] For example, such as Figure 11 The diagram illustrates the display of search results in one embodiment. Clicking one of the search intent controls, namely "Purchase," in the interactive interface 100 displays a corresponding preview area 107. The preview area 107 includes search result 1 corresponding to "Purchase," which includes images of trench coats in two different colors, detailed information, a favorites control, purchase amount details (222.2 yuan), customer service controls, etc. For example, as shown... Figure 12The diagram illustrates the display of search results in another embodiment. Clicking one of the search intent controls, namely "Material Comparison," in the interactive interface 100 displays a corresponding preview area 107. The preview area 107 includes search results 2 corresponding to the search intent "Material Comparison." Search results 2 include controls for 100% material 1 content in the brand's trench coat, a collection control for material comparison details, comparison controls for material 1 and material 2, and comparison controls for material 1 and material 3. In response to triggering any comparison control, the corresponding comparison result is displayed.

[0153] In this embodiment, in response to the triggering operation of any search intent control, a preview area is embedded in the interactive interface. Thus, without switching to other interfaces, the search results can be viewed directly in the interactive interface, avoiding interface switching operations and improving the user search experience.

[0154] In one embodiment, the method further includes: in response to a triggering operation on another search intent control, displaying the search results corresponding to the triggered other search intent control in a preview area.

[0155] For example, such as Figure 13 The diagram shown illustrates the display of search results in another embodiment. First, if a search intent control for "purchase" is selected, a corresponding preview area 107 is displayed in the interactive interface 100. This preview area 107 includes search result 1 corresponding to the search intent "purchase". The information contained in search result 1 can be found in [reference needed]. Figure 11 If, during the display of search result 1, the search intent control is reselected as "material comparison," then search result 1 will be de-displayed in preview area 107, and search result 2 will be displayed. The information contained in search result 2 can be found in [reference needed]. Figure 12 .

[0156] In this embodiment, in response to the triggering operation of other search intent controls, the search results corresponding to the other triggered search intent controls are directly displayed in the preview area, which makes it convenient for users to switch and view the search results of different search intent controls in real time according to their needs, thereby improving the user search experience.

[0157] In one embodiment, the method further includes: in response to a selection operation of multiple search intent controls, displaying an intent merging control for the multiple search intent controls in an interactive interface; and in response to a trigger operation of the intent merging control, embedding and displaying search results in the interactive interface, the search results being obtained by searching based on multiple search intents among the multiple search intent controls.

[0158] The intent merging control is used to merge at least two search intent controls.

[0159] For example, in response to the selection of multiple search intent controls, an intent merging control for the selected search intent controls is displayed in the interactive interface. In response to triggering the intent merging control, the terminal merges the individual search intents of the selected multiple search intents to obtain a merged search intent. The terminal sends a search request carrying the merged search intent to the search server. The search server performs a search based on the merged search intent, obtains search results related to the merged search intent, and returns them to the terminal. The terminal displays the search results in a preview area.

[0160] In this embodiment, by selecting multiple search intent controls, an intent merging control is displayed. Based on this, a comprehensive search is performed by combining the search intents of the selected multiple search intent controls according to the intent merging control, thereby improving the flexibility of the search.

[0161] In one embodiment, the interactive interface displaying multiple search intent controls further includes an intent query control, and the method further includes: in response to a triggering operation of the intent query control, displaying a statement input box, the statement input box including a query statement about the target content, the query statement being a question generated based on the target content and the associated words in the triggered associated word control; in response to a triggering operation of the query statement, displaying a newly added search intent control, the search intent in the newly added search intent control being generated based on the target content, the associated words in the triggered associated word control, and the historical search records of other object accounts; in response to a triggering operation of the newly added search intent control, embedding and displaying the search results corresponding to the triggered newly added search intent control in the interactive interface.

[0162] Among them, the intent query control is used to generate new search intent controls.

[0163] In one embodiment, in response to a triggering operation of the intent query control, the terminal displays a statement input box in the interactive interface. The query statement in the statement input box is a question automatically generated by the terminal based on the target content, the suggested words in the triggered word association control, and the multiple displayed search intent controls. For example, the query statement could be in the form of: "Please query the suggested words for the target content and the triggered word association control, and retrieve any newly added search intent controls in addition to the multiple displayed search intent controls." That is, when there is no actual user search intent among the multiple search intent controls, the query statement is automatically generated by triggering the intent query control to regenerate the newly added search intent controls.

[0164] In one embodiment, in response to a triggered query statement, the terminal sends the query statement to the search server. The search server retrieves the historical search records of other object accounts, generates query prompt text based on these historical search records and the query statement, calls a large language model to perform semantic understanding on the query prompt text, outputs a newly added search intent control, and returns it to the terminal. The terminal displays the newly added search intent control. Thus, in response to a triggered operation on the newly added search intent control, the search results corresponding to the newly added search intent control are embedded and displayed in the interactive interface.

[0165] In one embodiment, the method further includes: displaying an intent query control in the interactive interface in response to a closing operation of each of the plurality of intent search controls. Thus, upon detecting a closing operation of each intent search control, it indicates that none of the plurality of intent search controls represent the user's actual search intent, and therefore, the intent query control is displayed in the interactive interface.

[0166] In one embodiment, once the display duration of each intent search control in the interactive interface reaches a duration threshold, the display of multiple intent search controls in the interactive interface is canceled, indicating that none of the multiple intent search controls represent the user's actual search intent. At this time, an intent query control is displayed in the interactive interface.

[0167] In this embodiment, in response to the triggering operation of the intent query control, the newly added search intent control can be regenerated, providing users with additional search intent options without the need for manual input, thus improving the user search experience.

[0168] In the above search method, an interactive interface is displayed, which includes display content and content capture controls. In response to dragging the content capture control to a first position in the interactive interface, the target content at that first position in the display content is accurately captured. Then, multiple related word controls are displayed in the interactive interface, providing the user with multiple related word controls based on the target content and the display content in the interactive interface. Since the display content reflects the contextual information of the target content, different related words in these multiple related word controls can accurately match the user's current potential and possible search needs. Subsequently, by triggering any related word control, the associated words that the user is interested in can be identified, and multiple corresponding search intent controls can be displayed in the interactive interface. Different search intents in these multiple search intent controls can accurately match the user's current potential and possible search intents. Finally, in response to triggering any of the multiple search intent controls, the corresponding search results can be embedded and displayed in the interactive interface according to the user's accurate search intent. The entire search process is based on real-time dynamic search interaction on a single interactive interface. It eliminates the need for manual input or copy-pasting of search terms, accurately captures the user's search intent, and provides accurate search results that match that intent, thereby improving search efficiency and enhancing the user's search experience.

[0169] In one embodiment, the method further includes: in response to dragging a content capture control to a first position in the interactive interface, displaying a plurality of search intent controls in the interactive interface for the target content, the plurality of search intent controls being jointly determined based on the target content and the displayed content; in response to a triggering operation on any search intent control, embedding and displaying the search results corresponding to the triggered search intent control in the interactive interface.

[0170] In one embodiment, in response to dragging a content capture control to a first position in the interactive interface, the terminal sends a search intent generation request carrying the target content and the displayed content to the search server. Based on the target content and the displayed content, the search server filters out multiple matching candidate search intents from the candidate search intent set, determines multiple search intent controls based on the filtered candidate search intents, and returns them to the terminal.

[0171] For example, such as Figure 14The diagram shown illustrates the display of search results in another embodiment. In response to dragging the content capture control 101 to a first position on the interactive interface 100, where the target content at the first position is "trench coat," the terminal displays four search intent controls on the interactive interface 100 for the target content. The search intents of each of the four search intent controls are "purchase," "scene consultation," "city temperature query," and "material comparison," respectively. In response to a trigger operation on the search intent control corresponding to "purchase," a preview area 107 is embedded in the interactive interface. This preview area 107 includes search results 1 corresponding to the search intent "purchase."

[0172] In this embodiment, in response to dragging the content capture control to the first position, multiple search intent controls are directly determined based on the target content and the displayed content, thereby enabling quick acquisition of search results and improving search efficiency.

[0173] In one embodiment, the method further includes: in response to dragging the content capture control from a first position to a second position, updating the search results for the current target content in the interactive interface, wherein the search results for the current target content are determined jointly based on the current target content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control, wherein the current target content is the content located in the second position of the displayed content.

[0174] The second position refers to any position in the interactive interface other than the first position, and the current target content is the content located in the second position of the displayed content.

[0175] In one embodiment, after moving the content capture control from the first position to the second position, if the entity of the target content at the first position and the entity of the target content at the second position belong to different entities of the same attribute, such as "trench coat" and "hoodie" belonging to the clothing attribute, then the process returns to continue execution in response to the step of dragging the content capture control from the first position to the second position.

[0176] In one embodiment, the method further includes: if the content capture controls do not belong to different attributes, for example, "trench coat" and "shoes" belong to the clothing attribute and footwear attribute respectively, then after moving the content capture control from the first position to the second position, displaying multiple associative word controls about the target content at the second position in the interactive interface, wherein the different associative words in the multiple associative word controls are jointly determined based on the target content at the second position and the displayed content. Then, the process returns to step S206 to continue execution.

[0177] For example, such as Figure 15 The diagram illustrates the updating of search results in one embodiment. During the process of displaying the search results for "trench coat" in the preview area 107 of the interactive interface 100, pressing... Figure 15The dragging path indicated by the dashed arrow moves the content capture control from the first position ("trench coat") to the second position ("hoodie"), directly displaying the search results for "hoodie" in preview area 107. These results show images of two hoodie styles and details of the purchase price (120 yuan). Since the search results for "trench coat" are generated based on "trench coat," "M brand," and "purchase," the search results for "hoodie" are also generated based on "M brand," "purchase," and "hoodie."

[0178] In this embodiment, in response to dragging the content capture control from the first position to the second position, the search results of the target content at the second position are directly displayed in the interactive interface. This eliminates the need for the user to select the related word control and search intent control one by one, simplifying the search process at the second position and improving search efficiency.

[0179] In one embodiment, such as Figure 16 As shown, an interaction method is provided, which is applied to Figure 1 Taking terminal 110 as an example, the explanation includes the following steps S1602 to S1606:

[0180] Step S1602: Display the interactive interface, which includes display content and content capture controls.

[0181] Step S1604: In response to dragging the content capture control to the target position in the interactive interface, determine the target content corresponding to the target position from the displayed content.

[0182] Step S1606: Display recommended content that matches the target content in at least a portion of the interactive interface.

[0183] The recommended content can take the form of images, videos, text and images, purchase pages, etc. In one embodiment, the recommended content is associated with the target content; for example, if the target content is "trench coat," the recommended content would be a video or text and images recommending trench coats. Or, if the target content is "thirsty," the recommended content would be a beverage purchase page. In one embodiment, the recommended content can be content obtained through AI search based on the target content. In one embodiment, such as... Figure 17 The diagram illustrates the content recommendation process in one embodiment. Content is displayed in the interactive interface 100, including the text "hoodie" (1) and "trench coat" (2). After dragging the content capture control 101 to the target location, the target content at that location is determined to be "trench coat." At this point, a preview area 107 is displayed in the interactive interface 100. The preview area 107 is used to display recommended content for "trench coat," including detailed information and purchase controls.

[0184] In one embodiment, in response to dragging a content capture control to a target position in the interactive interface, determining target content corresponding to the target position from the displayed content includes: in response to sequentially dragging the content capture control to multiple target positions in the interactive interface, determining multiple target contents corresponding to the multiple target positions from the displayed content.

[0185] In one embodiment, after dragging the content capture control sequentially to multiple target locations on the interactive interface, and if a recommendation trigger operation is detected at each target location, multiple target contents corresponding to the multiple target locations are determined from the displayed content. Here, the recommendation trigger operation refers to recommending content at the corresponding location. For example, the recommendation trigger operation can be a long press, a pause operation, a double-click operation, etc. For instance, in response to a double-click operation after each dragging of the content capture control to the corresponding target location, the target content at that location is determined.

[0186] In this embodiment, by dragging the content capture control sequentially to multiple target locations in the interactive interface, multiple target locations can be anchored. Therefore, subsequent joint recommendations can be made based on multiple target locations to ensure the recommendation effect.

[0187] In one embodiment, displaying recommended content matching target content in at least a portion of the interactive interface includes: generating a promotion request based on multiple target contents; sending the promotion request to a promotion server; receiving recommended content from the promotion server in response to the promotion request; and displaying the received recommended content in at least a portion of the interactive interface.

[0188] The promotion request carries multiple target content items. In one embodiment, after receiving the promotion request from the terminal, the promotion server determines the corresponding recommended content based on at least the multiple target content items in the promotion request. For example, the promotion server can obtain object information of the account performing the drag-and-drop operation, and determine the corresponding recommended content based on the object information and the multiple target content items. In one embodiment, after the terminal obtains the recommended content, the method further includes: generating a search request based on the multiple target content items, sending the search request to a search server, receiving the search results returned by the search server in response to the search request, and displaying the search results and recommended content in an interactive interface.

[0189] In this embodiment, in response to dragging the content capture control sequentially to multiple target locations in the interactive interface, joint recommendations can be made based on the target content corresponding to each target location, ensuring the recommendation effect.

[0190] In one embodiment, the interactive interface is a search interface, displaying response information for a search term; in response to dragging a content capture control to a target location in the interactive interface, determining the target content corresponding to the target location from the displayed content includes: in response to dragging the content capture control to the target location in the search interface, determining the target text corresponding to the target location from the response information. Displaying recommended content matching the target content in at least a portion of the interactive interface includes: displaying recommended content matching the target text in at least a portion of the search interface.

[0191] In one embodiment, after determining the target text, the method further includes: the terminal generating a promotion request based on the target text; sending the promotion request to a promotion server; receiving recommended content from the promotion server in response to the promotion request; and displaying the received recommended content, which is content matching the target text, in at least a portion of the interactive interface. In this embodiment, by sending a promotion request to the promotion server, the promotion server can make accurate recommendations based on the target text, thereby improving recommendation accuracy.

[0192] In this embodiment, entering a search term in the search box of the search interface can trigger a search for the search term and obtain response information. By displaying the response information in the search interface, users can conveniently capture target text from the response information based on their needs using the content capture control.

[0193] In one embodiment, the interactive interface is a video playback interface, and the displayed content includes the video frame of the target video being played; in response to dragging the content capture control to the target position in the interactive interface, determining the target content corresponding to the target position from the displayed content includes: in response to dragging the content capture control to the target position in the video frame, pausing the playback of the target video, and determining the target content corresponding to the target position from the paused video frame.

[0194] The target content can be people in the video footage, their clothing, buildings, words in the subtitles, etc.

[0195] In this embodiment, the content capture control can be used to select any position in any frame of the video. This enables real-time recommendation of target content at the target position dragged by the content capture control, thus realizing content recommendation in the video scene.

[0196] In one embodiment, determining the target content corresponding to the target location from a paused video frame includes: taking a screenshot of the paused video frame to obtain a screenshot image, the screenshot image including a content capture control; performing image recognition on the screenshot image to obtain the target content at the target location where the content capture control is located in the video frame; and displaying recommended content matching the target content in at least a portion of the interactive interface, including: displaying recommended content matching the target content in at least a portion of the video playback interface.

[0197] For example, in response to dragging the content capture control to a target position in the video frame, a screenshot of the paused video frame is taken with the target position as the center, resulting in a screenshot image of a preset size. The preset size is less than or equal to the size of the video frame. For example, the terminal sends a promotion request carrying the target content to a promotion server, and the promotion server filters out recommended content related to the target content from multiple candidate recommended content based on the target content.

[0198] In this embodiment, a screenshot image containing the content capture control is obtained by taking a screenshot of the paused video screen. Therefore, the target position can be determined by recognizing the content capture control, thereby obtaining the target content at the target position. This allows recommended content matching the target content to be displayed in at least a part of the video playback interface.

[0199] In the above interaction method, an interactive interface is displayed, which includes display content and a content capture control. This allows for precise capture of the target content located at the first position within the displayed content by dragging the content capture control to the target position on the interactive interface. This enables accurate content recommendations to be made to the user based on the target content, and directly displays recommended content matching the target content in at least a portion of the interactive interface, thus improving the user's interactive experience.

[0200] In one specific embodiment, such as Figure 18 The diagram shown is a schematic representation of the device interaction process during a search in one embodiment. Figure 18 The text mainly introduces the interaction process between the terminal and the search server. Figure 18The terminal includes an interactive result presentation layer, which comprises an embedded display unit and a multimodal interaction unit. The embedded display unit overlays the results of each triggered operation onto the current interface as floating cards, supporting quick preview and interaction. The multimodal interaction unit supports the display of various types of content, including text, video, and icons. Upon responding to a triggered operation, the terminal sends a response request to the search server, instructing it to perform appropriate processing. The terminal then renders and displays the results returned by the search server in the interactive interface. The search server can be used for target content recognition, semantic analysis, and searching. It can also perform local searches from a local database and return local results, as well as perform cloud searches from a cloud search engine and return cloud results. Furthermore, the search server can sort search results (local and cloud results) according to a result ranking algorithm to present them to the user through interactive results. The search server handles user requests, coordinates the workflow of each execution step, and is responsible for communication with external cloud server interfaces to obtain relevant data and services. The search server also provides external cloud server interfaces to provide additional data resources and computing power, supporting complex searches and semantic analysis. Figure 19 The diagram shown is a timing diagram of the search process in one embodiment. (Refer to...) Figure 19 and Figure 18 The search process is explained below, with the specific implementation steps as follows:

[0201] Step S1901: The user performs the first drag operation on the content capture control.

[0202] The first drag operation is the operation of dragging the content capture control to the first position in the interactive interface.

[0203] Optionally, after the user performs a first drag operation on the content capture control, the terminal responds by dragging the content capture control to a first position in the interactive interface and sends a target content recognition request to the search server. The first drag event refers to the event where the user drags the content capture control to the first position. The search server identifies the target content at the first position based on the first position carried in the target content recognition request and returns it to the terminal. In this embodiment, the search server may have a focus content recognition function, which identifies the focus content at the focus point in the interface. The focus is the position of the content capture control in the interface, as described above, and the focus content can be considered the target content at the first position where the content capture control is located. In other embodiments, the method further includes: the terminal also communicates with a focus content recognition server via a network. To this end, in response to dragging the content capture control to the first position in the interactive interface, the terminal sends a target content recognition request to the focus content recognition server. The focus content recognition server identifies the target content at the first position based on the first position carried in the target content recognition request and returns it to the terminal. This focus content recognition server is used to identify the target content at the location of the content capture control. The first position can be determined by the coordinate capture of the computer vision unit of the focus recognition layer in the terminal. The focus recognition layer is deployed in the terminal and has the function of capturing the coordinate information of the content capture control in the interactive interface to determine the first position.

[0204] Optionally, the terminal displays an interactive interface, which shows content and content capture controls.

[0205] For example, when the interactive interface is a search interface, the displayed content in the interactive interface is the response information for the search term. At this time, the terminal displays a search box in the search interface; in response to triggering a submission operation for the search term after entering a search term in the search box, the response information for the search term is displayed in the response area of ​​the search interface.

[0206] For example, in response to a trigger operation that initiates access to the interactive interface within a preset time period, the terminal displays the interactive interface, and the content displayed on the interactive interface is related to the information query intent corresponding to the preset time period. This trigger operation to access the interactive interface is performed by the user.

[0207] Step S1902: The terminal generates a suggested word generation request.

[0208] Optionally, after determining the target content at the first location, the terminal responds by dragging the content capture control to the first location in the interactive interface and generating a word association generation request. This word association generation request carries the user's object account, the displayed content in the interactive interface, and the target content.

[0209] Step S1903: The terminal sends a request to generate associated words.

[0210] For example, the terminal sends a suggested word generation request to the search server.

[0211] Step S1904: The search server generates multiple related keywords.

[0212] Optionally, after obtaining semantic analysis results by performing semantic analysis on the displayed content and target content, the search server determines the search strategy based on the historical search records of the object account and the semantic analysis results. For example, the upper and lower modeling layers in the search server perform semantic analysis on the displayed content and target content in the associated word generation request, and generate a search strategy based on the semantic analysis results and the historical search records of the object account executing the drag-and-drop. The dynamic retrieval layer in the search server performs local retrieval from the local database based on the search strategy, returning local results, and performs cloud retrieval from the cloud search engine based on the search strategy, returning cloud results. The search server determines multiple associated words based on the local results and the cloud search results.

[0213] Step S1905: The search server sends multiple suggested terms.

[0214] Optionally, the search server sends multiple related keywords about the target content to the terminal.

[0215] Step S1906: The terminal generates multiple associated word controls based on multiple associated words and displays the multiple associated word controls on the interactive interface.

[0216] Optionally, after acquiring multiple suggested keyword controls, in response to dragging the content capture control to a first position in the interactive interface, and if the terminal detects a suggested search trigger operation at the first position, it displays multiple suggested keyword controls related to the target content in the interactive interface. For example, displaying multiple suggested keyword controls related to the target content in the interactive interface includes: displaying multiple suggested keyword controls associated with the target content in the area surrounding the target content in the interactive interface. The terminal's behavior analysis engine can deduce whether the user's intent is a suggested search intent based on whether a suggested search trigger operation is detected.

[0217] Step S1907: The user performs a trigger operation on any of the associated word controls.

[0218] Step S1908: The terminal generates a search intent generation request.

[0219] Optionally, in response to a triggering operation on any of the suggested word controls, the terminal generates a search intent generation request. This search intent generation request carries the displayed content in the interactive interface and the suggested words in the triggered suggested word control.

[0220] Step S1909: The terminal sends a search intent generation request.

[0221] Optionally, the terminal sends a search intent generation request to the search server.

[0222] Step S1910: The search server generates multiple search intents.

[0223] Optionally, the search server infers intent based on the displayed content and the associated words in the triggered associated word control, thereby obtaining multiple search intents corresponding to the triggered associated word control.

[0224] Step S1911: The search server sends multiple search intents.

[0225] Optionally, the search server sends multiple search intents corresponding to the triggered associated word control to the terminal.

[0226] Step S1912: The terminal generates multiple search intent controls based on multiple search intents and displays the multiple search intent controls in the interactive interface.

[0227] Optionally, after determining multiple search intent controls, the terminal, in response to the triggering operation of any of the suggested word controls, displays a content pop-up window in the interactive interface for the triggered suggested word control, and the content pop-up window presents the search object corresponding to the suggested word in the triggered suggested word control; in the interactive interface, multiple search intent controls are displayed in the area surrounding the content pop-up window, and each search intent control presents a different search intent for the search object.

[0228] For example, multiple search intent controls are displayed in the area surrounding the content pop-up in the interactive interface, including: in response to an interactive operation on a search object within the content pop-up, multiple search intent controls related to the search object are displayed in the area surrounding the content pop-up in the interactive interface.

[0229] For example, in response to an interactive operation on a search object within a content pop-up window, the method cancels the display of other related word controls among multiple related word controls except for the triggered related word control in the interactive interface; the method further includes: in response to a triggering operation on any search intent control, displaying a related search return control in the interactive interface; and in response to a triggering operation on the related search return control, re-displaying multiple related word controls about the target content in the interactive interface.

[0230] Step S1913: The user performs a trigger operation on any search intent control.

[0231] Step S1914: The terminal generates a search request.

[0232] Optionally, in response to a triggering operation on any search intent control, the terminal generates a search request carrying the triggered search intent control.

[0233] Step S1915: The terminal sends a search request.

[0234] Optionally, the terminal sends a search request to the search server.

[0235] Step S1916: The search server determines the search results.

[0236] Optionally, the search server searches from a local database and a cloud search engine based on the search intent corresponding to the triggered search intent control to determine the search results for the triggered search intent control.

[0237] Step S1917: The search server sends the search results.

[0238] Optionally, the search server sends the search results to the terminal.

[0239] Step S1918: The terminal displays the search results on the interactive interface.

[0240] Optionally, after the terminal obtains the search results, in response to the triggering operation of any search intent control, the terminal embeds a preview area in the interactive interface and presents the search results corresponding to the triggered search intent control in the preview area; the method further includes: in response to the triggering operation of other search intent controls, presenting the search results corresponding to the other triggered search intent controls in the preview area.

[0241] Optionally, after performing step S1912, the method further includes: in response to the selection operation of multiple search intent controls, displaying an intent merging control for the multiple search intent controls in the interactive interface; in response to the triggering operation of the intent merging control, embedding and displaying search results in the interactive interface, the search results being obtained based on multiple search intents in the multiple search intent controls.

[0242] Optionally, after performing step S1912, the interactive interface of the terminal displaying multiple search intent controls further includes an intent query control. The method further includes: in response to a triggering operation of the intent query control, the terminal displays a statement input box, which includes a query statement about the target content. The query statement is a question generated based on the target content and the associated words in the triggered associated word control; in response to a triggering operation of the query statement, a newly added search intent control is displayed, where the search intent is generated based on the target content, the associated words in the triggered associated word control, and the historical search records of other object accounts; in response to a triggering operation of the newly added search intent control, the search results corresponding to the triggered newly added search intent control are embedded and displayed in the interactive interface.

[0243] Optionally, after performing step S1918, the method further includes: in response to dragging the content capture control from the first position to the second position, the terminal updates the search results for the current target content in the interactive interface. The search results for the current target content are determined jointly based on the current target content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control. The current target content is the content located in the second position of the displayed content.

[0244] Optionally, after performing step S1901, the method further includes: in response to dragging the content capture control to a first position in the interactive interface, the terminal displays multiple search intent controls for the target content in the interactive interface, the multiple search intent controls being jointly determined based on the target content and the displayed content; in response to triggering any search intent control, the terminal embeds and displays the search results corresponding to the triggered search intent control in the interactive interface.

[0245] In this embodiment, an interactive interface is displayed, which includes display content and content capture controls. In response to dragging the content capture control to a first position in the interactive interface, the target content at that first position in the display content is accurately captured. Then, multiple related word controls are displayed in the interactive interface, providing the user with multiple related word controls based on the target content and the display content in the interactive interface. Since the display content reflects the contextual information of the target content, different related words in these multiple related word controls can accurately match the user's current potential search needs. Subsequently, by triggering any of the related word controls, the associated words that the user is interested in can be identified, and multiple corresponding search intent controls can be displayed in the interactive interface. Different search intents in these multiple search intent controls can accurately match the user's current potential search intent. Then, in response to triggering any of the multiple search intent controls, the corresponding search results can be embedded and displayed in the interactive interface according to the user's accurate search intent. The entire search process is based on real-time dynamic search interaction within a single interactive interface. It eliminates the need for manual input or copy-pasting of search terms, accurately captures the user's search intent, and provides precise search results matching that intent, thus improving search efficiency and enhancing the user experience. Furthermore, it can perform searches based on the specific scenarios involved in the interactive interface, further improving efficiency. Moreover, the use of contextual information within the displayed content to perform associative searches ensures the accuracy of search results and increases click-through rates. Additionally, the entire process is triggered naturally, enhancing the user search experience.

[0246] In one specific embodiment, an interaction method is provided, comprising the following steps: A terminal displays an interactive interface, which includes display content and a content capture control. In response to dragging the content capture control to at least one target position in the interactive interface, target content corresponding to the at least one target position is determined from the display content. The terminal generates a promotion request based on the at least one target content; sends the promotion request to a promotion server; receives recommended content from the promotion server in response to the promotion request; and displays the received recommended content in at least a portion of the interactive interface.

[0247] The following examples illustrate the interaction process in search and video playback scenarios: When the interaction interface is a search interface, the displayed content is the response information for the search term; at this time, in response to dragging the content capture control to the target position in the search interface, the target text corresponding to the target position is determined from the response information. Recommended content matching the target text is displayed in at least a portion of the search interface.

[0248] When the interactive interface is a video playback interface, the displayed content includes the video frame of the target video being played. At this time, in response to dragging the content capture control to the target position in the video frame, the playback of the target video is paused, and a screenshot is taken of the paused video frame, resulting in a screenshot image that includes the content capture control. Image recognition is performed on the screenshot image to obtain the target content at the target position of the content capture control in the video frame. Recommended content matching the target content is displayed in at least a portion of the video playback interface.

[0249] In this embodiment, an interactive interface is displayed, which includes display content and a content capture control. Thus, in response to dragging the content capture control to a target position in the interactive interface, the target content located at a first position within the display content is accurately captured. This enables accurate content recommendations to be made to the user based on the target content, and directly displays recommended content matching the target content in at least a portion of the interactive interface, improving the user's interactive experience.

[0250] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0251] Based on the same inventive concept, this application also provides a search apparatus for implementing the search method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, specific limitations in one or more search apparatus embodiments provided below can be found in the limitations of the search method described above, and will not be repeated here.

[0252] In one exemplary embodiment, such as Figure 20 As shown, a search device 2000 is provided, including: a first interactive interface display module 2002, a word association control display module 2004, a search intent control display module 2006, and a search result display module 2008, wherein:

[0253] The first interactive interface display module 2002 is used to display the interactive interface, which includes display content and content capture controls.

[0254] The word association control display module 2004 is used to respond to dragging the content capture control to the first position in the interactive interface, and to display multiple word association controls about the target content in the interactive interface. The target content is the content located in the first position of the displayed content. The different word associations in the multiple word association controls are determined together based on the displayed content and the target content.

[0255] The search intent control display module 2006 is used to display multiple search intent controls corresponding to the triggered associated word control in the interactive interface in response to the triggering operation of any associated word control.

[0256] The search results display module 2008 is used to display the search results corresponding to the triggered search intent control in the interactive interface in response to the triggering operation of any search intent control.

[0257] In one embodiment, the interactive interface is a search interface, and the interactive interface includes display content that is response information for the search term. The first interactive interface display module 2002 is also used to display a search box in the search interface; in response to triggering a submission operation for the search term after entering a search term in the search box, the response information for the search term is displayed in the response area of ​​the search interface.

[0258] In one embodiment, the first interactive interface display module 2002 is further configured to display the interactive interface in response to a trigger operation that enters the interactive interface within a preset time period, wherein the content displayed in the interactive interface is related to the information query intent corresponding to the preset time period.

[0259] In one embodiment, the word association control display module 2004 is configured to display multiple word association controls related to the target content in the interactive interface in response to a detected word association search trigger operation at the first position after dragging the content capture control to a first position in the interactive interface.

[0260] In one embodiment, the word association control display module 2004 is used to display multiple word association controls associated with the target content in the area surrounding the target content in the interactive interface.

[0261] In one embodiment, the associated word control display module 2004 is used to send an associated word generation request to the search server, the associated word generation request carrying the currently logged-in object account, the display content presented in the interactive interface, and the target content; receive multiple associated words from the search server in response to the associated word generation request, the associated words being determined by the search server based on the semantic analysis results obtained from the semantic analysis of the display content and the target content, and then based on the historical search records of the object account and the semantic analysis results; and display multiple associated word controls related to the target content in the interactive interface according to the received multiple associated words.

[0262] In one embodiment, the search intent control display module 2006 is configured to, in response to a triggering operation of any associated word control, display a content pop-up window in the interactive interface for the triggered associated word control, the content pop-up window presenting the search object corresponding to the associated word in the triggered associated word control; and display multiple search intent controls in the area surrounding the content pop-up window in the interactive interface, each search intent control presenting a different search intent for the search object.

[0263] In one embodiment, the search intent control display module 2006 is used to display multiple search intent controls related to the search object in the area surrounding the content pop-up window in the interactive interface in response to an interactive operation on the search object within the content pop-up window.

[0264] In one embodiment, the apparatus further includes a word association control display cancellation module, configured to, in response to an interactive operation on a search object within a content pop-up window, cancel the display of other word association controls among a plurality of word association controls except for the triggered word association control in the interactive interface; the word association control display module 2004 is further configured to, in response to a triggering operation on any search intent control, display a word association search return control in the interactive interface; and, in response to a triggering operation on the word association search return control, re-display multiple word association controls related to the target content in the interactive interface.

[0265] In one embodiment, the search intent control display module 2006 is configured to send a search intent generation request to the search server, the search intent generation request carrying the display content presented in the interactive interface and the associated words in the triggered associated word control; receive multiple search intents fed back by the search server in response to the search intent generation request, the search intents being inferred by the search server based on the display content and the associated words in the triggered associated word control; and display multiple search intent controls corresponding to the triggered associated word control in the interactive interface according to the received multiple search intents.

[0266] In one embodiment, the search results display module 2008 is configured to, in response to dragging a content capture control to a first position in the interactive interface, display multiple search intent controls in the interactive interface for the target content, wherein the multiple search intent controls are jointly determined based on the target content and the displayed content; and in response to a triggering operation on any search intent control, embed and display the search results corresponding to the triggered search intent control in the interactive interface.

[0267] In one embodiment, the search result display module 2008 is configured to embed a preview area in the interactive interface in response to a triggering operation of any search intent control, and to present the search result corresponding to the triggered search intent control in the preview area; the search result display module 2008 is also configured to present the search result corresponding to the other triggered search intent controls in the preview area in response to a triggering operation of other search intent controls.

[0268] In one embodiment, the search result display module 2008 is further configured to, in response to the selection operation of multiple search intent controls, display an intent merging control for the multiple search intent controls in the interactive interface; and, in response to the trigger operation of the intent merging control, embed and display search results in the interactive interface, wherein the search results are obtained by searching based on multiple search intents among the multiple search intent controls.

[0269] In one embodiment, the interactive interface displaying multiple search intent controls further includes an intent query control. The search results display module 2008 is also configured to, in response to a triggering operation of the intent query control, display a statement input box, the statement input box including a query statement about the target content, the query statement being a question generated based on the target content and the associated words in the triggered associated word control; in response to a triggering operation of the query statement, display a newly added search intent control, the search intent in the newly added search intent control being generated based on the target content, the associated words in the triggered associated word control, and the historical search records of other object accounts; and in response to a triggering operation of the newly added search intent control, embed and display the search results corresponding to the triggered newly added search intent control in the interactive interface.

[0270] In one embodiment, the search results display module 2008 is further configured to update the search results for the current target content in the interactive interface in response to dragging the content capture control from the first position to the second position. The search results for the current target content are determined jointly based on the current target content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control. The current target content is the content located in the second position of the displayed content.

[0271] In one exemplary embodiment, such as Figure 21 As shown, an interactive device 2100 is provided, including: a second interactive interface display module 2102, a target content determination module 2104, and a recommended content display module 2106, wherein:

[0272] The second interactive interface display module 2102 is used to display the interactive interface, which includes display content and content capture controls.

[0273] The target content determination module 2104 is used to determine the target content corresponding to the target position from the displayed content in response to dragging the content capture control to the target position in the interactive interface.

[0274] The recommended content display module 2106 is used to display recommended content that matches the target content in at least a portion of the interactive interface.

[0275] In one embodiment, the target content determination module 2104 is configured to determine multiple target contents corresponding to the multiple target locations from the displayed content in response to sequentially dragging the content capture control to multiple target locations in the interactive interface.

[0276] In one embodiment, the recommended content display module 2106 is configured to generate a promotion request based on multiple target contents; send the promotion request to a promotion server; receive the recommended content from the promotion server in response to the promotion request; and display the received recommended content in at least a portion of the interactive interface.

[0277] In one embodiment, the interactive interface is a search interface, and the displayed content is the response information for the search term; the target content determination module 2104 is used to determine the target text corresponding to the target position from the response information in response to dragging the content capture control to the target position in the search interface; the recommended content display module 2106 is used to display recommended content that matches the target text in at least a portion of the search interface.

[0278] In one embodiment, the interactive interface is a video playback interface, which displays video frames of the target video that is being played; the target content determination module 2104 is used to pause the playback of the target video in response to dragging the content capture control to the target position in the video frame, and determine the target content corresponding to the target position from the paused video frame.

[0279] In one embodiment, the target content determination module 2104 is used to take a screenshot of the paused video frame to obtain a screenshot image, the screenshot image including a content capture control; perform image recognition on the screenshot image to obtain the target content at the target location of the content capture control in the video frame; and the recommended content display module 2106 is used to display recommended content that matches the target content in at least a portion of the video playback interface.

[0280] The modules in the aforementioned search and interaction devices can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0281] In one exemplary embodiment, a computer device is provided, which may be a server or a terminal, and its internal structure diagram may be as follows. Figure 22 As shown, this computer device includes a processor, memory, input / output (I / O) interfaces, and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and databases. The internal memory provides the environment for the operating system and computer programs stored in the non-volatile storage media to run. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communicating with external terminals via a network connection. When the computer program is executed by the processor, it implements a search method and an interaction method.

[0282] Those skilled in the art will understand that Figure 22 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0283] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0284] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0285] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0286] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0287] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0288] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0289] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A search method, characterized in that, The method includes: The interactive interface includes display content and content capture controls. In response to dragging the content capture control to a first position in the interactive interface, multiple related word controls about the target content are displayed in the interactive interface. The target content is the content located at the first position in the displayed content. Different related words in the multiple related word controls are determined together based on the displayed content and the target content. In response to a triggering operation on any of the associated word controls, multiple search intent controls corresponding to the triggered associated word controls are displayed in the interactive interface; In response to a triggering operation on any search intent control, the search results corresponding to the triggered search intent control are embedded and displayed in the interactive interface.

2. The method according to claim 1, characterized in that, The interactive interface is a search interface, and the displayed content in the interactive interface is the response information for the search term. The method further includes: The search box is displayed in the search interface; In response to the submission of a search term after it is entered in the search box, the response information for the search term is displayed in the response area of ​​the search interface.

3. The method according to claim 1, characterized in that, The display interface includes: In response to a trigger operation that enters the interactive interface within a preset time period, the interactive interface is displayed, and the content displayed in the interactive interface is related to the information query intent corresponding to the preset time period.

4. The method according to claim 1, characterized in that, The response to dragging the content capture control to a first position in the interactive interface, displaying multiple related word controls about the target content in the interactive interface, includes: In response to dragging the content capture control to a first position in the interactive interface, and detecting an associative search trigger operation at the first position, multiple associative word controls about the target content are displayed in the interactive interface.

5. The method according to claim 4, characterized in that, The multiple word association controls displayed in the interactive interface for the target content include: In the interactive interface, multiple associative word controls related to the target content are displayed in the area surrounding the target content.

6. The method according to claim 1, characterized in that, The multiple word association controls displayed in the interactive interface for the target content include: Send a suggested keyword generation request to the search server. The suggested keyword generation request carries the currently logged-in account, the content displayed in the interactive interface, and the target content. The system receives multiple suggested terms from the search server in response to the suggested term generation request. These suggested terms are determined by the search server based on the semantic analysis results obtained from the semantic analysis of the displayed content and the target content, and then based on the historical search records of the target account and the semantic analysis results. Based on the received multiple suggested words, multiple suggested word controls related to the target content are displayed in the interactive interface.

7. The method according to claim 1, characterized in that, In response to a triggering operation on any of the associated word controls, multiple search intent controls corresponding to the triggered associated word control are displayed in the interactive interface, including: In response to a trigger operation on any of the associated word controls, a content pop-up window is displayed in the interactive interface for the triggered associated word control, and the content pop-up window presents the search object corresponding to the associated word in the triggered associated word control; In the interactive interface, multiple search intent controls are displayed in the area surrounding the content pop-up window, with each search intent control presenting a different search intent for the search object.

8. The method according to claim 7, characterized in that, The area surrounding the content pop-up in the interactive interface displays multiple search intent controls, including: In response to an interactive operation targeting a search object within the content pop-up, multiple search intent controls related to the search object are displayed in the area surrounding the content pop-up in the interactive interface.

9. The method according to claim 7, characterized in that, The method further includes: In response to an interactive operation on the search object within the content pop-up window, the other associated word controls among the plurality of associated word controls, except for the triggered associated word control, are de-displayed in the interactive interface; The method further includes: In response to a triggering operation on any search intent control, a search return control is displayed in the interactive interface; In response to a triggering operation on the associated search return control, multiple associated word controls related to the target content are displayed again in the interactive interface.

10. The method according to claim 1, characterized in that, The multiple search intent controls displayed in the interactive interface corresponding to the triggered associated word control include: Send a search intent generation request to the search server. The search intent generation request carries the display content presented in the interactive interface and the associated words in the triggered associated word control. The system receives multiple search intents from the search server in response to the search intent generation request. These search intents are inferred by the search server based on the displayed content and the associated words in the triggered associated word control. Based on the received multiple search intents, multiple search intent controls corresponding to the triggered associated word control are displayed in the interactive interface.

11. The method according to claim 1, characterized in that, The method further includes: In response to dragging the content capture control to a first position in the interactive interface, multiple search intent controls are displayed in the interactive interface for the target content, and the multiple search intent controls are determined together based on the target content and the displayed content; In response to a triggering operation on any search intent control, the search results corresponding to the triggered search intent control are embedded and displayed in the interactive interface.

12. The method according to claim 1, characterized in that, The step of responding to a triggering operation on any search intent control by embedding and displaying the search results corresponding to the triggered search intent control in the interactive interface includes: In response to a triggering operation of any search intent control, a preview area is embedded in the interactive interface, and the search results corresponding to the triggered search intent control are presented in the preview area; The method further includes: In response to a triggering action on another search intent control, the search results corresponding to the triggered other search intent controls are displayed in the preview area.

13. The method according to claim 1, characterized in that, The method further includes: In response to the selection of multiple search intent controls, display an intent merging control for the multiple search intent controls in the interactive interface; In response to a trigger operation on the intent merging control, a search result is embedded and displayed in the interactive interface. The search result is obtained by searching based on multiple search intents among the multiple search intent controls.

14. The method according to claim 1, characterized in that, The interactive interface displaying multiple search intent controls also includes an intent query control, and the method further includes: In response to a triggering operation of the intent query control, a statement input box is displayed, the statement input box including a query statement about the target content, the query statement being a question generated based on the target content and the associated words in the triggered associated word control; In response to the triggering operation of the query statement, a newly added search intent control is displayed. The search intent in the newly added search intent control is generated based on the target content, the associated words in the triggered associated word control, and the historical search records of other object accounts. In response to the triggering operation of the newly added search intent control, the search results corresponding to the triggered newly added search intent control are embedded and displayed in the interactive interface.

15. The method according to any one of claims 1 to 14, characterized in that, The method further includes: In response to dragging the content capture control from the first position to the second position, the search results for the current target content are updated in the interactive interface. The search results for the current target content are determined jointly based on the current target content, the associated words in the associated word control triggered when the content capture control is in the first position, and the search intent in the search intent control. The current target content is the content located in the second position of the displayed content.

16. An interaction method, characterized in that, The method includes: The interactive interface includes display content and content capture controls. In response to dragging the content capture control to a target position in the interactive interface, the target content corresponding to the target position is determined from the displayed content; Recommended content matching the target content is displayed in at least a portion of the interactive interface.

17. The method according to claim 16, characterized in that, The step of responding to dragging the content capture control to a target position in the interactive interface and determining the target content corresponding to the target position from the displayed content includes: In response to sequentially dragging the content capture control to multiple target locations in the interactive interface, multiple target contents corresponding to the multiple target locations are determined from the displayed content.

18. The method according to claim 17, characterized in that, Displaying recommended content matching the target content in at least a portion of the interactive interface includes: Generate a promotion request based on the multiple target contents; Send the promotion request to the promotion server; Receive the recommended content from the promotion server in response to the promotion request; The received recommended content is displayed in at least a portion of the interactive interface.

19. The method according to claim 16, characterized in that, The interactive interface is a search interface, and the displayed content is the response information for the search term; The step of responding to dragging the content capture control to a target position in the interactive interface and determining the target content corresponding to the target position from the displayed content includes: In response to dragging the content capture control to a target location in the search interface, the target text corresponding to the target location is determined from the response information; Displaying recommended content matching the target content in at least a portion of the interactive interface includes: Recommended content matching the target text is displayed in at least a portion of the search interface.

20. The method according to claim 16, characterized in that, The interactive interface is a video playback interface, and the displayed content includes the video frame of the target video that is being played. The step of responding to dragging the content capture control to a target position in the interactive interface and determining the target content corresponding to the target position from the displayed content includes: In response to dragging the content capture control to the target position in the video frame, pause the playback of the target video and determine the target content corresponding to the target position from the paused video frame.

21. The method according to claim 20, characterized in that, Determining the target content corresponding to the target location from the paused video frame includes: A screenshot is taken of the paused video frame to obtain a screenshot image, the screenshot image including the content capture control; Image recognition is performed on the screenshot to obtain the target content at the target location of the content capture control in the video frame; Displaying recommended content matching the target content in at least a portion of the interactive interface includes: Recommended content matching the target content is displayed in at least a portion of the video playback interface.

22. A search device, characterized in that, The device includes: The first interactive interface display module is used to display the interactive interface, which includes display content and content capture controls. The word association control display module is used to respond to dragging the content capture control to a first position in the interactive interface, and to display multiple word association controls related to target content in the interactive interface. The target content is the content located at the first position in the displayed content. Different word associations in the multiple word association controls are determined together based on the displayed content and the target content. The search intent control display module is used to display multiple search intent controls corresponding to the triggered associated word control in the interactive interface in response to the triggering operation of any associated word control. The search results display module is used to embed and display the search results corresponding to the triggered search intent control in the interactive interface in response to a triggering operation of any search intent control.

23. An interactive device, characterized in that, The device includes: The second interactive interface display module is used to display the interactive interface, which includes display content and content capture controls. The target content determination module is used to determine the target content corresponding to the target position from the displayed content in response to dragging the content capture control to the target position in the interactive interface; A recommended content display module is used to display recommended content that matches the target content in at least a portion of the interactive interface.

24. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 21.

25. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 21.

26. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 21.

Images