Search data processing method and device, computer, medium and program product

Abstract

The embodiment of the invention discloses a search data processing method and device, a computer, a medium and a program product, and the method comprises the steps: responding to a moving operation for a search box located in an initial position range in an application page, and moving the search box to a target position range in the application page; the initial position range is different from the target position range; in a search box located in the target position range, displaying the target multimedia data selected by the search box; the target multimedia data belongs to multimedia data contained in the target position range; and in response to a trigger operation for the target multimedia data in the search box, displaying a search result for the target multimedia data in the application page. By adopting the application, the search efficiency, the search success rate and the operability of the application can be improved while the search mode of the application is enriched and the search range is expanded.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a search data processing method, apparatus, computer, medium, and program product. Background Technology

[0002] With the rapid development of electronic device technologies and the widespread adoption of the internet, various applications that rely on electronic devices for existence and operation have experienced explosive growth. While ensuring high-quality operation, these applications also pay close attention to operability and user experience. Search functionality, especially during app browsing, is a crucial aspect of operability. Currently, common search methods offered by various applications primarily involve dragging images to the search box or having a persistent search box that users can click to initiate a search. However, these methods are relatively limited. One method, using a persistent search box at the top of the page for text input, offers text search but lacks image search capabilities, requiring manual operation and resulting in a complex and inefficient process. Another method allows dragging images to the search box, but this fails for images that cannot be dragged, leading to low success rates and limited operability. Summary of the Invention

[0003] This application provides a search data processing method, apparatus, computer, medium, and program product, which can enrich the search methods of applications and improve search efficiency and search success rate.

[0004] One embodiment of this application provides a search data processing method, the method comprising:

[0005] In response to a movement operation on the search box within the application page that is initially located within its target location range, move the search box to the target location range within the application page; the initial location range and the target location range are different.

[0006] The search box within the target location range displays the target multimedia data selected by the search box; the target multimedia data belongs to the multimedia data included within the target location range.

[0007] In response to a trigger action on the target multimedia data within the search box, display the search results for the target multimedia data on the application page.

[0008] One embodiment of this application provides a search data processing apparatus, the apparatus comprising:

[0009] The search box movement module is used to respond to movement operations on the search box located in the initial position range within the application page, and to move the search box to the target position range within the application page; the initial position range and the target position range are different.

[0010] The data display module is used to display the target multimedia data selected by the search box within the target location range; the target multimedia data belongs to the multimedia data included within the target location range.

[0011] The results display module responds to trigger operations on the target multimedia data within the search box and displays the search results for the target multimedia data on the application page.

[0012] In one possible implementation, when the data display module displays the target multimedia data selected by the search box within the target location range, the data display module is specifically used to perform the following operations:

[0013] Highlight the multimedia data contained within the target location range, and identify the highlighted multimedia data as the target multimedia data;

[0014] A search box is displayed within the target location area to enclose the target multimedia data, and a search icon is displayed within the search box; the search icon indicates that the search box has the function of searching for the enclosed target multimedia data.

[0015] In one possible implementation, when the data display module displays the target multimedia data selected by the search box within the target location range, the data display module is specifically used to perform the following operations:

[0016] The multimedia data contained within the target location area is highlighted, and a search box is displayed within the target location area to surround the highlighted multimedia data. A search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted multimedia data.

[0017] In response to a partial selection operation of the search box within a target location range, the search icon is hidden, and the search box is moved to the target search location; the target search location is a local area within the target location range.

[0018] Displays a search box within the target search location to select the target multimedia data; the target multimedia data is the multimedia data contained within the target search location.

[0019] In one possible implementation, when the data display module displays a search box for selecting target multimedia data within the target search location, the data display module specifically performs the following operations:

[0020] In response to a partial selection operation of the search box within the target search location, move the search box to the character search location; the character search location is a local area within the target search location.

[0021] Displays a search box within the character search position to select the target multimedia data; the target multimedia data is the character within the character search position.

[0022] In one possible implementation, the multimedia data contained within the target location range is image data; when the data display module displays the target multimedia data selected by the search box within the target location range, the data display module is specifically used to perform the following operations:

[0023] The image data contained within the target location range is highlighted, and a search box is displayed within the target location range to surround the highlighted image data. A search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted image data.

[0024] In response to a local selection operation of the search box within the target location range, the image data within the target location range is magnified and the search box is moved to the element search position in the magnified image data; the element search position is a local area in the image data within the target location range.

[0025] A search box is displayed at the element search location to select the target multimedia data, and the search icon is moved synchronously to the search box for display; the target multimedia data is the key element located at the element search location in the image data.

[0026] In one possible implementation, the multimedia data contained within the target location range is video data; when the data display module displays the target multimedia data selected by the search box within the target location range, the data display module is specifically used to perform the following operations:

[0027] Highlight the video data contained within the target location area, and identify the highlighted video data as the target multimedia data;

[0028] A search box is displayed within the target location range to surround the target multimedia data. A video indicator icon is displayed within the search box. The video indicator icon is transformed from the search icon that follows the search box. The video indicator icon is used to indicate that the target multimedia data surrounded by the search box is video data, and it is used to indicate that the search box has a search function for the surrounded video data.

[0029] In one possible implementation, the results display module is used to respond to a trigger operation on the target multimedia data within the search box. When displaying the search results for the target multimedia data on the application page, the results display module is specifically used to perform the following operations:

[0030] Respond to a trigger operation targeting the target multimedia data within the search box and retrieve search results for the target multimedia data;

[0031] The application page displays the results interface, which shows the target multimedia data and the search results for the target multimedia data.

[0032] In one possible implementation, the target multimedia data is video data, and the search results include video element results and audio parsing results. The results display module is used to display the target multimedia data in the results interface. When displaying search results for the target multimedia data, the results display module is specifically used to perform the following operations:

[0033] The video data is highlighted, and the results interface displays the highlighted video data, as well as the video element results and audio parsing results for the video data. The video element results are obtained by searching for the currently playing video element in the video data, and the audio parsing results are obtained by parsing the audio data corresponding to the video data within the audio search time period.

[0034] In one possible implementation, the results interface also includes an audio progress control, which includes a sub-image corresponding to a video frame in the video data. The image size of the sub-image is smaller than the image size of the video frame. The audio progress control includes a slider icon and a search time sub-control. The results display module is also used to perform the following operations:

[0035] If the response is to a sliding operation of the slider icon in the audio progress control, the slider icon is slid to the updated video frame position of the audio progress control, the updated video frame corresponding to the sub-image at the updated video frame position is obtained, and the currently playing video frame in the video data is switched to be displayed as the updated video frame.

[0036] If an adjustment operation is performed on the search time sub-control, the duration of the audio search time period is updated to obtain the updated audio search time period, and the updated audio parsing result is obtained; the updated audio parsing result is obtained by parsing the audio data corresponding to the video data within the updated audio search time period;

[0037] Delete the audio parsing result in the results interface and display the updated audio parsing result.

[0038] In one possible implementation, the results interface also includes a follow-up question icon; the results display module is also used to perform the following operations:

[0039] The response to the follow-up question icon in the results screen retrieves the follow-up question data.

[0040] In response to the triggered action on the follow-up data, the follow-up data and the search results for the follow-up data will be displayed in the results interface.

[0041] In one possible implementation, the results display module is used to display follow-up data and search results for follow-up data in the results interface. Specifically, the results display module is used to perform the following operations:

[0042] In the results interface, delete the search results for the target multimedia data and display the search results for the follow-up questions.

[0043] Alternatively, in the results interface, the search results for the target multimedia data can be moved from the first display position to the second display position, and the follow-up search results for the follow-up data can be displayed in the first display position; both the first and second display positions are located in the results interface, and the display priority of the first display position is higher than that of the second display position.

[0044] In one possible implementation, when the results display module is used to display the results interface on the application page, the results display module is specifically used to perform the following operations:

[0045] Overlay a mask frame with filter functionality on the application page, and display the results interface within the mask frame;

[0046] Alternatively, a sub-window can be displayed within the application page, and the results interface can be displayed within the sub-window; the sub-window is an area displayed independently on the application page, and the display size of the sub-window is smaller than the display size of the application page.

[0047] In one possible implementation, the results interface also includes a delete icon; the results display module is also used to perform the following operations:

[0048] The system responds to the trigger action of deleting an icon in the results screen, exits the results screen, and restores the application page.

[0049] In one possible implementation, the search data processing device further includes a status acquisition module, which is used to perform the following operations:

[0050] Obtain the content status information of the target multimedia data, parse the target multimedia data based on the content status information, and obtain search results for the target multimedia data.

[0051] In one possible implementation, the state acquisition module is used to parse the target multimedia data based on content state information. When obtaining search results for the target multimedia data, the state acquisition module specifically performs the following operations:

[0052] If the content status information indicates that the target multimedia data is text data, then the text data corresponding to the target multimedia data is parsed to obtain the text parsing result;

[0053] If the text parsing result indicates that the text data belongs to the industry terminology type, then the text data is interpreted to obtain the terminology interpretation result, and the terminology interpretation result is determined as the search result for the target multimedia data;

[0054] If the text parsing result indicates that the text data belongs to the question type, then a question search is performed on the question to obtain the question answer result, and the question answer result is determined as the search result for the target multimedia data.

[0055] In one possible implementation, the state acquisition module is used to parse the target multimedia data based on content state information. When obtaining search results for the target multimedia data, the state acquisition module specifically performs the following operations:

[0056] If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is a key element in the image data, then the key element is searched to obtain the search results for the target multimedia data.

[0057] If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is complete image data, then at least two key elements in the image data are obtained, the at least two key elements are fused and parsed to obtain the fusion and parsing result, and the fusion and parsing result is searched to obtain the search results for the target multimedia data.

[0058] In one possible implementation, the state acquisition module is used to parse the target multimedia data based on content state information. When obtaining search results for the target multimedia data, the state acquisition module specifically performs the following operations:

[0059] If the content status information indicates that the target multimedia data is video data, then the currently playing video frame in the video data is obtained, and the video elements in the currently playing video frame are searched to obtain the video element results;

[0060] Obtain the audio data corresponding to the video data within the audio search time period, parse the audio data, and obtain the audio parsing results;

[0061] The video element results and audio parsing results are used to determine the search results for the target multimedia data.

[0062] In one possible implementation, the results display module is used to respond to a triggering operation on follow-up data, display the follow-up data in the results interface, and when displaying follow-up search results on the follow-up data, the results display module is specifically used to perform the following operations:

[0063] In response to the triggered operation on the follow-up data, parse the follow-up data to obtain the initial parsing result;

[0064] The initial parsing results and the target multimedia data are fused to obtain fused data. The fused data is then searched to obtain follow-up search results for the follow-up data.

[0065] The results page displays follow-up data and search results for follow-up questions based on that data.

[0066] One embodiment of this application provides a computer device, including a processor, a memory, and an input / output interface;

[0067] The processor is connected to a memory and an input / output interface, respectively. The input / output interface is used to receive and output data, the memory is used to store computer programs, and the processor is used to call the computer programs so that the computer device containing the processor executes the method in one aspect of the embodiments of this application.

[0068] One aspect of this application provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having the processor performs the method of one aspect of this application.

[0069] One aspect of this application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional embodiments of this application. In other words, when the computer instructions are executed by the processor, they implement the methods provided in various optional embodiments of this application.

[0070] In this embodiment, in response to a movement operation of a search box located within an initial position range on the application page, the search box is moved to a target position range on the application page; the initial position range is different from the target position range; in the search box located within the target position range, the target multimedia data selected by the search box is displayed; the target multimedia data belongs to the multimedia data included within the target position range; in response to a trigger operation on the target multimedia data within the search box, the search results for the target multimedia data are displayed on the application page. Through the above process, the mobility and interactivity of the search box are fully utilized, allowing users to efficiently move the search box to the target location and freely select the multimedia data to be searched within that location. This enables interactive search, obtaining and displaying search results, enriching the application's search methods. Furthermore, the mobility and interactivity of the search box are provided, eliminating the limitation on whether the selected multimedia data can be dragged. In other words, this embodiment allows users to always drag the search box to search for any content on the page, improving the search success rate. Users no longer need to manually enter keywords into the search box; they can simply drag the search box to select the desired multimedia data, improving search efficiency and the operability of the application search, thereby further enhancing the user experience. Attached Figure Description

[0071] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0072] Figure 1 This is a network interaction architecture diagram provided in an embodiment of this application;

[0073] Figure 2 This is a schematic diagram illustrating a scenario of a search data processing method provided in an embodiment of this application;

[0074] Figure 3 This application provides a method flow for searching data processing. Figure 1 ;

[0075] Figure 4 This application provides a method flow for searching data processing. Figure 2 ;

[0076] Figure 5 This is a schematic diagram of a text data search provided in an embodiment of this application;

[0077] Figure 6 This is a schematic diagram of an image data search provided in an embodiment of this application;

[0078] Figure 7 This is a schematic diagram of a video data search provided in an embodiment of this application;

[0079] Figure 8 This is a schematic diagram of a follow-up search provided in an embodiment of this application;

[0080] Figure 9 This is a schematic diagram illustrating a search processing procedure provided in an embodiment of this application;

[0081] Figure 10 This is a schematic diagram of a search data processing device provided in an embodiment of this application;

[0082] Figure 11 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0083] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0084] If this application requires the collection of object data (such as user data), a prompt interface or pop-up window will be displayed before and during the collection process. This prompt interface or pop-up window is used to inform the user that certain data is being collected. The data acquisition steps will only begin after the user confirms the prompt interface or pop-up window; otherwise, the process will end. Furthermore, the acquired user data will be used in reasonable and legal scenarios or for legitimate purposes. Optionally, in scenarios where user data needs to be used but user authorization has not been obtained, authorization can be requested from the user, and the user data can only be used after authorization is granted.

[0085] It is understood that, in the specific embodiments of this application, the user data involved requires user permission or consent when the following embodiments of this application are applied to specific products or technologies, and the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant regions.

[0086] Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that utilize digital computers or computers-controlled machines to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that attempts to understand the essence of intelligence and produce new intelligent machines that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to possess perception, reasoning, and decision-making capabilities.

[0087] Artificial intelligence (AI) is a comprehensive discipline encompassing a wide range of fields, including both hardware and software technologies. Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies primarily include computer vision, speech processing, natural language processing, as well as machine learning / deep learning, autonomous driving, and intelligent transportation.

[0088] With the research and advancement of artificial intelligence (AI) technology, AI is being studied and applied in various fields, such as smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, autonomous driving, drones, robots, smart healthcare, smart customer service, vehicle networking, and intelligent transportation. It is believed that with the development of technology, AI will be applied in more fields and play an increasingly important role.

[0089] This application may involve core AI algorithm technology in the field of artificial intelligence. When a business device searches for data, it can use AI algorithm technology to parse and process the data and generate the search results indicated by the data.

[0090] In the embodiments of this application, please refer to Figure 1 , Figure 1 This is a network interaction architecture diagram provided in an embodiment of this application, such as... Figure 1As shown in the diagram, the network interaction architecture may include a service server 101 and a service device cluster. The service device cluster may include service devices 102a, 102b, 102c, ..., 102n. Communication connections may exist between service devices in the cluster; for example, there is a communication connection between service devices 102a and 102b, and between service devices 102a and 102c. Simultaneously, any service device in the service device cluster may have a communication connection with the service server 101; for example, there is a communication connection between service device 102a and service server 101. The communication connection method is not limited; it can be established directly or indirectly through wired communication, wireless communication, or other methods. This application does not impose any restrictions on these methods.

[0091] It should be understood that, such as Figure 1 Each service device in the service device cluster shown can have an application client installed. When the application client runs on each service device, it can interact with the aforementioned... Figure 1 The business servers 101 shown interact with each other, enabling them to receive business data from each business device. The application client can be any application client with the capabilities to display text, images, audio, and video data, as well as search functionality, such as social applications, instant messaging applications, live streaming applications, short video applications, video applications, music applications, shopping applications, novel applications, payment applications, or browsers. This application client can be a standalone client or an embedded sub-client integrated into another client (e.g., an instant messaging client, a social client, a video client, etc.), without limitation. Taking a browser as an example, the business server 101 can be a collection of multiple servers, including a web server (World Wide Web Server), a database server, a content delivery network server (CDN server), a caching server, an artificial intelligence server (AI server), a load balancer, a log server, and a security server. Therefore, each business device can transmit data with the business server 101 through the application client corresponding to the browser. For example, each business device can search for or browse the same content with other business devices through the business server 101.

[0092] Taking a browser as an example, business server 101 can provide services such as browser login, web browsing, search query, and security protection to the business device cluster through communication functions. For instance, if a target user logs in through a browser installed on business device 102a, business device 102a can receive business data returned by business server 101 (e.g., the target user's personal account information, browsing history, bookmarks, etc.) and display the relevant application page on the screen. This application page displays the webpage browsed by the target user, allowing business device 102a to respond to relevant operations on the application page and update the content display accordingly. In response to a movement operation of the search box within the initial location range on the application page, business device 102a moves the search box to the target location range, displays and searches for target multimedia data within the target location range, sends the target multimedia data to business server 101, obtains the search results for the target multimedia data returned by business server 101, and displays them on the application page. The initial location range generally refers to the initial default position of the search box in the page application; for example, the initial default position could be at the top of the application page. The position of the search box can change in response to dragging operations. For example, if a user long-presses the search box, the browser on the application device can respond by raising the search box's page hierarchy, making it draggable, and allowing it to be moved from its initial position to a target position. The target position refers to the area where the search box resides after being moved within the application page—the area the user intends to search within. The search box also has the function of searching for target multimedia data. The browser can respond to triggering operations on target multimedia data within the search box, retrieve the surrounding multimedia data, send it to the application server 101, and receive search results for that target multimedia data, thus enabling the search operation.

[0093] Through the above process, the mobility and interactivity of the search box are fully utilized, allowing users to efficiently move the search box to the target location and freely select the multimedia data to be searched within that location. This enables interactive search, obtaining and displaying search results, enriching the application's search methods. Furthermore, the mobility and interactivity of the search box are provided, eliminating the limitation on whether the selected multimedia data can be dragged. In other words, this embodiment allows searching any content on the page by dragging the search box, improving the search success rate. The interactive services of the search box (i.e., selection and search functions) allow direct searching of the target multimedia data within the search box, eliminating the need for users to manually input the target multimedia data. Simply dragging the search box to select the desired multimedia data improves search efficiency and application operability, further enhancing the user experience.

[0094] It is understood that the business equipment mentioned in the embodiments of this application can also be a computer device, and the computer device in the embodiments of this application includes, but is not limited to, terminal devices or servers. In other words, the computer device can be a server or a terminal device, or a system composed of a server and a terminal device. The terminal device mentioned above can be an electronic device, including but not limited to mobile phones, tablets, desktop computers, laptops, handheld computers, in-vehicle devices, augmented reality / virtual reality (AR / VR) devices, head-mounted displays, smart TVs, wearable devices, smart speakers, digital cameras, webcams, and other mobile internet devices (MIDs) with network access capabilities, or terminal devices in scenarios such as trains, ships, and flights. Figure 1 As shown, the terminal device can be a laptop (as shown in business device 102n), a mobile phone (as shown in business device 102a), a desktop computer (as shown in business device 102b), or a tablet computer (as shown in business device 102c), etc. Figure 1 Only a portion of the equipment is listed. The servers mentioned above can be standalone physical servers, server clusters or distributed systems composed of multiple physical servers, or cloud servers providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, vehicle-to-everything (V2X) communication, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0095] Optionally, the data involved in the embodiments of this application may be stored in a computer device, or may be stored based on cloud storage technology or a blockchain network, without limitation.

[0096] To facilitate understanding, the following explanation will use business equipment 102a as an example.

[0097] For details, please see Figure 2 , Figure 2 This is a schematic diagram of a search data processing scenario provided in an embodiment of this application. The implementation process of this search data processing scenario can be as follows: Figure 1 The process can be performed in the business equipment 102a shown, or in, for example... Figure 1 This can be performed on any one of the service devices in the shown service device cluster (including service device 102a, service device 102b, service device 102c, ..., service device 102n). For example... Figure 2 As shown, user A is bound to service device 102a. Multiple applications (such as browsers, games, educational applications, shopping applications, reading applications, etc.) can be installed on service device 102a. Assuming user A wants to open one of the applications, such as target application A1, service device 102a can respond to a trigger operation (such as a click operation) targeting target application A1 and display the corresponding interface of target application A1 on its screen. Assuming target application A1 is a browser, service device 102a can display application page 200a of target application A1 on its screen. Figure 2As shown, application page 200a can be the application page that user A is currently browsing using a browser, including a search box 201a, a search icon 201b, and multimedia data. The multimedia data in application page 200a includes text data and image data, and the search icon 201b can be displayed in the search box 201a. Furthermore, when user A wants to search for multimedia data in application page 200a, they can long-press the search box 201a to raise its page hierarchy, making it movable. Then, by moving the search box 201a to the target location range 201c within application page 200a, the browser in service device 102a can respond to the movement operation of the search box 201a within application page 200a, moving it to the target location range 201c and selecting the multimedia data within that target location range 201c. It is important to note that the search icon 201b can move synchronously with the search box 201a, and its display position within the search box 201a can change. Further, referring to application page 200b, the target location range 202a can be the location range corresponding to the search box 202b. The browser displays the target multimedia data selected by the search box 202b and the search icon 202c within the search box 202b located within the target location range 202a. The search icon 202c indicates that the search box 202b has a search function for the enclosed target multimedia data, which is multimedia data contained within the target location range 202a. The search box 202b is derived from the search box 201a, and its display size is determined by the display size of the multimedia data selected by the search box 202b. The search icon 202c is derived from the change in position of the search icon 201b. The target location range 201c and the target location range 202a are the same target location range. After the selected target multimedia data is displayed in the search box 202b on application page 200b, user A can perform a trigger operation on the target multimedia data within the search box 202b. This trigger operation could be user A releasing the search box 202b. The browser responds to user A's trigger operation on the target multimedia data within the search box 202b and displays the search result 1 for the target multimedia data in the results interface 200c on the application page. The browser can also overlay a filter-enabled mask on the application page, displaying the results interface 200c within the mask. This mask can also blur the multimedia data on the application page.The results interface 200c on the application page includes a search box 203a, a search icon 203b, and a search result 1. The search box 203a is derived from the search box 202b, and the display size of the search box 203a is smaller than that of the search box 202b. The display size of the target multimedia data in the search box 203a changes synchronously with the change in the display size of the search box 203a. The search icon 203b is derived from the search icon 202c.

[0098] It should be noted that application page 200b also includes a search cancellation icon 202d and a search cancellation prompt, such as "Drag here to cancel" in application page 200b. Optionally, user A can move the search box 202b to the position range corresponding to the search cancellation icon 202d to cancel the search for the target multimedia data within the search box 202b. Simultaneously, the search box 202b responds to the search cancellation operation for the target multimedia data within the search box 202b, canceling the search for the multimedia data within the search box 202b and returning the search box 202b to its initial position range for display. At this time, the browser can display as shown in application page 200a.

[0099] Through the above process, the mobility and interactivity of the search box are fully utilized, allowing users to efficiently move the search box to the target location at any time, identify the target multimedia data from the multimedia data within the target location, perform a search interaction, obtain search results, and display the results, thus enriching the application's search methods. Simultaneously, the mobility and interactivity services of the search box are provided, thus removing the limitation on whether the multimedia data selected by the search box can be dragged. That is, in this embodiment, the search box can always be dragged to search for any content on the page, improving the search success rate. Through the interactive services of the search box (i.e., box selection operation and search function), the target multimedia data in the search box can be searched directly without the user manually entering the target multimedia data into the search box; simply dragging the search box to select the desired multimedia data is sufficient to perform the search, improving search efficiency. Furthermore, before performing a search interaction, the search box can be moved to the location corresponding to the search cancellation icon, canceling the search operation on the multimedia data on the application page at any time, making the application search process more flexible and variable. Providing mobility and interactivity services for the search box can improve search efficiency and the operability of application search, thereby further enhancing the user experience of the application.

[0100] Further, please see Figure 3 , Figure 3 This application provides a method flow for searching data processing. Figure 1 .like Figure 3The diagram illustrates a search data processing procedure, which includes the following steps:

[0101] Step S301: In response to a movement operation of the search box located in the initial position range on the application page, move the search box to the target position range on the application page; the initial position range is different from the target position range.

[0102] In this embodiment, the search data processing process is described using an application page in a browser as an example. The service device can respond to a user's click on the browser, open the browser, and display the browser's application page (e.g., ...). Figure 2 Application page 200a in the browser further responds to user actions on the application page regarding the search box (e.g., ...). Figure 2 The application device can process the search box 201a in the application page 200a (e.g., a long press) by triggering an operation (e.g., a long press) to make the search box movable (i.e., the search box is detached from the application page and can move in response to the user's movement). Furthermore, as the user moves the search box from its initial location range to its target location range, the application device can respond to the movement operation on the search box within the initial location range in the application page, moving the search box to the target location range within the application page. The initial location range of the search box differs from the target location range. The initial location range generally refers to the initial default position of the search box (e.g., the initial default position could be the top of the application page). The target location range refers to the location of the multimedia content the user wants to search for, i.e., the final location range where the user moves the search box within the application page.

[0103] Step S302: In the search box located within the target location range, display the target multimedia data selected by the search box; the target multimedia data belongs to the multimedia data included within the target location range.

[0104] In this embodiment, after the search box is moved to the target location range, the service device can respond to the interaction between the search box and the multimedia data within the target location range, displaying the target multimedia data selected by the search box in the search box. That is, when the search box is close to the multimedia data within the target location range, it can select the multimedia data and highlight the multimedia data included in the target location range. Figure 2As shown in application page 200b, the display brightness of multimedia data within the target location range corresponding to search box 202b is higher than the display brightness of other multimedia data within application page 200b. This means the application highlights the multimedia data within the target location range on the application page. Furthermore, the target multimedia data selected by the search box is displayed in the search box. The target multimedia data is all multimedia data within the target location range; that is, the target multimedia data can be all multimedia data within the target location range or a single multimedia data within the target location range. The specific content of the target multimedia data is determined by the application device in response to further user triggering operations.

[0105] It's important to note that when a business device responds to a movement of the search box within the initial location range on the browser's application page, it simultaneously retrieves all currently displayed data (i.e., all multimedia data on the application page) and sends this data to the browser's corresponding backend server (e.g., it could be like...). Figure 1(See the business server 101 shown). At this time, the backend server can divide all the data content currently displayed on the application page into blocks, obtain the current block content of the application page, and return the block content to the corresponding business device. After receiving the block content corresponding to all the data content currently displayed on the application page, the business device can only select multimedia data within the target location range when the search box is within the target location range on the application page. That is, the target multimedia data selected by the search box can be displayed in the search box within the target location range. For example, the current content displayed on the application page includes text paragraph 1, text paragraph 2, image 1, image 2, and text paragraph 3. After the application device receives the data from the backend server, which processes the current content into segments, the browser can further divide each segment into its own segments. Therefore, when a user performs a search for text paragraph 2, the application device responds to the search box movement operation on the application page, moving the search box to the location of text paragraph 2. Since text paragraph 2 is now isolated, it can be displayed in the search box. Optionally, when the user further performs a search for a portion of the multimedia data within text paragraph 2, the application device further obtains the data from the backend server, which processes all the multimedia data within text paragraph 2 into segments, to obtain the segmented content for text paragraph 2. For example, if the content of paragraph 2 at this point includes "statement 1, statement 2, statement 3", the browser can further divide statement 1, statement 2, and statement 3. Then, when the user performs a search operation targeting statement 2, the service device can respond to the search operation by moving the search box to the location of statement 2 and displaying the selected statement 2 separately in the search box. Simultaneously, when the user further performs a search operation targeting some multimedia data within statement 2, the service device further obtains the all multimedia data in statement 2 from the backend server and performs block processing to obtain the block content for statement 2. For example, if the content of statement 2 at this point is "character 1, character 2, character 3, character 4, character 5", the browser can further divide character 1, character 2, character 3, character 4, and character 5. Then, when the user performs a search operation targeting character 3, the service device can respond to the search operation by moving the search box to the location of character 3 and displaying the selected character 3 separately in the search box. The backend server can use an artificial intelligence model for image segmentation to segment the content displayed on the application page into blocks. This means treating the content displayed on the application page as an image, segmenting it, and assigning each pixel in the image to a specific object or entity, thereby creating a detailed image segmentation map and obtaining the final segmented content.

[0106] Step S303: In response to the trigger operation for the target multimedia data in the search box, display the search results for the target multimedia data on the application page.

[0107] In this embodiment, when a user performs a trigger operation on target multimedia data within the search box (e.g., releasing control of the search box), the service device responds to the trigger operation and displays search results for the target multimedia data on the application page. The service device can overlay a mask frame with filter functionality on the application page, displaying the results interface within the mask frame, and further displaying the search results for the target multimedia data within the results interface. The mask frame can also blur the multimedia data on the application page. Optionally, the service device can create and display a sub-window on the application page, displaying the results interface within the sub-window, and further displaying the search results for the target multimedia data within the results interface. The sub-window is an area independently displayed on the application page, and its display size is smaller than the display size of the application page.

[0108] The browser can further respond to user actions triggered by the search box on the application page (e.g., long-pressing and dragging the search box). These actions can include voice activation and gesture control. For example, a user can use a voice assistant control to input a specific wake-up word (e.g., "enter search box movement mode"). The device responds to this wake-up word, activating the search box and making it movable. The user can then drag the search box to the target location. Alternatively, the user can input a movement aid word (e.g., a description of multimedia data within the target location range). The device responds to this aid word, parses it, obtains the target location range indicated by the aid word, and moves the search box to that range. Optionally, the device can also set gesture control for the search box to enter the movable state (e.g., double-tapping the search box) to activate it and move it to the target location range. Users can modify the gesture control according to their own operating preferences, such as changing double-clicking the search box to triple-clicking the search box.

[0109] Through the above process, the mobility and interactivity of the search box are fully utilized, allowing users to easily move the search box to the target location at any time, select the target multimedia data from the multimedia data within the target location, perform a search interaction, obtain search results, and display the results, thus enriching the application's search methods. Simultaneously, the mobility and interactivity services of the search box are provided, thus no longer limiting the selection of multimedia data by whether it can be dragged. That is, in this embodiment, the search box can always be dragged to search for any content on the page, improving the search success rate. Through the interactive services of the search box (i.e., box selection operation and search function), the target multimedia data in the search box can be searched directly without the user manually entering the target multimedia data into the search box. The search can be completed simply by dragging the search box to select the desired multimedia data, improving search efficiency and the operability of the application search, thereby further enhancing the user experience of the application.

[0110] Further, please see Figure 4 , Figure 4 This application provides a method flow for searching data processing. Figure 2 .like Figure 4 The diagram illustrates a search data processing procedure, which includes the following steps:

[0111] Step S401: In response to a movement operation of the search box located in the initial position range on the application page, move the search box to the target position range on the application page; the initial position range is different from the target position range.

[0112] In this embodiment of the application, the specific implementation process of step S401 can be found in [reference needed]. Figure 3 The specific implementation process of step S301 will not be described here.

[0113] Step S402: In the search box located within the target location range, display the target multimedia data selected by the search box; the target multimedia data belongs to the multimedia data included within the target location range.

[0114] In this embodiment, after the search box is moved to the target location range, the service device can respond to the interaction between the search box and the multimedia data within the target location range, displaying the target multimedia data selected by the search box in the search box. That is, when the search box approaches multimedia data within the target location range, the multimedia data can be selected, and the multimedia data included in the target location range will be highlighted. Further, the service device displays the target multimedia data selected by the search box in the search box. The target multimedia data belongs to the multimedia data included within the target location range; that is, the target multimedia data can be all multimedia data within the target location range, or it can be a single multimedia data within the target location range. The specific content of the target multimedia data is determined by the service device in response to further triggering operations by the user.

[0115] Specifically, the service device can respond to interactive operations between the search box and multimedia data within the target location range (which could be multimedia data within the target location range that the search box is close to). It can highlight the multimedia data contained within the target location range and identify the highlighted multimedia data as the target multimedia data. That is, when a user searches for all multimedia data within the target location range, after moving the search box to the target location range, they can directly release control of the search box. At this time, the service device displays a search box surrounding the target multimedia data within the target location range, and displays a search icon within the search box; the search icon indicates that the search box has the function of searching for the surrounded target multimedia data. For example, see [link to relevant documentation]. Figure 2 In application page 200b, the target multimedia data is all multimedia data within a target location range. The service device highlights the multimedia data within the target location range, meaning the display brightness of all multimedia data within the target location range is higher than the display brightness of the other multimedia data in application page 200b. Further, the service device displays a search box 202b surrounding the target multimedia data in application page 200b, and a search icon 202c is displayed in the search box 202b. Optionally, the service device can highlight the multimedia data within the target location range by desaturating the other multimedia data in the application page, for example, by reducing the display brightness of the other multimedia data based on the original display brightness; or by reducing the display brightness of the other multimedia data while increasing the display brightness of the multimedia data within the target location range.

[0116] Optionally, the process by which the service device displays the target multimedia data selected by the search box within the search box located within the target location range can also be as follows: the service device highlights the multimedia data contained within the target location range, displays a search box within the target location range to surround the highlighted multimedia data, and displays a search icon within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted multimedia data; furthermore, within the target location range, the user continues to perform a partial selection operation on the search box (this partial selection operation can refer to an operation of continuing to move within the target location range), and the service device responds to the partial selection operation on the search box within the target location range by hiding the search icon and moving the search box to the target search position. That is, after the user moves the search box to the target location range, they do not cancel the movement operation on the search box (e.g., do not release the search box), continue to perform a partial selection operation within the target location range, select the target search position, and move the search box to the target search position within the target location range; the target search position is a local area within the target location range; a search box for selecting the target multimedia data is displayed within the target search position; the target multimedia data belongs to the multimedia data contained within the target search position. In other words, the target multimedia data is one or more multimedia data corresponding to the target search location within the target location range. For example, if the highlighted multimedia data is text paragraph 2, and text paragraph 2 includes statement 1, statement 2, and statement 3, then the target search location can be the location range corresponding to statement 2, and the target multimedia data can be the text content corresponding to statement 2.

[0117] For details, please refer to Figure 5 , Figure 5 This is a schematic diagram of a text data search provided in an embodiment of this application, such as... Figure 5 As shown, it includes application page 200b, application page 500a, result interface 500b, application page 500c, result interface 500d, and application page 500e. Figure 5 Application page 200b is Figure 2Application page 200b. The service device highlights the multimedia data contained within the target location range 202a, displays a search box 202b to surround the highlighted multimedia data within the target location range 202a, and displays a search icon 202c within the search box 202b. Further, the user can move the search box 202b within the target location range 202a to the target search position 501b, as shown in application page 500a. That is, the service device can respond to a partial selection operation of the search box 202b within the target location range 202a, hide the search icon 202c, and move the search box 202b to the target search position 501b, resulting in the search box 501a as shown in application page 500a; the target search position 501b is a local area within the target location range 202a. For example, at this time, at the target search position 501b within the target position range 202a in the application page 500a, a display search box 501a is displayed to select the target multimedia data, and the multimedia data displayed in the search box 501a is the target multimedia data.

[0118] Optionally, if the user moves the search box 501a to the target search position 501b and does not cancel the movement operation of the search box 501a (e.g., does not release the search box 501a), and continues to search for a certain multimedia data in the target search position 501b, the service device continues to respond to the partial selection operation of the search box 501a within the target search position 501b (this partial selection operation can refer to the operation of continuing to move within the target search position), moving the search box 501a to the character search position, such as the character search position 503b shown in application page 500c; the character search position 503b is a local area within the target search position 501b; the search box 503a for selecting the target multimedia data is displayed within the character search position 503b; the target multimedia data is the character within the character search position 503b. For details, please refer to... Figure 5 On application page 500c, after the service device moves the search box 503a to the character search position 503b, the search box 503a for selecting target multimedia data is displayed in the character search position 503b. At this time, the target multimedia data in the search box 503a is of character type. The search box 503a is derived from the search box 501a.

[0119] Optionally, if the multimedia data contained within the target location range is image data, the specific process by which the service device displays the target multimedia data selected by the search box within the search box located within the target location range can be as follows: The image data contained within the target location range is highlighted; a search box is displayed within the target location range to surround the highlighted image data; a search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted image data. In response to a local selection operation of the search box within the target location range, the image data within the target location range is magnified, and the search box is moved to the element search position within the magnified image data; the element search position is a local area within the image data within the target location range. A search box for selecting the target multimedia data is displayed at the element search position, and the search icon is simultaneously moved to the search box for display; the target multimedia data is a key element located at the element search position in the image data.

[0120] For details, please refer to Figure 6 , Figure 6 This is a schematic diagram of an image data search provided in an embodiment of this application, such as... Figure 6As shown, the interface includes application page 600a, application page 600b, results interface 600c, and results interface 600d. As shown in application page 600a, it includes a search box 601a, a search icon 601b, and a target location range 601c. In response to the user's movement operation on the search box 601a, the service device moves the search box 601a to the target location range 601c. Then, it adjusts the display brightness of the image data within the target location range 601c to be higher than the display brightness of the other multimedia data in application page 600a, highlighting the image data. A search box 601a is displayed within the target location range 601c to surround the highlighted image data, and the search icon 601b is displayed within the search box 601a. Furthermore, in response to the user's partial selection operation of the search box 601a within the target location range 601c, the service device magnifies the image data within the target location range 601c, as shown in the image data within the target location range 601c in application page 600b. The search box 601a is then moved to the element search position 602c within the magnified image data, resulting in a search box 602a within the element search position 602c in application page 600b. The search box 602a is used to display the selected target multimedia data. Furthermore, the service device synchronously moves the search icon 601b to the search box 602a, resulting in the search icon 602b in application page 600b. That is, after the user selects image data and searches for a specific element within the image data, the service device can respond to the user's operation by moving the search box 602a to the element search position 602c indicated by the operation. The element search position 602c is a local area within the image data within the target location range 601c. Furthermore, the service device can identify elements or objects in the image data. Therefore, when the service device moves the search box 602a to the element search position 602c, the search box 602a will automatically select the key elements identified within the element search position 602c and identify these key elements as the target multimedia data. This further improves search efficiency by automatically selecting the target multimedia data. Simultaneously, the service device magnifies the image data within the target location range, allowing users to quickly locate the element search position, reducing the time required for users to move the search box to the element search position, thus also improving search efficiency.

[0121] Optionally, if the multimedia data contained within the target location range is video data, the specific process by which the service device displays the target multimedia data selected by the search box within the search box located within the target location range can be as follows: the service device highlights the video data contained within the target location range and identifies the highlighted video data as the target multimedia data; a search box is displayed within the target location range to surround the target multimedia data, and a video indicator icon is displayed within the search box; the video indicator icon is obtained by converting the search icon used to follow the search box, and the video indicator icon is used to indicate that the target multimedia data surrounded by the search box is video data, and to characterize that the search box has a search function for the surrounded video data.

[0122] For details, please refer to Figure 7 , Figure 7 This is a schematic diagram of a video data search provided in an embodiment of this application, such as... Figure 7 As shown, the system includes application page 700a, application page 700b, results interface 700c, results interface 700d, results interface 700e, and results interface 700f. As shown in application page 700a, it includes a search box 701a, a search icon 701b, and a target location range 701c. Responding to the user's movement operation on the search box 701a, the service device moves the search box 701a to the target location range 701c indicated by the movement operation. The service device then highlights the video data contained within the target location range 701c, identifies the highlighted video data as the target multimedia data, and displays a search box within the target location range 701c to surround the target multimedia data, as shown in search box 702a in application page 700b. Furthermore, the service device displays a video indicator icon 702b within search box 702a. The video indicator icon 702b is derived from the search icon 701b, which moves synchronously with the search box 701a. The video indicator icon 702b indicates that the target multimedia data enclosed within the search box 702a is video data, thus reminding the user that the target multimedia data selected by the search box 702a is a video. Furthermore, the video indicator icon 702b signifies that the search box 702a has a search function for the enclosed video data. Optionally, in response to further user triggering operations on the video data, the service device can search for local objects in the image data corresponding to the currently playing video frame. Specifically, the service device moves the search box 702a to select a local object 702c and further searches for that local object.

[0123] Step S403: Respond to the trigger operation for the target multimedia data in the search box, obtain the content status information of the target multimedia data, parse the target multimedia data based on the content status information, and obtain the search results for the target multimedia data.

[0124] In this embodiment, the service device responds to a trigger operation targeting the multimedia data within the search box, obtains the content status information of the target multimedia data, and if the content status information indicates that the target multimedia data is text data, then the text data corresponding to the target multimedia data is parsed to obtain the text parsing result; if the text parsing result indicates that the text data belongs to the industry terminology type, then the text data is interpreted to obtain the terminology interpretation result, and the terminology interpretation result is determined as the search result for the target multimedia data; if the text parsing result indicates that the text data belongs to the question type, then the question is searched to obtain the question answer result, and the question answer result is determined as the search result for the target multimedia data.

[0125] Specifically, if the content status information indicates that the target multimedia data is text data, the service device performs text parsing on the corresponding text data to obtain the text parsing result. The search result for the target multimedia data is then determined by the text parsing result corresponding to the text data in the search box. If the text parsing result indicates that the text data belongs to an industry term, i.e., the text data is an industry term, the service device performs terminology interpretation on the text data to obtain the terminology interpretation result, which is then used as the search result for the target multimedia data. For example, when the text data corresponding to the target multimedia data is "Deep learning is a branch of machine learning, mainly based on artificial neural networks, especially deep networks with multiple hidden layers," the text parsing result indicates that the text data belongs to an industry term. The service device can extract keywords from the text data based on AI algorithms, such as "deep learning," and further search for content matching the keyword in the database (such as a knowledge graph) corresponding to the AI ​​algorithm. The search results are then filtered to obtain content highly related to the text data, which is then used as the terminology interpretation result for the text data. For example, the business device parses professional terms (deep learning, artificial neural networks, and hidden layers, etc.) within the industry terminology to obtain terminology explanations. These explanations are then used as search results for the target multimedia data. If the text parsing result indicates that the text data belongs to a question type (i.e., the text data is a question), the business device can use AI algorithms to identify the intent or semantics of the question. It then searches a database (such as a knowledge graph) for content that matches the intent or semantics of the question, identifying these as answers. These answers are then used as search results for the target multimedia data. For instance, when the text data corresponding to the target multimedia data is "What is the development history of artificial intelligence?", the text parsing result indicates that the text data belongs to a question type. The business device performs a question search on the text data "What is the development history of artificial intelligence?" to obtain answers to the question "What is the development history of artificial intelligence?", and these answers are used as search results for the target multimedia data. See also... Figure 5 ,like Figure 5In the application page 500a shown, if the text parsing result corresponding to the target multimedia data indicates that the target multimedia data is an industry terminology type, then search result 2 in the results interface 500b will be the terminology explanation result for the target multimedia data, and the business device will display a result prompt message 1 next to the search icon 502b in the results interface 500b, which can be "Interpretation". If the text parsing result corresponding to the target multimedia data indicates that the target multimedia data is a question type, then search result 2 in the results interface 500b will be the question answer result for the target multimedia data, and the result prompt message 1 for the target multimedia data can be "Question Analysis". Figure 5 The target multimedia data displayed in the search box 503a in the application page 500c is the character in the character search position 503b. If the text parsing result corresponding to the target multimedia data indicates that the target multimedia data is an industry term, then the search result 3 in the result interface 500d is the term explanation result for the character, and the business device displays the result prompt information 2 next to the search icon 504b in the result interface 500d. At this time, the result prompt information 2 can be represented as "word explanation".

[0126] Optionally, if the content status information of the target multimedia data obtained by the service device indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is a key element in the image data, then the key element is searched to obtain the search results for the target multimedia data.

[0127] For details, please refer to Figure 6 In the application page 600b, the search box 602a indicates that the target multimedia data is image data, and the target multimedia data selected by the search box 602a is a key element in the image data. The service device then searches for the key element selected by the search box 602a (i.e., the person's head in the image data) and obtains the search results for that person's head. At this time, the search result 4 in the results interface 600c can be the search result for that person's head, and the result prompt information 3 displayed along with the search icon 603b can be represented as "person".

[0128] If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is complete image data, then at least two key elements from the image data are obtained. These two key elements are then fused and analyzed to obtain a fusion analysis result. This fusion analysis result is then used to search for the target multimedia data. Specifically, after obtaining at least two key elements (e.g., three key elements), the service device can extract the element features of each of the three key elements, concatenate the three element features to obtain an element feature sequence, and then analyze this element feature sequence to obtain a fusion analysis result. For example, in an image data set, the three key elements could be "person, basketball, and basketball hoop." The service device could analyze the element feature sequence obtained based on these three key elements to obtain a fusion analysis result such as "a person is playing basketball."

[0129] Specifically, if the content status information obtained by the service device indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is complete image data, that is, if the search box 601a in application page 600a selects the entire image data but does not further select a specific element within the image data, and directly searches the entire image data, then the search result 5 in the results interface 600d can be the search result for the entire image data. Simultaneously, the result prompt information 4 displayed following the search icon 604b can be the same as the result prompt information 3 in the results interface 600c, representing "People".

[0130] Optionally, if the content status information of the target multimedia data obtained by the service device indicates that the target multimedia data is video data, then the currently playing video frame in the video data is obtained, and the video elements in the currently playing video frame are searched to obtain the video element results (which may be...). Figure 7 The video element result 1 in the results interface 700c. For example, video element result 1 could be the object name (person's name) and object description (person's deeds) obtained by the business device after identifying and parsing the object in the video data. Further, the business device obtains the audio data corresponding to the video data within the audio search time period, parses the audio data, and obtains the audio parsing result (which could be...). Figure 7The audio parsing result 1 in the results interface 700c is used. For example, audio parsing result 1 can be the text data obtained after converting the audio data to text (i.e., speech-to-text). The video element results and audio parsing results are determined as the search results for the target multimedia data. Here, the currently playing video frame refers to the video frame that the video data is playing when responding to the movement operation of the search box. The audio search time period refers to a search time period for audio determined from the video data based on the video frame. For example, if the audio search time period is "the first 10 seconds (s)", it means the audio data corresponding to the video data within the first 10 seconds of the video frame, the video frame corresponding to the first 10 seconds of the video frame, and the audio data corresponding to the entire video frame between the video frame.

[0131] Step S404: Display the results interface on the application page, display the target multimedia data and the search results for the target multimedia data on the results interface.

[0132] In this embodiment, the service device displays a results interface on an application page, showing the target multimedia data and search results for the target multimedia data. Specifically, the service device can overlay a mask frame with filter functionality on the application page, displaying the results interface within the mask frame. This mask frame can also be used to blur the multimedia data on the application page. Alternatively, the service device can display a sub-window on the application page, displaying the results interface within the sub-window; the sub-window is an area independently displayed on the application page, and its display size is smaller than the display size of the application page.

[0133] For details, please refer to Figure 5 When the target multimedia data is text data, the target multimedia data displayed by the service device in the results interface can be as shown in the target multimedia data 502a in the results interface of results interface 500b and the target multimedia data 504a in the results interface of results interface 500d; the search results for the target multimedia data displayed by the service application in the results interface can be as shown in the search result 2 in the results interface of results interface 500b and the search result 3 in the results interface of results interface 500d.

[0134] Optional, see below Figure 6When the target multimedia data is image data, the target multimedia data displayed by the service device in the result interface can be as shown in the target multimedia data 603a in the result interface of result interface 600c and the target multimedia data 604a in the result interface of result interface 600d; the search results for the target multimedia data displayed by the service application in the result interface can be as shown in the search result 4 in the result interface of result interface 600c and the search result 5 in the result interface of result interface 600d.

[0135] Optionally, if the target multimedia data is video data, the search results for the video data include video element results and audio parsing results. The specific implementation process of the business device displaying the target multimedia data and the search results for the target multimedia data in the results interface can be as follows: highlighting the video data, displaying the highlighted video data, video element results, and audio parsing results for the video data in the results interface; the video element results are obtained by searching for the currently playing video elements in the video data, and the audio parsing results are obtained by parsing the audio data corresponding to the video data within the audio search time period.

[0136] For details, please refer to Figure 7 The service equipment highlights the video data and displays the highlighted video data in the results interface, thus obtaining... Figure 7 The video data 703a is displayed in the results interface 700c. The service device displays the video element results and audio parsing results in the results interface 700c, resulting in video element result 1 and audio parsing result 1. Video element result 1 is obtained by searching for the currently playing video element in the video data (i.e., the video element in the currently displayed video frame of video data 703a). Audio parsing result 1 is obtained by parsing the audio data corresponding to the video data within the audio search time period. The video data within the audio time period is determined by the currently displayed video frame and audio time period of video data 703a. The results interface 700c also includes a search icon 703b, and a result prompt message 4 for video element result 1 displayed following the search icon 703b. Result prompt message 4 can be represented as "person". The results interface 700c also includes a video indicator icon 703c, and a prompt message "Video Interpretation" displayed following the video indicator icon 703c for audio parsing result 1.

[0137] Furthermore, the result interface 700c also includes an audio parsing control 703d. The service device responds to the user's trigger operation (which could be a click operation) on the audio parsing control 703d, displaying an audio progress control in the result interface, resulting in an audio progress control 704c and an audio parsing control 704b in the result interface 700d. The audio parsing control 704b is obtained by converting the audio parsing control 703d. The audio progress control 704c includes a sub-graph (sub-image) corresponding to the video frame in the video data. Figure 1 ,son Figure 2 Sub-images (n, ..., n) are defined, with the sub-image size smaller than the video frame size. The audio progress control 704c includes a sliding icon 704d and a search time sub-control 704e (displayed as the first 10 seconds). At this time, the sliding icon 704d is located within the display range of the sub-image corresponding to the currently displayed video frame of video data 704a (i.e., video data 703a in the result interface 700c). If the service device responds to a sliding operation of the sliding icon 704d within the audio progress control 704c, it slides the sliding icon 704d to the updated video frame position of the audio progress control 704c, resulting in the sliding icon 705c in the result interface 700e, and the sub-control corresponding to the updated video frame. Figure 2 Get the sub-frame position at the updated video frame position. Figure 2 The corresponding updated video frame will switch the currently playing video frame in video data 705a to the updated video frame (i.e., the sub-frame). Figure 2 (The corresponding image); At this time, the business device can perform a search based on video data 705a, update the result prompt information 4 displayed following the search icon 703b and video element result 1, and obtain the search icon 705b and the result prompt information 5 displayed following the search icon 705b and video element result 2. If the business device responds to the adjustment operation of the search time sub-control 705d in the result interface 700e, and obtains the search time sub-control 706a in the result interface 700f (which is now displayed as the first 20 seconds), the business device updates the duration of the audio search time period, and obtains the updated audio search time period. The business device can perform audio parsing on the audio data corresponding to the video frames updated to the first 20 seconds in the video data, and obtain the updated audio parsing result; wherein, the updated audio parsing result is obtained by parsing the audio data corresponding to the video data within the updated audio search time period, that is, by parsing the audio data corresponding to the video frames updated to the first 20 seconds in the video data. The business device deletes audio parsing result 2 and displays the updated audio parsing result in the result interface 700f.

[0138] Step S405: Respond to the trigger operation on the results interface for the follow-up question icon, obtain the follow-up question data, respond to the trigger operation on the follow-up question data, and display the follow-up question data and the follow-up question search results on the results interface.

[0139] In this embodiment of the application, the results interface also includes a follow-up question icon. The service device can respond to the trigger operation on the follow-up question icon in the results interface, obtain follow-up question data, respond to the trigger operation on the follow-up question data, delete the search results for the target multimedia data in the results interface, and display the follow-up question search results for the follow-up question data.

[0140] Specifically, the business device can parse the follow-up data to obtain initial parsing results, fuse the initial parsing results with the target multimedia data to obtain fused data, and search the fused data to obtain follow-up search results for the follow-up data; that is, the follow-up search results are jointly determined by the follow-up data and the target multimedia data obtained by the business device. For example, the business device separately obtains the features of the follow-up data and the target multimedia data, concatenates these two features to obtain a follow-up feature sequence, further identifies the follow-up feature sequence to obtain the corresponding fused data, and searches the fused data to obtain follow-up search results for the follow-up data. Furthermore, the business device displays the follow-up data in the results interface, deletes the search results for the target multimedia data, and also deletes the follow-up search results for the follow-up data. For example, see [link to example]. Figure 8 , Figure 8 This is a schematic diagram of a follow-up search provided in an embodiment of this application, such as... Figure 8 The results interface includes three interfaces: 800a, 800b, and 800c. Result interface 800a includes multimedia data 801a, a search icon 801b, result prompt information 6 displayed following the search icon 801b, search results 6, and a follow-up question icon 801c, along with follow-up question prompt information displayed following the follow-up question icon (e.g., "I want to ask" in the results interface). The service device responds to a trigger operation on the follow-up question icon 801c in result interface 800a, retrieves follow-up question data, responds to a trigger operation on the follow-up question data, and displays the follow-up question data and the follow-up search results in the results interface. See also the follow-up question data and follow-up search results displayed in the follow-up question data display box 803b in result interface 800c, which is displayed following the follow-up question icon 803a.

[0141] Alternatively, in the results interface, the business device moves the search results for the target multimedia data from the first display position to the second display position, and displays the follow-up search results for the follow-up data in the first display position; both the first and second display positions are located in the results interface, with the first display position having a higher display priority than the second display position. For example, referring to results interface 800b, the follow-up data can be seen in the follow-up data box 802b displayed following the follow-up icon 802a; the first display position of the follow-up search results can be seen in the follow-up search results in results interface 800b; and the second display position corresponding to the search results can be seen in search result 6 in results interface 800b.

[0142] Step S406: Respond to the trigger operation of deleting the icon in the results interface, exit the results display interface, and restore the application page display.

[0143] In this embodiment, the results interface also includes a delete icon. The service device can respond to a trigger operation that deletes the icon in the results interface, exit the results display interface, and restore the application page. For details, please refer to... Figure 5 ,like Figure 5 As shown in the result interface 500d, the result interface 500d also includes a delete icon 504c. The service device can respond to the trigger operation (which can be a click operation, i.e., the user clicks the delete icon 504c) of the result interface 500d, exit the display result interface 500d, and restore the display application page 500e.

[0144] Through the above process, the mobility and interactivity of the search box are fully utilized, allowing users to efficiently move the search box to the target location at any time, select and define the target multimedia data from the multimedia data within the target location range, perform the search interaction, obtain search results, and display the results, thus enriching the application's search methods. Simultaneously, the mobility and interactivity services of the search box are provided, thus no longer limiting the selection of multimedia data to whether it can be dragged. That is, in this embodiment, the search box can always be dragged to search for any content on the page, improving the search success rate. Through the interactive services of the search box (i.e., box selection operation and search function), the target multimedia data in the search box can be searched directly without the user manually entering the target multimedia data into the search box; simply dragging the search box to select the desired multimedia data is sufficient to perform the search, improving search efficiency. Furthermore, when a user wants to cancel the search, they can move the search box to the location corresponding to the search cancellation icon before performing the search interaction, canceling the search operation on the multimedia data on the application page at any time, making the application search process more flexible and variable. By providing movable and interactive search box services, search efficiency and operability can be improved, thereby further enhancing the user experience. Furthermore, by acquiring content status information of the target multimedia data, different result display methods can be determined for different types of multimedia data, enriching the search scope and enabling comprehensive searching of various multimedia data such as text, images, and videos. Further, based on the follow-up question icon in the results interface, follow-up question data can be obtained. By combining the follow-up question data with the currently searched target multimedia data, the desired search results can be accurately obtained. After the user finishes reading the search results, clicking the delete icon deletes the results interface and restores the application page, enabling simultaneous reading and searching and maintaining an uninterrupted reading experience for the user.

[0145] Please see Figure 9 , Figure 9 This is a schematic diagram illustrating a search processing procedure provided in an embodiment of this application, used to explain the technical implementation of the implementation process in various embodiments of this application. For example... Figure 9As shown, the process includes two parts: user operation and technical implementation. When the user long-presses the search box, the search box will respond by floating (i.e., the search box enters a movable state). At this time, the front-end of the corresponding application in the business device (taking a browser as an example here) performs page hierarchy enhancement processing on the search box, making the search box movable. When the user moves the search box to the target location range, the business device obtains the content displayed on the application page (i.e., the browser page) in real time, and performs block processing on the application page through the artificial intelligence model in the algorithm component. See the specific description of the block processing in step S302 of the above embodiment. It's important to note that this algorithm component can reside within the business server corresponding to the browser on the business device. This means the business device can obtain the browser page display content in real time and send it to the business server. The business server then processes the content into chunks based on the algorithm component. Further, the browser frontend, based on these chunks and the target location range, performs different highlighting and desaturation processing on the multimedia data in the application page. Specifically, after moving the search box to the target location range, the multimedia data within that range (target multimedia data) is highlighted (highlighted), while multimedia data outside the target range is desaturated (not highlighted). This can be understood as the target multimedia data having a higher display brightness than the other multimedia data. When processing the multimedia data in the application page, the algorithm component needs to identify the content status information (category information) of the multimedia data corresponding to different chunks in real time. For example, content status information includes text data, image data, and video data. Text data can be further subdivided into paragraphs, sentences, and characters. The algorithm component can obtain the tags of different segments within the application page, and parse these tags to retrieve the category information of each segment. For example, HTML (HyperText Markup Language) tags can be used to define the category information of different multimedia data within the application page. <h1> arrive< / h1> <h6>Tags are used to define titles. Tags are used to define paragraphs. Tags are used to create links. Tags are used to insert images, etc. The algorithm component directly obtains and parses the HTML tags of the multimedia data corresponding to different blocks in the application page, and identifies the category information of different blocks in the application page.

[0146] The AI ​​model for block processing within the algorithm component can be a general, prompt-based segmentation model developed based on Segment Anything. Segment Anything is a novel AI model applicable to image segmentation. For example, the Segment Anything Model (SAM) can "cut" any object in any image with a single click. It's a prompt-based segmentation system capable of zero-shot generalization across different objects and images without additional training. Based on input prompts such as points or bounding boxes, it can generate high-quality object masks to create masks for all objects in the image. Specifically, it uses interactive points and bounding boxes for image segmentation, automatically segmenting all content in the image and generating multiple valid masks for the prompts.

[0147] Furthermore, when the algorithm component identifies a segment of multimedia data as text data, it can use an artificial intelligence model to intelligently recognize the text data, dividing it into sentences and characters. This allows the browser frontend to highlight the selected sentences or characters when they are selected via the search box, and also displays the selected sentences or characters in the search box. Similarly, when the algorithm component identifies a segment of multimedia data as image data, it can use an artificial intelligence model to intelligently recognize the image data, dividing it into elements. This allows the frontend to highlight different elements when different elements are selected via the search box, and display the selected element in the search box. When the algorithm component identifies a segment of multimedia data as video data, it can use an artificial intelligence model to intelligently recognize the video data, extracting the video frame content and audio content. It can also use an artificial intelligence model to intelligently recognize the video frame content, dividing it into video elements. Furthermore, when the frontend detects that the recognized video data has been selected via the search box, it can notify the application page to display a video indicator icon. The video indicator icon is used to inform the user that the target multimedia data enclosed in the search box is video data, and to indicate that the search box has a search function for the enclosed video data.

[0148] Furthermore, when a user releases their grip on the search box to enter search mode, the algorithm component summarizes the search results based on artificial intelligence algorithms and returns them to the browser frontend, where they are displayed. When the user adds a question related to the search results, the browser frontend displays the follow-up question data and forwards it to the algorithm component. The algorithm component then further analyzes the follow-up question data using artificial intelligence algorithms, summarizes the follow-up question search results, and displays them on the browser frontend.

[0149] Further, please see Figure 10 , Figure 10 This is a schematic diagram of a search data processing apparatus provided in an embodiment of this application. The search data processing apparatus 1000 can be a computer program (including program code, etc.) running on a computer device; for example, the search data processing apparatus 1000 can be an application software. The search data processing apparatus 1000 can be used to execute corresponding steps in the method provided in the embodiments of this application. Figure 10 As shown, the search data processing device 1000 can be used for Figure 3 and Figure 4 Specifically, the computer device in the corresponding embodiment may include: a search box moving module 11, a data display module 12, a status acquisition module 13, and a result display module 14.

[0150] The search box moving module 11 is used to respond to a movement operation on the search box located in the initial position range in the application page, and move the search box to the target position range in the application page; the initial position range and the target position range are different.

[0151] The data display module 12 is used to display the target multimedia data selected by the search box in the search box located within the target location range; the target multimedia data belongs to the multimedia data included within the target location range.

[0152] The results display module 14 responds to a trigger operation on the target multimedia data within the search box and displays the search results for the target multimedia data on the application page.

[0153] In one possible implementation, when the data display module 12 displays the target multimedia data selected by the search box within the target location range, the data display module 12 is specifically used to perform the following operations:

[0154] Highlight the multimedia data contained within the target location range, and identify the highlighted multimedia data as the target multimedia data;

[0155] A search box is displayed within the target location area to enclose the target multimedia data, and a search icon is displayed within the search box; the search icon indicates that the search box has the function of searching for the enclosed target multimedia data.

[0156] In one possible implementation, when the data display module 12 displays the target multimedia data selected by the search box within the target location range, the data display module 12 is specifically used to perform the following operations:

[0157] The multimedia data contained within the target location area is highlighted, and a search box is displayed within the target location area to surround the highlighted multimedia data. A search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted multimedia data.

[0158] In response to a partial selection operation of the search box within a target location range, the search icon is hidden, and the search box is moved to the target search location; the target search location is a local area within the target location range.

[0159] Displays a search box within the target search location to select the target multimedia data; the target multimedia data is the multimedia data contained within the target search location.

[0160] In one possible implementation, when the data display module 12 displays a search box for selecting target multimedia data within the target search location, the data display module 12 is specifically used to perform the following operations:

[0161] In response to a partial selection operation of the search box within the target search location, move the search box to the character search location; the character search location is a local area within the target search location.

[0162] Displays a search box within the character search position to select the target multimedia data; the target multimedia data is the character within the character search position.

[0163] In one possible implementation, the multimedia data contained within the target location range is image data; when the data display module 12 displays the target multimedia data selected by the search box within the target location range, the data display module 12 is specifically used to perform the following operations:

[0164] The image data contained within the target location range is highlighted, and a search box is displayed within the target location range to surround the highlighted image data. A search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted image data.

[0165] In response to a local selection operation of the search box within the target location range, the image data within the target location range is magnified and the search box is moved to the element search position in the magnified image data; the element search position is a local area in the image data within the target location range.

[0166] A search box is displayed at the element search location to select the target multimedia data, and the search icon is moved synchronously to the search box for display; the target multimedia data is the key element located at the element search location in the image data.

[0167] In one possible implementation, the multimedia data contained within the target location range is video data; when the data display module 12 displays the target multimedia data selected by the search box within the target location range, the data display module 12 is specifically used to perform the following operations:

[0168] Highlight the video data contained within the target location area, and identify the highlighted video data as the target multimedia data;

[0169] A search box is displayed within the target location range to surround the target multimedia data. A video indicator icon is displayed within the search box. The video indicator icon is transformed from the search icon that follows the search box. The video indicator icon is used to indicate that the target multimedia data surrounded by the search box is video data, and it is used to indicate that the search box has a search function for the surrounded video data.

[0170] In one possible implementation, the results display module 14 is used to respond to a trigger operation on the target multimedia data within the search box. When displaying the search results for the target multimedia data on the application page, the results display module 14 is specifically used to perform the following operations:

[0171] Respond to a trigger operation targeting the target multimedia data within the search box and retrieve search results for the target multimedia data;

[0172] The application page displays the results interface, which shows the target multimedia data and the search results for the target multimedia data.

[0173] In one possible implementation, the target multimedia data is video data, and the search results include video element results and audio parsing results; the result display module 14 is used to display the target multimedia data in the result interface, and when displaying search results for the target multimedia data, the result display module 14 is specifically used to perform the following operations:

[0174] The video data is highlighted, and the results interface displays the highlighted video data, as well as the video element results and audio parsing results for the video data. The video element results are obtained by searching for the currently playing video element in the video data, and the audio parsing results are obtained by parsing the audio data corresponding to the video data within the audio search time period.

[0175] In one possible implementation, the results interface further includes an audio progress control, which includes a sub-image corresponding to a video frame in the video data. The image size of the sub-image is smaller than the image size of the video frame. The audio progress control includes a slider icon and a search time sub-control. The results display module 14 is also used to perform the following operations:

[0176] If the response is to a sliding operation of the slider icon in the audio progress control, the slider icon is slid to the updated video frame position of the audio progress control, the updated video frame corresponding to the sub-image at the updated video frame position is obtained, and the currently playing video frame in the video data is switched to be displayed as the updated video frame.

[0177] If an adjustment operation is performed on the search time sub-control, the duration of the audio search time period is updated to obtain the updated audio search time period, and the updated audio parsing result is obtained; the updated audio parsing result is obtained by parsing the audio data corresponding to the video data within the updated audio search time period;

[0178] Delete the audio parsing result in the results interface and display the updated audio parsing result.

[0179] In one possible implementation, the results interface also includes a follow-up question icon; the results display module 14 is also used to perform the following operations:

[0180] The response to the follow-up question icon in the results screen retrieves the follow-up question data.

[0181] In response to the triggered action on the follow-up data, the follow-up data and the search results for the follow-up data will be displayed in the results interface.

[0182] In one possible implementation, the results display module 14 is used to display follow-up data in the results interface, and when displaying follow-up search results for the follow-up data, the results display module 14 is specifically used to perform the following operations:

[0183] In the results interface, delete the search results for the target multimedia data and display the search results for the follow-up questions.

[0184] Alternatively, in the results interface, the search results for the target multimedia data can be moved from the first display position to the second display position, and the follow-up search results for the follow-up data can be displayed in the first display position; both the first and second display positions are located in the results interface, and the display priority of the first display position is higher than that of the second display position.

[0185] In one possible implementation, when the result display module 14 is used to display the result interface in the application page, the result display module 14 is specifically used to perform the following operations:

[0186] Overlay a mask frame with filter functionality on the application page, and display the results interface within the mask frame;

[0187] Alternatively, a sub-window can be displayed within the application page, and the results interface can be displayed within the sub-window; the sub-window is an area displayed independently on the application page, and the display size of the sub-window is smaller than the display size of the application page.

[0188] In one possible implementation, the results interface also includes a delete icon; the results display module 14 is also used to perform the following operations:

[0189] The system responds to the trigger action of deleting an icon in the results screen, exits the results screen, and restores the application page.

[0190] In one possible implementation, the search data processing device 1000 further includes a status acquisition module 13, which is used to perform the following operations:

[0191] Obtain the content status information of the target multimedia data, parse the target multimedia data based on the content status information, and obtain search results for the target multimedia data.

[0192] In one possible implementation, the state acquisition module 13 is used to parse the target multimedia data based on the content state information. When obtaining search results for the target multimedia data, the state acquisition module 13 is specifically used to perform the following operations:

[0193] If the content status information indicates that the target multimedia data is text data, then the text data corresponding to the target multimedia data is parsed to obtain the text parsing result;

[0194] If the text parsing result indicates that the text data belongs to the industry terminology type, then the text data is interpreted to obtain the terminology interpretation result, and the terminology interpretation result is determined as the search result for the target multimedia data;

[0195] If the text parsing result indicates that the text data belongs to the question type, then a question search is performed on the question to obtain the question answer result, and the question answer result is determined as the search result for the target multimedia data.

[0196] In one possible implementation, the state acquisition module 13 is used to parse the target multimedia data based on the content state information. When obtaining search results for the target multimedia data, the state acquisition module 13 is specifically used to perform the following operations:

[0197] If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is a key element in the image data, then the key element is searched to obtain the search results for the target multimedia data.

[0198] If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is complete image data, then at least two key elements in the image data are obtained, the at least two key elements are fused and parsed to obtain the fusion and parsing result, and the fusion and parsing result is searched to obtain the search results for the target multimedia data.

[0199] In one possible implementation, the state acquisition module 13 is used to parse the target multimedia data based on the content state information. When obtaining search results for the target multimedia data, the state acquisition module 13 is specifically used to perform the following operations:

[0200] If the content status information indicates that the target multimedia data is video data, then the currently playing video frame in the video data is obtained, and the video elements in the currently playing video frame are searched to obtain the video element results;

[0201] Obtain the audio data corresponding to the video data within the audio search time period, parse the audio data, and obtain the audio parsing results;

[0202] The video element results and audio parsing results are used to determine the search results for the target multimedia data.

[0203] In one possible implementation, when the result display module 14 responds to a trigger operation on the follow-up data and displays the follow-up data in the result interface, and when the result display module 14 displays the follow-up search results on the follow-up data, it is specifically used to perform the following operations:

[0204] In response to the triggered operation on the follow-up data, parse the follow-up data to obtain the initial parsing result;

[0205] The initial parsing results and the target multimedia data are fused to obtain fused data. The fused data is then searched to obtain follow-up search results for the follow-up data.

[0206] The results page displays follow-up data and search results for follow-up questions based on that data.

[0207] Please see Figure 11 , Figure 11 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Figure 11 As shown, the computer device in this embodiment may include a processor 1101, a network interface 1104, and a memory 1105. Furthermore, the computer device 1100 may also include a user interface 1103 and at least one communication bus 1102. The communication bus 1102 is used to enable communication between these components. The user interface 1103 may include a display screen and a keyboard; optionally, the user interface 1103 may also include a standard wired interface or a wireless interface. The network interface 1104 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1105 may be high-speed RAM or non-volatile memory, such as at least one disk storage device. Optionally, the memory 1105 may also be at least one storage device located remotely from the processor 1101. Figure 11 As shown, the memory 1105, which is a computer-readable storage medium, may include an operating system, a network communication module, a user interface module, and a device control application.

[0208] Network interface 1104 provides network communication elements; user interface 1103 is mainly used to provide an input interface for users; and processor 1101 can be used to call the device control application stored in memory 1105 to perform the following operations:

[0209] In response to a movement operation on the search box within the application page that is initially located within its target location range, move the search box to the target location range within the application page; the initial location range and the target location range are different.

[0210] The search box within the target location range displays the target multimedia data selected by the search box; the target multimedia data belongs to the multimedia data included within the target location range.

[0211] In response to a trigger action on the target multimedia data within the search box, display the search results for the target multimedia data on the application page.

[0212] In one possible implementation, processor 1101 is used to display target multimedia data selected by the search box within a search box located within the target location range, specifically for performing the following operations:

[0213] Highlight the multimedia data contained within the target location range, and identify the highlighted multimedia data as the target multimedia data;

[0214] A search box is displayed within the target location area to enclose the target multimedia data, and a search icon is displayed within the search box; the search icon indicates that the search box has the function of searching for the enclosed target multimedia data.

[0215] In one possible implementation, processor 1101 is used to display target multimedia data selected by the search box within a search box located within the target location range, specifically for performing the following operations:

[0216] The multimedia data contained within the target location area is highlighted, and a search box is displayed within the target location area to surround the highlighted multimedia data. A search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted multimedia data.

[0217] In response to a partial selection operation of the search box within a target location range, the search icon is hidden, and the search box is moved to the target search location; the target search location is a local area within the target location range.

[0218] Displays a search box within the target search location to select the target multimedia data; the target multimedia data is the multimedia data contained within the target search location.

[0219] In one possible implementation, the processor 1101 is used to display a search box for selecting target multimedia data within the target search location, specifically for performing the following operations:

[0220] In response to a partial selection operation of the search box within the target search location, move the search box to the character search location; the character search location is a local area within the target search location.

[0221] Displays a search box within the character search position to select the target multimedia data; the target multimedia data is the character within the character search position.

[0222] In one possible implementation, the multimedia data contained within the target location range is image data; the processor 1101 is used to display the target multimedia data selected by the search box within the target location range, specifically for performing the following operations:

[0223] The image data contained within the target location range is highlighted, and a search box is displayed within the target location range to surround the highlighted image data. A search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted image data.

[0224] In response to a local selection operation of the search box within the target location range, the image data within the target location range is magnified and the search box is moved to the element search position in the magnified image data; the element search position is a local area in the image data within the target location range.

[0225] A search box is displayed at the element search location to select the target multimedia data, and the search icon is moved synchronously to the search box for display; the target multimedia data is the key element located at the element search location in the image data.

[0226] In one possible implementation, the multimedia data contained within the target location range is video data; the processor 1101 is used to display the target multimedia data selected by the search box within the target location range, specifically for performing the following operations:

[0227] Highlight the video data contained within the target location area, and identify the highlighted video data as the target multimedia data;

[0228] A search box is displayed within the target location range to surround the target multimedia data. A video indicator icon is displayed within the search box. The video indicator icon is transformed from the search icon that follows the search box. The video indicator icon is used to indicate that the target multimedia data surrounded by the search box is video data, and it is used to indicate that the search box has a search function for the surrounded video data.

[0229] In one possible implementation, processor 1101 is configured to respond to a trigger operation on target multimedia data within the search box, and display search results for the target multimedia data on the application page, specifically for performing the following operations:

[0230] Respond to a trigger operation targeting the target multimedia data within the search box and retrieve search results for the target multimedia data;

[0231] The application page displays the results interface, which shows the target multimedia data and the search results for the target multimedia data.

[0232] In one possible implementation, the target multimedia data is video data, and the search results include video element results and audio parsing results; the processor 1101 is used to display the target multimedia data and the search results for the target multimedia data in the results interface, specifically for performing the following operations:

[0233] The video data is highlighted, and the results interface displays the highlighted video data, as well as the video element results and audio parsing results for the video data. The video element results are obtained by searching for the currently playing video element in the video data, and the audio parsing results are obtained by parsing the audio data corresponding to the video data within the audio search time period.

[0234] In one possible implementation, the results interface further includes an audio progress control, which includes a sub-image corresponding to a video frame in the video data. The image size of the sub-image is smaller than the image size of the video frame. The audio progress control includes a slider icon and a search time sub-control. The processor 1101 is also used to perform the following operations:

[0235] If the response is to a sliding operation of the slider icon in the audio progress control, the slider icon is slid to the updated video frame position of the audio progress control, the updated video frame corresponding to the sub-image at the updated video frame position is obtained, and the currently playing video frame in the video data is switched to be displayed as the updated video frame.

[0236] If an adjustment operation is performed on the search time sub-control, the duration of the audio search time period is updated to obtain the updated audio search time period, and the updated audio parsing result is obtained; the updated audio parsing result is obtained by parsing the audio data corresponding to the video data within the updated audio search time period;

[0237] Delete the audio parsing result in the results interface and display the updated audio parsing result.

[0238] In one possible implementation, the results interface also includes a follow-up question icon; the processor 1101 is also used to perform the following operations:

[0239] The response to the follow-up question icon in the results screen retrieves the follow-up question data.

[0240] In response to the triggered action on the follow-up data, the follow-up data and the search results for the follow-up data will be displayed in the results interface.

[0241] In one possible implementation, processor 1101 is used to display follow-up data and follow-up search results for the follow-up data in the results interface, specifically for performing the following operations:

[0242] In the results interface, delete the search results for the target multimedia data and display the search results for the follow-up questions.

[0243] Alternatively, in the results interface, the search results for the target multimedia data can be moved from the first display position to the second display position, and the follow-up search results for the follow-up data can be displayed in the first display position; both the first and second display positions are located in the results interface, and the display priority of the first display position is higher than that of the second display position.

[0244] In one possible implementation, processor 1101 is used to display the results interface in the application page, specifically for performing the following operations:

[0245] Overlay a mask frame with filter functionality on the application page, and display the results interface within the mask frame;

[0246] Alternatively, a sub-window can be displayed within the application page, and the results interface can be displayed within the sub-window; the sub-window is an area displayed independently on the application page, and the display size of the sub-window is smaller than the display size of the application page.

[0247] In one possible implementation, the result interface also includes a delete icon; the processor 1101 is also used to perform the following operations:

[0248] The system responds to the trigger action of deleting an icon in the results screen, exits the results screen, and restores the application page.

[0249] In one possible implementation, processor 1101 is also used to perform the following operations:

[0250] Obtain the content status information of the target multimedia data, parse the target multimedia data based on the content status information, and obtain search results for the target multimedia data.

[0251] In one possible implementation, processor 1101 is used to parse the target multimedia data based on content state information to obtain search results for the target multimedia data, specifically for performing the following operations:

[0252] If the content status information indicates that the target multimedia data is text data, then the text data corresponding to the target multimedia data is parsed to obtain the text parsing result;

[0253] If the text parsing result indicates that the text data belongs to the industry terminology type, then the text data is interpreted to obtain the terminology interpretation result, and the terminology interpretation result is determined as the search result for the target multimedia data;

[0254] If the text parsing result indicates that the text data belongs to the question type, then a question search is performed on the question to obtain the question answer result, and the question answer result is determined as the search result for the target multimedia data.

[0255] In one possible implementation, processor 1101 is used to parse the target multimedia data based on content state information to obtain search results for the target multimedia data, specifically for performing the following operations:

[0256] If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is a key element in the image data, then the key element is searched to obtain the search results for the target multimedia data.

[0257] If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is complete image data, then at least two key elements in the image data are obtained, the at least two key elements are fused and parsed to obtain the fusion and parsing result, and the fusion and parsing result is searched to obtain the search results for the target multimedia data.

[0258] In one possible implementation, processor 1101 is used to parse the target multimedia data based on content state information to obtain search results for the target multimedia data, specifically for performing the following operations:

[0259] If the content status information indicates that the target multimedia data is video data, then the currently playing video frame in the video data is obtained, and the video elements in the currently playing video frame are searched to obtain the video element results;

[0260] Obtain the audio data corresponding to the video data within the audio search time period, parse the audio data, and obtain the audio parsing results;

[0261] The video element results and audio parsing results are used to determine the search results for the target multimedia data.

[0262] In one possible implementation, processor 1101 is used to respond to a trigger operation on follow-up data, display the follow-up data and the follow-up search results on the results interface, specifically for performing the following operations:

[0263] In response to the triggered operation on the follow-up data, parse the follow-up data to obtain the initial parsing result;

[0264] The initial parsing results and the target multimedia data are fused to obtain fused data. The fused data is then searched to obtain follow-up search results for the follow-up data.

[0265] The results page displays follow-up data and search results for follow-up questions based on that data.

[0266] Furthermore, it should be noted that embodiments of this application also provide a computer-readable storage medium storing a computer program adapted to be loaded and executed by the processor. Figure 3 or Figure 4 For details on the methods provided in each step, please refer to the document. Figure 3 or Figure 4 The implementation methods provided for each step are not repeated here. Furthermore, the beneficial effects of using the same method are also not repeated. For technical details not disclosed in the computer-readable storage medium embodiments involved in this application, please refer to the description of the method embodiments of this application. As an example, a computer program may be deployed to execute on a single computer device, or on multiple computer devices located in one location, or on multiple computer devices distributed across multiple locations and interconnected via a communication network.

[0267] The computer-readable storage medium can be the apparatus provided in any of the foregoing embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium can also be an external storage device of the computer device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., provided on the computer device. Furthermore, the computer-readable storage medium can include both internal storage units and external storage devices of the computer device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0268] This application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform... Figure 3 or Figure 4 The methods provided are among the various optional methods available in the code, so they will not be elaborated upon here.

[0269] The terms "first," "second," etc., in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the term "comprising" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or device that includes a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.

[0270] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0271] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been generally described in terms of functionality. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0272] The methods and related apparatus provided in this application are described with reference to the method flowcharts and / or structural diagrams provided in this application. Specifically, each block of the method flowchart and / or structural diagram, as well as combinations of blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable device to create a machine, such that the instructions, which execute via the processor of the computer or other programmable device, generate instructions for implementing the process. Figure 1 A schematic diagram of one or more processes and / or structures. Figure 1 The computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable device to function in a particular manner, causing the instructions stored in the computer-readable storage medium to produce an article of manufacture including the instruction means, or to be transmitted via a computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The instruction means is implemented in the process. Figure 1 A schematic diagram of one or more processes and / or structures. Figure 1 The functions specified in one or more boxes. These computer program instructions may also be loaded onto a computer or other programmable device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable device for implementing the process. Figure 1 A process or multiple processes and / or structures illustrate the steps of the functions specified in one or more boxes.

[0273] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0274] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0275] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application. < / h6>

Claims

1. A method for processing search data, characterized in that, The method includes: In response to a movement operation on a search box located within an initial position range on an application page, the search box is moved to a target position range on the application page; the initial position range is different from the target position range. In the search box located within the target location range, the target multimedia data selected by the search box is displayed; the target multimedia data belongs to the multimedia data included within the target location range; In response to a trigger operation on the target multimedia data within the search box, search results for the target multimedia data are displayed on the application page.

2. The method according to claim 1, characterized in that, Displaying the target multimedia data selected by the search box within the target location range includes: Multimedia data contained within the target location range is highlighted, and the highlighted multimedia data is identified as the target multimedia data. A search box is displayed within the target location range to surround the target multimedia data, and a search icon is displayed within the search box; the search icon is used to indicate that the search box has a search function for the surrounded target multimedia data.

3. The method according to claim 1, characterized in that, Displaying the target multimedia data selected by the search box within the target location range includes: The multimedia data contained within the target location range is highlighted, and a search box is displayed within the target location range to surround the highlighted multimedia data. A search icon is displayed within the search box; the search icon is used to indicate that the search box has a search function for the surrounded highlighted multimedia data. In response to a partial selection operation of the search box within the target location range, the search icon is hidden, and the search box is moved to the target search location; the target search location is a local area within the target location range. A search box for selecting target multimedia data is displayed within the target search location; the target multimedia data belongs to the multimedia data contained within the target search location.

4. The method according to claim 3, characterized in that, The step of displaying the search box for selecting target multimedia data within the target search location includes: In response to a partial selection operation of the search box within the target search position, the search box is moved to the character search position; the character search position is a local area within the target search position. A search box for selecting target multimedia data is displayed within the character search position; the target multimedia data is the character within the character search position.

5. The method according to claim 1, characterized in that, The multimedia data included within the target location range is image data; displaying the target multimedia data selected by the search box within the target location range includes: The image data contained within the target location range is highlighted, and a search box is displayed within the target location range to surround the highlighted image data. A search icon is displayed within the search box; the search icon indicates that the search box has a search function for the surrounded highlighted image data. In response to a local selection operation of the search box within the target location range, the image data within the target location range is magnified and the search box is moved to the element search position in the magnified image data; the element search position is a local area in the image data within the target location range. A search box for selecting the target multimedia data is displayed at the element search position, and the search icon is synchronously moved into the search box for display; the target multimedia data is a key element in the image data located at the element search position.

6. The method according to claim 1, characterized in that, The multimedia data contained within the target location range is video data; Displaying the target multimedia data selected by the search box within the target location range includes: The video data contained within the target location range is highlighted, and the highlighted video data is identified as target multimedia data; A search box is displayed within the target location range to surround the target multimedia data, and a video indicator icon is displayed within the search box. The video indicator icon is obtained by converting a search icon that follows the search box. The video indicator icon is used to indicate that the target multimedia data surrounded by the search box is video data, and to indicate that the search box has a search function for the surrounded video data.

7. The method according to claim 1, characterized in that, The response to the triggering operation of the target multimedia data within the search box displays search results for the target multimedia data on the application page, including: In response to a trigger operation on the target multimedia data within the search box, retrieve search results for the target multimedia data; The application page displays a results interface, which shows the target multimedia data and search results for the target multimedia data.

8. The method according to claim 7, characterized in that, The target multimedia data is video data, and the search results include video element results and audio parsing results; The display of the target multimedia data and the search results for the target multimedia data in the results interface includes: The video data is highlighted, and the highlighted video data, along with the video element results and audio parsing results for the video data, are displayed in the results interface. The video element result is obtained by searching for the currently playing video element in the video data, and the audio parsing result is obtained by parsing the audio data corresponding to the video data within the audio search time period.

9. The method according to claim 8, characterized in that, The results interface also includes an audio progress control, which includes a sub-image corresponding to a video frame in the video data. The image size of the sub-image is smaller than the image size of the video frame. The audio progress control includes a sliding icon and a search time sub-control. The method also includes: If a sliding operation is performed on the sliding icon in the audio progress control, the sliding icon is slid to the updated video frame position of the audio progress control, the updated video frame corresponding to the sub-image at the updated video frame position is obtained, and the currently playing video frame in the video data is switched to be displayed as the updated video frame. If an adjustment operation is performed on the search time sub-control, the duration of the audio search time period is updated to obtain an updated audio search time period, and the updated audio parsing result is obtained; the updated audio parsing result is obtained by parsing the audio data corresponding to the video data within the updated audio search time period; Delete the audio parsing result in the results interface and display the updated audio parsing result.

10. The method according to claim 7, characterized in that, The results interface also includes a follow-up question icon, and the method further includes: In response to the triggered operation of the follow-up question icon on the results interface, the follow-up question data is obtained; In response to a triggered operation on the follow-up data, the follow-up data and the search results for the follow-up data are displayed in the results interface.

11. The method according to claim 10, characterized in that, The display of the follow-up data and the search results for the follow-up data in the results interface includes: In the results interface, delete the search results for the target multimedia data and display the search results for the follow-up questions. Alternatively, in the results interface, the search results for the target multimedia data are moved from the first display position to the second display position, and the follow-up search results for the follow-up data are displayed in the first display position; both the first display position and the second display position are located in the results interface, and the display priority of the first display position is higher than that of the second display position.

12. The method according to claim 7, characterized in that, The result display interface on the application page includes: A mask frame with filter function is displayed over the application page, and the result interface is displayed within the mask frame; Alternatively, a sub-window may be displayed on the application page, and the results interface may be displayed within the sub-window; the sub-window is an area displayed independently on the application page, and the display size of the sub-window is smaller than the display size of the application page.

13. The method according to claim 10, characterized in that, The results interface also includes a delete icon, and the method further includes: In response to the triggered operation of the delete icon in the results interface, exit the display of the results interface and restore the display of the application page.

14. The method according to claim 1, characterized in that, The method further includes: Obtain the content status information of the target multimedia data, parse the target multimedia data based on the content status information, and obtain search results for the target multimedia data.

15. The method according to claim 14, characterized in that, The step of parsing the target multimedia data based on the content status information to obtain search results for the target multimedia data includes: If the content status information indicates that the target multimedia data is text data, then the text data corresponding to the target multimedia data is parsed to obtain the text parsing result; If the text parsing result indicates that the text data belongs to the industry terminology type, then the text data is interpreted to obtain the terminology interpretation result, and the terminology interpretation result is determined as the search result for the target multimedia data; If the text parsing result indicates that the text data belongs to a question type, then a question search is performed on the question to obtain a question answer result, and the question answer result is determined as the search result for the target multimedia data.

16. The method according to claim 14, characterized in that, The step of parsing the target multimedia data based on the content status information to obtain search results for the target multimedia data includes: If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is a key element in the image data, then the key element is searched to obtain search results for the target multimedia data. If the content status information indicates that the target multimedia data is image data, and the target multimedia data selected by the search box is complete image data, then at least two key elements in the image data are obtained, the at least two key elements are fused and parsed to obtain a fusion parsing result, and the fusion parsing result is searched to obtain a search result for the target multimedia data.

17. The method according to claim 14, characterized in that, The step of parsing the target multimedia data based on the content status information to obtain search results for the target multimedia data includes: If the content status information indicates that the target multimedia data is video data, then the currently playing video frame in the video data is obtained, and the video elements in the currently playing video frame are searched to obtain the video element results; Obtain the audio data corresponding to the video data within the audio search time period, parse the audio data, and obtain the audio parsing result; The video element results and the audio parsing results are determined as the search results for the target multimedia data.

18. The method according to claim 10, characterized in that, The response to the triggered operation of the follow-up data displays the follow-up data and the search results for the follow-up data in the results interface, including: In response to the triggered operation on the follow-up data, the follow-up data is parsed to obtain an initial parsing result; The initial parsing result and the target multimedia data are fused to obtain fused data. The fused data is then searched to obtain follow-up search results for the follow-up data. The results interface displays the follow-up data and the search results for the follow-up data.

19. A search data processing apparatus, characterized in that, The device includes: The search box movement module is used to respond to a movement operation on a search box located in an initial position range within an application page, and to move the search box to a target position range within the application page; the initial position range is different from the target position range. The data display module is used to display target multimedia data selected by the search box within the search box located within the target location range; the target multimedia data belongs to the multimedia data included within the target location range; The results display module responds to a trigger operation on the target multimedia data within the search box and displays the search results for the target multimedia data on the application page.

20. A computer device, characterized in that, Includes processor, memory, and input / output interfaces; The processor is connected to the memory and the input / output interface respectively, wherein the input / output interface is used to receive data and output data, the memory is used to store computer programs, and the processor is used to call the computer programs so that the computer device executes the method according to any one of claims 1-18.

21. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-18.

22. A computer program product, comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the method described in any one of claims 1-18.

Images