Searching method and device, computer equipment and storage medium

Abstract

The invention provides a search method and device, computer equipment and a storage medium, and belongs to the technical field of computers. The method comprises the steps that in an intelligent agent-based search interface, an application list is displayed, the application list comprises a plurality of target applications, the target applications are respectively from first equipment and second equipment under the same account number, and intelligent agents run on the first equipment and the second equipment; and in response to a search operation for a target search term, displaying search results obtained by the intelligent agent in the plurality of target applications based on the target search term in the search interface. According to the technical scheme, the data in the multiple applications on the multiple devices can be searched through the intelligent agent, the search results of the multiple applications on the multiple devices are displayed to the user at a time, the user does not need to frequently switch between the multiple devices and the applications for searching, and the search efficiency can be improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a search method, apparatus, computer device, and storage medium. Background Technology

[0002] With the rapid development of information technology, users have accumulated massive amounts of data across various devices (such as computers, mobile phones, tablets, etc.) and applications (photo albums, document management software, social media platforms, email clients, etc.), including photos, documents, notes, and chat logs. Due to the large amount of data, users typically use search to quickly find the data they need.

[0003] Currently, common data search methods mainly involve: for the search term to be searched, the user enters the search term into the search box of each target application on each device to obtain data related to the search term within each target application; this data is then used as the search result.

[0004] However, most of the above-mentioned technical solutions can only perform searches within a single device or application, and cannot integrate data from different platforms. This forces users to frequently switch between multiple devices and applications when searching for data, consuming a lot of time and effort and seriously affecting search efficiency. Summary of the Invention

[0005] This application provides a search method, apparatus, computer device, and storage medium, which can improve search efficiency. The technical solution is as follows:

[0006] On the one hand, a search method is provided, applied to a first device, the method comprising:

[0007] In the agent-based search interface, an application list is displayed, which includes multiple target applications. These multiple target applications come from the first device and the second device under the same account. The agent is running on both the first device and the second device.

[0008] In response to a search operation targeting a specific search term, the search results obtained by the agent based on the target search term in the multiple target applications are displayed in the search interface.

[0009] In some embodiments, the method further includes:

[0010] Based on the intelligent agent, multiple applications are displayed in the search interface. These multiple applications are respectively from the first device and the second device, and the multiple applications support the intelligent agent in obtaining data within the applications.

[0011] The application list displayed in the agent-based search interface includes:

[0012] In response to the selection of multiple target applications among the multiple applications, a list of applications containing the multiple target applications is displayed in the agent-based search interface.

[0013] In some embodiments, the method further includes:

[0014] Based on the intelligent agent, the search results are synchronized to the second device, which is used to display the search results in a search interface based on the intelligent agent after the intelligent agent is activated.

[0015] In some embodiments, the method further includes:

[0016] In response to the linked display operation of the search results, based on the intelligent agent, a linked display instruction is sent to a second device indicated by the linked display operation, and the second device is used to display the search results in the search interface based on the intelligent agent in response to the linked display instruction.

[0017] In some embodiments, the number of the second devices is multiple;

[0018] The response to the linked display operation of the search results, based on the intelligent agent, involves sending a linked display instruction to the second device indicated by the linked display operation, including:

[0019] In response to the linked operation of the search results, multiple second devices are displayed in the search interface;

[0020] In response to the selection operation of any one of the plurality of second devices, the linkage display instruction is sent to the selected second device based on the intelligent agent.

[0021] In some embodiments, the target search term includes location information;

[0022] The method includes:

[0023] While saving any data item within any application of the plurality of target applications, the location information at the time of saving the data is also stored;

[0024] In response to a search operation targeting a search term, the search interface displays the search results obtained by the agent based on the target search term in multiple target applications, including:

[0025] In response to a search operation targeting a search term, the search results obtained by the agent based on the location information in the multiple target applications are displayed in the search interface.

[0026] In some embodiments, the target search term includes location information;

[0027] The method includes:

[0028] While saving any data item within any application of the plurality of target applications, the location information at the time of saving the data is also stored;

[0029] In response to a search operation targeting a search term, the search interface displays the search results obtained by the agent based on the target search term in multiple target applications, including:

[0030] In response to a search operation targeting a search term, the search results obtained by the agent based on the location information in the multiple target applications are displayed in the search interface.

[0031] In some embodiments, the method further includes:

[0032] For any of the at least one event, if the agent detects new information related to the event in the plurality of applications, then the relevant information of the event is updated based on the new information obtained by the agent.

[0033] In some embodiments, for any target application in the application list, the agent can call the data interface opened by the target application to obtain data in the target application; or, the agent has screen capture permission for the target application and obtains data in the target application based on the screen capture permission; or, the agent can call the data interface opened by the operating system on the device where the target application is located to obtain data in the target application.

[0034] On the other hand, a search device is provided, deployed on the first device, the device comprising:

[0035] The first display module is used to display an application list in an agent-based search interface. The application list includes multiple target applications, which are respectively from the first device and the second device under the same account. The agent is running on both the first device and the second device.

[0036] The second display module is used to display, in response to a search operation for a target search term, the search results obtained by the agent based on the target search term in the multiple target applications in the search interface.

[0037] In some embodiments, the first display module is further configured to display multiple applications in the search interface based on the intelligent agent, the multiple applications being respectively from the first device and the second device, and the multiple applications supporting the intelligent agent in obtaining data within the application;

[0038] In response to the selection of multiple target applications among the multiple applications, a list of applications containing the multiple target applications is displayed in the agent-based search interface.

[0039] In some embodiments, the apparatus further includes:

[0040] The sending module is used to synchronize the search results to the second device based on the intelligent agent, and the second device is used to display the search results in the search interface based on the intelligent agent after the intelligent agent is activated.

[0041] In some embodiments, the apparatus further includes:

[0042] The sending module is configured to, in response to the linked display operation of the search results, send a linked display instruction to a second device indicated by the linked display operation based on the intelligent agent, wherein the second device is configured to display the search results in the search interface based on the intelligent agent in response to the linked display instruction.

[0043] In some embodiments, the number of the second devices is multiple;

[0044] The sending module is configured to display multiple second devices in the search interface in response to a linkage operation on the search results; and to send the linkage display instruction to the selected second device based on the intelligent agent in response to a selection operation on any of the multiple second devices.

[0045] In some embodiments, the target search term includes location information;

[0046] The device includes:

[0047] The storage module is used to store the location information when the data is saved, while saving any data item within any application of the plurality of target applications;

[0048] The second display module is configured to, in response to a search operation targeting a search term, display in the search interface the search results obtained by the agent based on the location information in the plurality of target applications.

[0049] In some embodiments, the apparatus further includes:

[0050] A determining module is configured to, based on the intelligent agent, determine at least one event related to a user object from multiple applications, wherein the multiple applications are respectively from the first device and the second device;

[0051] The third display module is used to display relevant information about the at least one event obtained by the intelligent agent from the plurality of applications, and the relevant information about the at least one event is used to prompt the user object to perform the at least one event.

[0052] In some embodiments, the apparatus further includes:

[0053] An update module is configured to, for any of the at least one events, if the agent detects new information related to the event in the plurality of applications, update the relevant information of the event based on the new information obtained by the agent.

[0054] In some embodiments, for any target application in the application list, the agent can call the data interface opened by the target application to obtain data in the target application; or, the agent has screen capture permission for the target application and obtains data in the target application based on the screen capture permission; or, the agent can call the data interface opened by the operating system on the device where the target application is located to obtain data in the target application.

[0055] On the other hand, a computer device is provided, the computer device including a processor and a memory, the memory being used to store at least one computer program, the at least one computer program being loaded and executed by the processor to implement the search method in the embodiments of this application.

[0056] On the other hand, a computer-readable storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, the at least one computer program being loaded and executed by a processor to implement the search method as described in the embodiments of this application.

[0057] On the other hand, a computer program product is provided, including a computer program stored in a computer-readable storage medium, a processor of a computer device reading the computer program from the computer-readable storage medium, and the processor executing the computer program, causing the computer device to perform the search method provided in the above-described search aspect or various alternative implementations of the search aspect.

[0058] This application provides a search method that can search for data in multiple applications on multiple devices through an intelligent agent, and aggregate the data found in multiple applications on multiple devices into search results and display them in the search interface. This method can show search results from multiple applications on multiple devices to the user at once, is simple to operate, and does not require the user to frequently switch between multiple devices and applications to search, thus improving search efficiency. Attached Figure Description

[0059] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0060] Figure 1 This is a schematic diagram illustrating the implementation environment of a search method provided in an embodiment of this application;

[0061] Figure 2 This is a flowchart of a search method provided according to an embodiment of this application;

[0062] Figure 3 This is a flowchart of another search method provided according to an embodiment of this application;

[0063] Figure 4 This is a schematic diagram of a search interface provided according to an embodiment of this application;

[0064] Figure 5 This is a framework diagram of a file search method provided according to an embodiment of this application;

[0065] Figure 6 This is a framework diagram of searching chat history according to an embodiment of this application;

[0066] Figure 7 This is a schematic diagram of a linkage second device provided according to an embodiment of this application;

[0067] Figure 8 This is a schematic diagram of a display event provided according to an embodiment of this application;

[0068] Figure 9 This is a block diagram of a search device provided according to an embodiment of this application;

[0069] Figure 10 This is a structural block diagram of a terminal provided according to an embodiment of this application;

[0070] Figure 11 This is a schematic diagram of the structure of a server according to an embodiment of this application. Detailed Implementation

[0071] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0072] In this application, the terms "first," "second," etc., are used to distinguish identical or similar items with essentially the same function. It should be understood that there is no logical or temporal dependency between "first," "second," and "nth," nor are there any restrictions on quantity or execution order.

[0073] In this application, the term "at least one" means one or more, and "multiple" means two or more.

[0074] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the search terms, search results, event-related information, and data within each application involved in this application were all obtained with full authorization.

[0075] The search method provided in this application can be executed by a computer device. In some embodiments, the computer device is a terminal or a server. The following section first uses a computer device as an example to describe the implementation environment of the search method provided in this application. Figure 1 This is a schematic diagram illustrating the implementation environment of a search method provided according to an embodiment of this application. See also... Figure 1 The implementation environment includes a first device 101, a second device 102, and a server 103. The first device 101, the second device 102, and the server 103 can be directly or indirectly connected via wired or wireless communication, which is not limited herein.

[0076] In some embodiments, the first device 101 is a terminal device such as a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, smart voice interaction device, smart home appliance, or in-vehicle terminal, but is not limited thereto. The first device 101 runs an intelligent agent that supports search functionality. Illustratively, the first device 101 is a device used by a user, who uses the first device 101 to log in to the intelligent agent to obtain services provided by that intelligent agent, such as search services. The user can search for the data they need from applications on the first device 101 and applications on the second device 102 through the intelligent agent on the first device 101.

[0077] In some embodiments, the second device 102 is a terminal device such as a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, smart voice interaction device, smart home appliance, or in-vehicle terminal, but is not limited thereto. Illustratively, the second device 102 is also the device used by the user described above. The second device 102 also runs the aforementioned intelligent agent that supports search functionality. The second device 102 and the first device 101 are logged into the same account. When a user uses the intelligent agent on the first device 101 to search for data, the intelligent agent on the first device 101 automatically searches for applications on the first device 101 to obtain the data it needs on the first device 101; the intelligent agent on the second device 102 can respond to the search request from the intelligent agent on the first device 101, automatically search for applications on the second device 102 to obtain the data it needs on the second device 102, and return the searched data to the intelligent agent on the first device 101. The data searched on the first device 101 and the data searched on the second device constitute the intelligent agent's search results. The first device 101 can display the search results to the user.

[0078] Those skilled in the art will understand that the number of the second devices 102 described above can be more or less. For example, there may be only one second device 102, or there may be dozens or hundreds of second devices 102, or even more. This application does not limit the number or type of the second devices 102 in its embodiments.

[0079] In some embodiments, server 103 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), big data, and artificial intelligence platforms. Server 103 is used to provide backend services for intelligent agents that support search. In some embodiments, server 103 undertakes the main computing work, and the first device 101 and the second device 102 undertake secondary computing work; or, server 103 undertakes secondary computing work, and the first device 101 and the second device 102 undertake primary computing work; or, server 103, the first device 101, and the second device 102 collaborate on computing using a distributed computing architecture.

[0080] Figure 2 This is a flowchart of a search method provided according to an embodiment of this application. See also... Figure 2 In this embodiment, a first device is used as an example for explanation. The search method includes the following steps:

[0081] 201. The first device displays an application list in the agent-based search interface. The application list includes multiple target applications, which come from the first device and the second device under the same account. Both the first device and the second device are running agents.

[0082] In this embodiment, the first device and the second device are terminal devices used by a user. Both the first and second devices run an intelligent agent. The intelligent agent is used to search for data in applications on the terminal devices. The intelligent agents on the first and second devices are logged into the same account. In response to a startup operation on the intelligent agent on the first device, the first device displays a search interface based on that intelligent agent. Then, the first device displays a list of applications containing multiple target applications in the search interface. The target applications in the application list come from both the first and second devices. Each target application allows the intelligent agent to access data within the application. That is, the target application grants the intelligent agent permission to access data within the application. This permission is only granted with the user's permission.

[0083] 202. In response to a search operation for a target search term, the first device displays the search results obtained by the agent based on the target search term in multiple target applications on the search interface.

[0084] In this embodiment, a user can enter a target search term in the search interface to find data matching the target search term. In response to a search operation for the target search term in the search interface, an agent on the first device searches for a target application on the first device to obtain first data matching the target search term. Furthermore, the first device can also send a search instruction to a second device, instructing an agent on the second device to search for a target application on the second device to obtain second data matching the target search term. Then, the first device aggregates the first and second data to obtain search results based on the target search term and displays these search results on the search interface.

[0085] The searched data can be files (such as image files, video files, text documents, etc.), or chat logs, published social messages, etc., and this application embodiment does not impose any limitations on this. The number of second devices can be multiple. That is, this application is based on the ability of an intelligent agent to search data from multiple applications on multiple devices.

[0086] During the display of search results, the first device may display the data source of each item in the search results (such as the device or application from which it comes). Alternatively, the first device may also display the data items categorized by data source, etc., and this embodiment of the application does not impose any limitations on this.

[0087] This application provides a search method that can search for data in multiple applications on multiple devices through an intelligent agent, and aggregate the data found in multiple applications on multiple devices into search results and display them in the search interface. This method can show search results from multiple applications on multiple devices to the user at once, is simple to operate, and does not require the user to frequently switch between multiple devices and applications to search, thus improving search efficiency.

[0088] Figure 3 This is a flowchart of another search method provided according to an embodiment of this application, see [link to flowchart]. Figure 3 In this embodiment, a first device is used as an example for explanation. The search method includes the following steps:

[0089] 301. The first device is based on an intelligent agent and displays multiple applications in the intelligent agent-based search interface. The multiple applications come from the first device and the second device respectively, and the multiple applications support the intelligent agent to obtain data within the application.

[0090] In this embodiment, in response to opening the agent-based search interface, the first device determines the applications on the first device that support agent access to internal application data based on the permissions of each application running on the first device. Furthermore, the first device can also send an application retrieval instruction to a second device logged into the same account as the first device, instructing the second device to determine the applications on the second device that support agent access to internal application data based on the permissions of each application running on the second device, and return the relevant information (such as an icon) of the target application to the first device. Then, the first device aggregates the applications on the first device and the applications on the second device, and displays multiple applications from both the first and second devices that support agent access to internal application data on the agent-based search interface.

[0091] For example, Figure 4 This is a schematic diagram of a search interface provided according to an embodiment of this application. See also... Figure 4 The search interface displays five applications that support intelligent agents in obtaining internal application data.

[0092] The first device and the second device can interact through a server that supports intelligent agents. That is, the first device can send the aforementioned application retrieval command to the second device through the server that supports intelligent agents, and receive the application returned by the second device through the same server.

[0093] The first device can display all applications on both the first and second devices that support the intelligent agent in accessing internal application data in the search interface. Specifically, the first device can display multiple applications that support the intelligent agent in accessing internal application data according to the device on which the application is located. During the search process, the intelligent agent can search for all applications that support the intelligent agent in accessing internal application data; alternatively, before searching, the user can select the target application from all applications to perform the search, thus narrowing the search scope and improving search efficiency, as detailed in step 302.

[0094] 302. In response to the selection of multiple target applications among multiple applications, the first device displays a list of applications containing multiple target applications in an agent-based search interface.

[0095] In this embodiment of the application, when multiple target applications are selected among multiple applications, the first device deletes the unselected applications in the agent-based search interface and only displays the application list containing the selected multiple target applications.

[0096] Initially, the multiple applications displayed in the search interface are not interactive. Upon interaction with the applications (such as long-pressing an application), the first device displays that the applications are now interactive. Only when multiple applications are interactive can the user delete or select individual applications for subsequent searching within those selected applications.

[0097] 303. In response to a search operation for a target search term, the first device displays the search results obtained by the agent based on the target search term in multiple target applications on the search interface.

[0098] In this embodiment, the search interface also displays an input control. The input control is used to obtain the user's target search term. This input control can be a text input control (e.g., ...). Figure 4 The 401 error in the code can also be a voice input control (such as...). Figure 4 Examples such as 402 in this application are not limited in this respect.

[0099] In other words, the user's target search terms can be textual information. The intelligent agent can input the content to be searched via text, and using natural language processing technology, it can not only recognize the user's target search terms but also understand the user's intent behind their semantics, accurately retrieving the required data, such as images, videos, files, chat logs, etc. Alternatively, the intelligent agent can further enhance its semantic understanding capabilities through artificial intelligence technology, enabling users to quickly find the data they need through natural language descriptions without having to precisely input the data's name, thus achieving accurate location of the data the user is searching for.

[0100] Alternatively, the user can input their target search term as voice information. The first device is equipped with a microphone, allowing the user to directly record and send their voice in real time. When typing is inconvenient or a more convenient way to search for data is desired, detailed explanations can be provided via voice. In addition to basic search commands, the agent supports a rich set of voice control commands. Users can issue voice commands such as "Search for documents created yesterday on all devices" or "Find email attachments related to user A," which the agent accurately recognizes and executes. Furthermore, users can use voice control commands to manipulate search results, such as "Open the first file" or "Share these files to application A," achieving full voice interaction, freeing up hands, and improving operational efficiency.

[0101] In response to a search operation targeting a search term, the first device searches for the target application on its own device based on the agent running on it, and sends a search instruction to the second device to instruct the second device to search for the target application on its own device based on the agent running on it.

[0102] For any target application in the application list, the agent can call the data interface exposed by the operating system on the device where the target application is located to obtain data from the target application. For example, Figure 5 This is a framework diagram of a file search method provided according to an embodiment of this application. See also... Figure 5 In Windows systems, agents can interact with applications that support COM (Component Object Model) technology to obtain internal application data (such as files). For example, for office applications, agents can use COM interfaces to call relevant methods to obtain metadata such as the path, name, and modification time of open documents within the application, providing basic information for searching. In macOS systems, agents can utilize functions within the Core Services framework to query the metadata database of internal application data (such as files) to obtain various attribute information of the application's internal data, including file type and creator, facilitating file filtering and searching.

[0103] Alternatively, the agent can also invoke the target application's open data interfaces to obtain data from the target application. That is, if the application provides an open API (Application Programming Interface), the agent can interact directly with the application. See also... Figure 5Taking cloud storage applications as an example, through the application's open API, the agent can obtain data stored by the user in the cloud storage, such as file lists and file content summaries (e.g., document keywords, image descriptive tags, etc.), thereby enabling precise searching of data within the cloud storage. For other applications, such as design applications, if the application supports open APIs, the agent can obtain the internal structure information of project files in the application, such as design layers and element names, making it easier for users to search for relevant files based on specific design elements.

[0104] Regarding the process of the intelligent agent acquiring internal application data, the agent can acquire data generated within the application in real time during its operation or use, standardize the data to convert it into a unified format, and then index the data based on its attributes, storing the data and its index. When performing searches based on the agent, the target search term is matched against the indexes of each data item to find data matching the target search term, thus improving search efficiency. The index of each data item may include its spatiotemporal information (e.g., creation time, location), semantic information (e.g., topic), sentiment tags, etc., but this embodiment does not impose any limitations on these aspects.

[0105] Alternatively, the intelligent agent may have screen capture permissions for the target application, and use these permissions to access data within the application. In other words, during the use of the target application, the intelligent agent can utilize screen capture technology to obtain data displayed within the application. For example, Figure 6 This is a framework diagram of searching chat history according to an embodiment of this application. See also... Figure 6 For common chat software, since they don't publicly provide APIs for directly accessing chat logs, the intelligent agent can utilize the system's screen capture technology to simulate user actions, locate the chat window on the screen, and read pixel information by coordinates to parse out text and other chat content. After obtaining the chat logs, the intelligent agent can then parse them.

[0106] For text chat messages, the intelligent agent can use natural language processing technology to perform word segmentation, part-of-speech tagging, named entity recognition, and other processing to extract key information from the text chat messages, such as names of people, places, and key events. Based on this key information, an index is built for the text chat messages so that the text chat records can be searched based on the index in subsequent search processes.

[0107] For unstructured text such as text in images and scanned documents, the agent can use Optical Character Recognition (OCR) technology to convert it into editable text. For example, the agent uses an OCR engine to recognize and extract text from images. The recognized text is then cleaned and corrected to remove recognition errors and noise. Keywords are then extracted and an index is built to enable its use in searches. Alternatively, the agent can use speech recognition technology to convert audio content into text. A speech recognition engine is then used to process user-uploaded audio files. The converted text is then indexed and incorporated into the search system. Users can then search for audio files containing specific keywords.

[0108] In some embodiments, the target search term includes location information. The agent is capable of searching for data based on the location information. Accordingly, while saving any data item within any of the multiple target applications, the first device stores the location information at the time the data is saved based on the agent. In response to a search operation for the target search term, the first device displays the search results obtained by the agent based on the location information in the multiple target applications on the search interface. That is, this application can record the user's location information at different times, and the user can search according to the geographic location trajectory. For example, a user can search for "photos taken during a trip from Beijing to Shanghai". The agent filters out data (such as files) generated within that trip period based on the recorded location trajectory and displays it on the search interface, providing convenience for the user to recall data from a specific trip.

[0109] In some embodiments, a caching mechanism is set up locally on the first device and the application to cache metadata (such as file paths, chat history summaries, etc.) of files or chat information recently searched by the user. This allows the first device to quickly retrieve results directly from the local cache when the user performs a similar search again, improving search speed. Simultaneously, the first device can periodically clear the local cache to free up storage space and ensure smooth application operation.

[0110] In other embodiments, the first device can also store key metadata of user-authorized files and chat logs on a cloud server, enabling multi-device synchronization. When a user finds important files or chat logs on the first device, the search history and results can be viewed synchronously on the smart agent of the second device. Simultaneously, cloud storage can also be used to back up data and prevent local data loss.

[0111] The embodiment of the present application provides a search method, which can search for data in multiple applications on multiple devices through an agent, and summarize the data searched in multiple applications on multiple devices into a search result and display it on a search interface, presenting the search results of multiple applications on multiple devices to the user at one time, with simple operation, without the user having to frequently switch between multiple devices and applications to search, and can improve the search efficiency.

[0112] In some embodiments, when the user starts searching for a file on one device and does not complete the operation, the search process can be continued on other devices. Correspondingly, the first device synchronizes the search results to the second device based on the agent. The second device is used to display the search results in the agent-based search interface after starting the agent. For example, when the user searches for work files on the mobile phone and needs to view the file content in detail on the computer, the user does not need to re-enter the search keywords. By opening the search tool on the computer, the search history and results on the mobile phone can be automatically synchronized, realizing seamless interaction across devices.

[0113] In other embodiments, the present application can also support the linkage operation between multiple devices. Correspondingly, in response to the linkage display operation on the search results, the first device sends a linkage display instruction to the second device indicated by the linkage display operation based on the agent. The second device is used to display the search results in the agent-based search interface in response to the linkage display instruction.

[0114] Among them, the number of the second devices is multiple. During the linkage with the second device, in response to the linkage operation on the search results, the first device displays multiple second devices in the search interface. In response to the selection operation on any one of the multiple second devices, the first device sends a linkage display instruction to the selected second device based on the agent.

[0115] For example, Figure 7 is a schematic diagram of linking a second device according to an embodiment of the present application. Refer to Figure 7 , select a certain file (such as File 1). In the case of detecting a linkage display operation, the second devices that can be linked with the first device, such as a computer, an all-in-one machine, etc., are displayed on the search interface. In response to the selection operation on any one of the second devices, File 1 can be directly projected onto the second device with the same account. For example, when the user views the searched picture file on the mobile phone, the picture can be directly cast to other devices such as an all-in-one machine or a computer for large-screen display through the device linkage function.

[0116] In other embodiments, the intelligent agent can also provide intelligent reminders to the user. Specifically, a first device can determine at least one event related to the user from multiple applications based on the intelligent agent. These multiple applications originate from both the first and second devices. The first device then displays relevant information about the at least one event obtained by the intelligent agent from the multiple applications. This relevant information is used to prompt the user to perform at least one event. The relevant information for each event may include the time associated with the event (e.g., start time, end time), the event name, and the specific content of the event; this embodiment does not impose limitations on this. For any of the at least one events, if the intelligent agent detects new information related to the event in the multiple applications, it updates the relevant information for the event based on the new information obtained by the intelligent agent.

[0117] In other words, the intelligent agent's backend can automatically read information such as emails and schedules, and users can customize the refresh time. For example, Figure 8 This is a schematic diagram illustrating a display event according to an embodiment of this application. See also... Figure 8 The first device organizes the read events into a list and displays it. Users can adjust the size and position by dragging and dropping, or choose not to display it. After the user opens the smart agent, clicking the smart reminder button on the page will display the relevant reminder in the incomplete list. Clicking the complete button will move the reminder to the completed list.

[0118] Figure 9 This is a block diagram of a search device according to an embodiment of this application. The search device is used to perform the steps of the search method described above, see [link to relevant documentation]. Figure 9 The device includes:

[0119] The first display module 901 is used to display an application list in the agent-based search interface. The application list includes multiple target applications, which are respectively from a first device and a second device under the same account. Both the first device and the second device are running agents.

[0120] The second display module 902 is used to display, in response to a search operation for a target search term, the search results obtained by the agent based on the target search term in multiple target applications in the search interface.

[0121] In some embodiments, the first display module 901 is further configured to display multiple applications in the search interface based on an intelligent agent, the multiple applications being from a first device and a second device respectively, and the multiple applications supporting the intelligent agent in obtaining data within the application;

[0122] In response to the selection of multiple target applications among multiple applications, a list of applications containing multiple target applications is displayed in the agent-based search interface.

[0123] In some embodiments, the apparatus further includes:

[0124] The sending module is used to synchronize search results to a second device based on the intelligent agent. The second device is used to display the search results in the intelligent agent-based search interface after the intelligent agent is activated.

[0125] In some embodiments, the apparatus further includes:

[0126] The sending module is used to respond to the linked display operation of the search results. Based on the intelligent agent, it sends a linked display instruction to the second device indicated by the linked display operation. The second device is used to display the search results in the intelligent agent-based search interface in response to the linked display instruction.

[0127] In some embodiments, the number of second devices is multiple;

[0128] The sending module is used to respond to the linkage operation of the search results and display multiple second devices in the search interface; in response to the selection operation of any of the multiple second devices, it sends a linkage display command to the selected second device based on the intelligent agent.

[0129] In some embodiments, the target search term includes location information;

[0130] The device includes:

[0131] The storage module is used to store the location information at the time of data saving while saving any data item in any application of multiple target applications;

[0132] The second display module 902 is used to display the search results obtained by the agent based on location information in multiple target applications in the search interface in response to a search operation for a target search term.

[0133] In some embodiments, the apparatus further includes:

[0134] A determination module is used to determine, based on an intelligent agent, at least one event related to a user object from multiple applications, the multiple applications being respectively from a first device and a second device;

[0135] The third display module is used to display information about at least one event obtained by the intelligent agent from multiple applications. The information about at least one event is used to prompt the user object to perform at least one event.

[0136] In some embodiments, the apparatus further includes:

[0137] The update module is used to update the relevant information of the event based on the new information obtained by the agent if the agent detects new information related to the event in multiple applications for any event in at least one event.

[0138] In some embodiments, for any target application in the application list, the agent can call the data interface exposed by the target application to obtain data in the target application; or, the agent has screen capture permission of the target application and obtains data in the target application based on the screen capture permission; or, the agent can call the data interface exposed by the operating system on the device where the target application is located to obtain data in the target application.

[0139] This application provides a search device that can search for data from multiple applications on multiple devices through an intelligent agent, and aggregate the data found in multiple applications on multiple devices into search results and display them in the search interface. It can show the search results of multiple applications on multiple devices to the user at one time, which is simple to operate and does not require the user to frequently switch between multiple devices and applications to search, thereby improving search efficiency.

[0140] It should be noted that the search device provided in the above embodiments is only illustrated by the division of the above functional modules when running the application. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the search device and the search method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0141] In the embodiments of this application, the computer device can be configured as a terminal or a server. When the computer device is configured as a terminal, the terminal can act as the execution subject to implement the technical solutions provided in the embodiments of this application. When the computer device is configured as a server, the server can act as the execution subject to implement the technical solutions provided in the embodiments of this application. Alternatively, the technical solutions provided in this application can be implemented through the interaction between the terminal and the server. The embodiments of this application do not limit this.

[0142] The first and second devices are terminals. Figure 10 This is a structural block diagram of a terminal 1000 provided according to an embodiment of this application. The terminal 1000 can be a portable mobile terminal, such as a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), laptop computer, or desktop computer. The terminal 1000 may also be referred to as user equipment, portable terminal, laptop terminal, desktop terminal, or other names.

[0143] Typically, terminal 1000 includes a processor 1001 and a memory 1002.

[0144] Processor 1001 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1001 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1001 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1001 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the screen. In some embodiments, processor 1001 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0145] The memory 1002 may include one or more computer-readable storage media, which may be non-transitory. The memory 1002 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1002 are used to store at least one computer program, which is executed by the processor 1001 to implement the search method provided in the method embodiments of this application.

[0146] In some embodiments, the terminal 1000 may also optionally include a peripheral device interface 1003 and at least one peripheral device. The processor 1001, memory 1002, and peripheral device interface 1003 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1003 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1004, a display screen 1005, a camera assembly 1006, an audio circuit 1007, and a power supply 1008.

[0147] Peripheral device interface 1003 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1001 and memory 1002. In some embodiments, processor 1001, memory 1002 and peripheral device interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1001, memory 1002 and peripheral device interface 1003 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0148] The radio frequency (RF) circuit 1004 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1004 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1004 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. In some embodiments, the RF circuit 1004 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1004 can communicate with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1004 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0149] Display screen 1005 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1005 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1001 for processing. In this case, display screen 1005 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1005, disposed on the front panel of terminal 1000; in other embodiments, there may be at least two display screens, disposed on different surfaces of terminal 1000 or in a folded design; in still other embodiments, display screen 1005 may be a flexible display screen, disposed on a curved or folded surface of terminal 1000. Furthermore, display screen 1005 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1005 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0150] The camera assembly 1006 is used to acquire images or videos. In some embodiments, the camera assembly 1006 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1006 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash is a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0151] The audio circuit 1007 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1001 for processing, or input to the radio frequency circuit 1004 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1000. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1001 or the radio frequency circuit 1004 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1007 may also include a headphone jack.

[0152] The power supply 1008 is used to power the various components in the terminal 1000. The power supply 1008 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When the power supply 1008 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, while a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0153] In some embodiments, the terminal 1000 further includes one or more sensors 1009. The one or more sensors 1009 include, but are not limited to: an acceleration sensor 1010, a gyroscope sensor 1011, a pressure sensor 1012, an optical sensor 1013, and a proximity sensor 1014.

[0154] Accelerometer 1010 can detect the magnitude of acceleration along the three coordinate axes of a coordinate system established by terminal 1000. For example, accelerometer 1010 can be used to detect the components of gravitational acceleration along the three coordinate axes. Processor 1001 can control display screen 1005 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 1010. Accelerometer 1010 can also be used for games or for acquiring user motion data.

[0155] The gyroscope sensor 1011 can detect the orientation and rotation angle of the terminal 1000. The gyroscope sensor 1011 can work in conjunction with the accelerometer sensor 1010 to collect the user's 3D movements on the terminal 1000. Based on the data collected by the gyroscope sensor 1011, the processor 1001 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0156] The pressure sensor 1012 can be disposed on the side bezel of the terminal 1000 and / or on the lower layer of the display screen 1005. When the pressure sensor 1012 is disposed on the side bezel of the terminal 1000, it can detect the user's grip signal on the terminal 1000, and the processor 1001 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1012. When the pressure sensor 1012 is disposed on the lower layer of the display screen 1005, the processor 1001 can control the operable controls on the UI interface based on the user's pressure operation on the display screen 1005. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0157] An optical sensor 1013 is used to collect ambient light intensity. In one embodiment, the processor 1001 can control the display brightness of the display screen 1005 based on the ambient light intensity collected by the optical sensor 1013. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1005 is increased; when the ambient light intensity is low, the display brightness of the display screen 1005 is decreased. In another embodiment, the processor 1001 can also dynamically adjust the shooting parameters of the camera assembly 1006 based on the ambient light intensity collected by the optical sensor 1013.

[0158] The proximity sensor 1014, also known as a distance sensor, is typically installed on the front panel of the terminal 1000. The proximity sensor 1014 is used to detect the distance between the user and the front of the terminal 1000. In one embodiment, when the proximity sensor 1014 detects that the distance between the user and the front of the terminal 1000 is gradually decreasing, the processor 1001 controls the display screen 1005 to switch from a screen-on state to a screen-off state; when the proximity sensor 1014 detects that the distance between the user and the front of the terminal 1000 is gradually increasing, the processor 1001 controls the display screen 1005 to switch from a screen-off state to a screen-on state.

[0159] Those skilled in the art will understand that Figure 10 The structure shown does not constitute a limitation on terminal 1000 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0160] Figure 11This is a schematic diagram of a server structure according to an embodiment of this application. The server 1100 can vary considerably due to different configurations or performance. It may include one or more Central Processing Units (CPUs) 1101 and one or more memories 1102. The memory 1102 stores at least one computer program, which is loaded and executed by the processor 1101 to implement the search methods provided in the various method embodiments described above. Of course, the server may also have wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The server may also include other components for implementing device functions, which will not be elaborated here.

[0161] This application also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor of a computer device to implement the operations performed by the computer device in the search method of the above embodiments. For example, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, or optical data storage device, etc.

[0162] In some embodiments, the computer program involved in the present application embodiments may be deployed and executed on a computer device, or executed on multiple computer devices located in one location, or executed on multiple computer devices distributed in multiple locations and interconnected through a communication network. Multiple computer devices distributed in multiple locations and interconnected through a communication network may constitute a blockchain system.

[0163] This application also provides a computer program product, including a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the search methods provided in the various optional implementations described above.

[0164] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0165] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A search method, characterized in that, Applied to a first device, the method includes: In the agent-based search interface, an application list is displayed, which includes multiple target applications. These multiple target applications come from the first device and the second device under the same account. The agent is running on both the first device and the second device. In response to a search operation targeting a specific search term, the search results obtained by the agent based on the target search term in the multiple target applications are displayed in the search interface.

2. The method according to claim 1, characterized in that, The method further includes: Based on the intelligent agent, multiple applications are displayed in the search interface. These multiple applications are respectively from the first device and the second device, and the multiple applications support the intelligent agent in obtaining data within the applications. The application list displayed in the agent-based search interface includes: In response to the selection of multiple target applications among the multiple applications, a list of applications containing the multiple target applications is displayed in the agent-based search interface.

3. The method according to claim 1, characterized in that, The method further includes: Based on the intelligent agent, the search results are synchronized to the second device, which is used to display the search results in a search interface based on the intelligent agent after the intelligent agent is activated.

4. The method according to claim 1, characterized in that, The method further includes: In response to the linked display operation of the search results, based on the intelligent agent, a linked display instruction is sent to a second device indicated by the linked display operation, and the second device is used to display the search results in the search interface based on the intelligent agent in response to the linked display instruction.

5. The method according to claim 4, characterized in that, There are multiple such devices; The response to the linked display operation of the search results, based on the intelligent agent, involves sending a linked display instruction to the second device indicated by the linked display operation, including: In response to the linked operation of the search results, multiple second devices are displayed in the search interface; In response to the selection operation of any one of the plurality of second devices, the linkage display instruction is sent to the selected second device based on the intelligent agent.

6. The method according to claim 1, characterized in that, The target search term includes location information; The method further includes: While saving any data item within any application of the plurality of target applications, the location information at the time of saving the data is also stored; In response to a search operation targeting a search term, the search interface displays the search results obtained by the agent based on the target search term in multiple target applications, including: In response to a search operation targeting a search term, the search results obtained by the agent based on the location information in the multiple target applications are displayed in the search interface.

7. The method according to claim 1, characterized in that, The method further includes: Based on the intelligent agent, at least one event related to the user object is determined from multiple applications, which are respectively from the first device and the second device; The information related to at least one event obtained by the agent from the plurality of applications is displayed, and the information related to the at least one event is used to prompt the user object to perform the at least one event.

8. The method according to claim 7, characterized in that, The method further includes: For any of the at least one event, if the agent detects new information related to the event in the plurality of applications, then the relevant information of the event is updated based on the new information obtained by the agent.

9. The method according to claim 1, characterized in that, For any target application in the application list, the agent can call the data interface opened by the target application to obtain data in the target application; or, the agent has screen capture permission for the target application and obtains data in the target application based on the screen capture permission; or, the agent can call the data interface opened by the operating system on the device where the target application is located to obtain data in the target application.

10. A search device, characterized in that, Deployed in a first device, the device includes: The first display module is used to display an application list in an agent-based search interface. The application list includes multiple target applications, which are respectively from the first device and the second device under the same account. The agent is running on both the first device and the second device. The second display module is used to display, in response to a search operation for a target search term, the search results obtained by the agent based on the target search term in the multiple target applications in the search interface.

11. A computer device, characterized in that, The computer device includes a processor and a memory, the memory being used to store at least one computer program, the at least one computer program being loaded by the processor and executed as the search method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store at least one computer program for performing the search method according to any one of claims 1 to 9.

13. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the search method as described in any one of claims 1 to 9.

Images