Image searching method and device

Abstract

The invention discloses an image searching method and device, and belongs to the technical field of electronic equipment. The method comprises the steps of receiving a first input for a first application interface under the condition that the first application interface is displayed; in response to the first input, displaying an interface window corresponding to the first application interface, the interface window including an identifier of at least one image, and the at least one image being obtained by searching based on an application type corresponding to the first application interface; receiving a second input of the identification of the first image in the interface window; and displaying the first image in the first application interface in response to the second input.

Description

Technical Field

[0001] This application belongs to the field of electronic equipment technology, and specifically relates to an image search method and apparatus. Background Technology

[0002] Currently, images stored in electronic devices are often diverse and numerous, and users frequently need to use images stored on their phones in a particular application.

[0003] Typically, if a user needs to use an image stored on their phone in an application, they can open the Photos app and enter a description of the image in the search box on the app's interface. This allows the phone to search for the desired image in the album, and the user can then trigger the phone to open the application and use the found image.

[0004] However, the above process requires users to go through multiple cumbersome steps and switch back and forth between the photo album application and the application that needs to use the image in order to use the required image in the application. Therefore, the process of using the image in the application is cumbersome and inefficient. Summary of the Invention

[0005] The purpose of this application is to provide an image search method and apparatus that can improve the efficiency of image search in electronic devices.

[0006] In a first aspect, embodiments of this application provide an image search method, the method comprising: receiving a first input to the first application interface when the first application interface is displayed; displaying an interface window of the first application interface in response to the first input, the interface window including an identifier of at least one image, the at least one image being obtained by searching based on an application type corresponding to the first application interface; receiving a second input to the identifier of the first image in the interface window; and displaying the first image in the first application interface in response to the second input.

[0007] Secondly, embodiments of this application provide an image search device, comprising a receiving module and a display module. The receiving module is configured to receive a first input to the first application interface when the first application interface is displayed. The display module is configured to display an interface window corresponding to the first application interface in response to the first input received by the receiving module. The interface window includes an identifier for at least one image, which is obtained by searching based on the application type corresponding to the first application interface. The receiving module is further configured to receive a second input to the identifier of the first image in the interface window. The display module is further configured to display a first image in the first application interface in response to the second input received by the receiving module.

[0008] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions, when executed by the processor, implement the steps of the method described in the first aspect.

[0009] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0010] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0011] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0012] In this embodiment, when displaying a first application interface, a first input to the first application interface is received; in response to the first input, an interface window corresponding to the first application interface is displayed, the interface window including an identifier of at least one image, the at least one image being obtained based on the application type corresponding to the first application interface; a second input to the identifier of the first image in the interface window is received; in response to the second input, the first image is displayed in the first application interface. In this solution, through user input in the first application interface, the electronic device can directly search for at least one image in other applications that matches the application type corresponding to the first application interface, and display the identifier of the at least one image in the first application interface corresponding to the first application interface. This allows the user to determine the image they require based on the at least one identifier. In other words, the electronic device can directly display an image in the first application interface that matches the application type of the first application interface without switching application interfaces, reducing the image search process and thus improving the efficiency of image search by the electronic device. Attached Figure Description

[0013] Figure 1 This is one of the flowcharts of the image search method provided in the embodiments of this application;

[0014] Figure 2 This is one of the schematic diagrams of the interface window provided in the embodiments of this application;

[0015] Figure 3 This is the second flowchart of the image search method provided in the embodiments of this application;

[0016] Figure 4 This is a second schematic diagram of the interface window provided in the embodiments of this application;

[0017] Figure 5 This is the third schematic diagram of the interface window provided in the embodiments of this application;

[0018] Figure 6 This is the third flowchart of the image search method provided in the embodiments of this application;

[0019] Figure 7 This is the fourth schematic diagram of the interface window provided in the embodiments of this application;

[0020] Figure 8 This is the fifth schematic diagram of the interface window provided in the embodiments of this application;

[0021] Figure 9 This is the sixth schematic diagram of the interface window provided in the embodiments of this application;

[0022] Figure 10 This is the seventh schematic diagram of the interface window provided in the embodiments of this application;

[0023] Figure 11 This is the fourth flowchart of the image search method provided in the embodiments of this application;

[0024] Figure 12 This is the fifth flowchart of the image search method provided in the embodiments of this application;

[0025] Figure 13 This is the sixth flowchart of the image search method provided in the embodiments of this application;

[0026] Figure 14 This is a schematic diagram of the image search device provided in an embodiment of this application;

[0027] Figure 15 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0028] Figure 16 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0029] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0030] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0031] The terms "at least one," "at least one," etc., in this application refer to any one, any two, or a combination of two or more of the included objects. For example, at least one of a, b, and c can mean: "a," "b," "c," "a and b," "a and c," "b and c," and "a, b, and c," where a, b, and c can be single or multiple. Similarly, "at least two" refers to two or more, and its meaning is similar to that of "at least one."

[0032] The following explains some concepts and terms involved in the image search method and apparatus provided in the embodiments of this application.

[0033] Identifiers: In this application, identifiers are text, symbols, images, etc. used to indicate information. They can be used as carriers for displaying information, including but not limited to text identifiers, image identifiers, symbol identifiers, etc.

[0034] In this embodiment, an electronic device may have multiple applications installed, and icons of these applications may be displayed on the device's home screen. The applications in this embodiment may be embedded applications (i.e., system applications of the electronic device) or downloadable applications. Embedded applications are applications provided as part of the electronic device's implementation. Downloadable applications are applications that can provide their own Internet Protocol Multimedia Subsystem (IMS) connectivity. These downloadable applications may be pre-installed on the electronic device or third-party applications downloaded and installed by the user. As an example, applications may include: social networking applications, image management applications (e.g., photo albums), map applications (e.g., maps), browser applications, music applications, etc.

[0035] The main screen of an electronic device can also be called the desktop or main interface. This main screen may include one or more sub-screens, which can be used to display control elements. Alternatively, the desktop of the electronic device may include one or more pages. Users can switch between different sub-screens by swiping left or right. A control is a graphical user interface (GUI) element; it is a software component contained within an application that controls all the data processed by the application and the interactive operations related to that data. Users can interact with controls through direct manipulation, thereby reading or editing information related to the application. Generally, controls can include icons (such as application icons or folder icons on an electronic device), buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0036] Interface: This refers to the visual interface through which users interact with electronic devices, such as mobile phones. It serves as the medium for information presentation and input / output within a hardware or software system. Electronic devices can display an interface on a screen, allowing users to interact with the device through touch, clicks, or gestures. The interface can include elements such as icons, buttons, menus, text, and labels.

[0037] User Interface (UI): The user interface (UI) serves as the bridge for interaction and communication between the system and the user. User interface design refers to the style settings of the graphical user interface, including color schemes, content arrangement, and layout. It encompasses not only the graphical interfaces of commonly seen desktop and mobile systems, but also emerging interaction methods such as touchscreens, motion sensing, and voice control. The three main principles of user interface design are consistency, flexibility, and simplicity.

[0038] Controls: A control (also called a part, component, widget, or control) is a graphical user interface element. It is a basic building block of the user interface, such as a window or text box, and is displayed in the program interface of any application. Controls can be buttons, text boxes, labels, etc., and are used to control all the data processed by each application and the interactive operations on that data.

[0039] Multimodal: Multimodality refers to the multiple forms of data or information. A single piece of information can exist in multiple forms. To enable computers to analyze internet data and simulate human cognition, multimodal information processing technologies have emerged to handle multiple modalities of data simultaneously. In current artificial intelligence tasks, multimodality primarily refers to support for 3V tasks: Verbal, Vocal, and Visual. Many classic deep learning tasks are based on the conversion between these three tasks. For example, image generation generates images from text descriptions, and conversely, image description generates text from images. Multimodal learning is a method that utilizes multimodal data, which may include text, images, audio, and video. By fusing multiple data modalities to train the model, it improves the model's perception and understanding capabilities, achieving cross-modal information interaction and fusion.

[0040] Optical Character Recognition (OCR) refers to the process by which electronic devices (such as scanners or digital cameras) examine characters printed on paper, determine their shapes by detecting dark and light patterns, and then translate the shapes into computer text using character recognition methods.

[0041] The image search method and apparatus provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0042] The embodiments of this application can be applied to image viewing scenarios. For example, in scenario 1, a user needs to view personal identification information in a document application; or in scenario 2, a user needs to view an image containing poetry in an image editing application.

[0043] Scenario 1: When a user needs to view their personal ID number in a document application, the user can slide to input the information on the document application interface, causing the electronic device to display a pop-up window on the document application interface. This pop-up window includes a thumbnail of at least one image stored in the photo album application. The user can click on the thumbnail corresponding to the ID card image to input the information, causing the electronic device to display the ID card image, from which the user can view the ID card number they need.

[0044] Scenario 2: When a user needs to view an image containing a poem in an image editing application, the user can slide input on the image editing application interface to display a pop-up window on the electronic device. This pop-up window includes thumbnails of at least one image stored in the photo album application. The user can click on the thumbnail corresponding to the image containing the poem to display the image containing the poem on the electronic device. Thus, the user can view the poem they need from the image containing the poem and add it to the edited image.

[0045] It should be noted that the above scenarios 1 and 2 are merely exemplary examples of some scenarios that may be applied to the embodiments of this application. In actual implementation, the embodiments of this application can also be applied to more scenarios with any possible requirements, and the embodiments of this application are not limited here.

[0046] This application provides an image search method. By inputting data in a first application interface, an electronic device can directly search for at least one image in other applications that matches the application type corresponding to the first application interface, and display the identifier of the at least one image in the first application interface. The image requested by the user can be determined based on the at least one identifier. In other words, the electronic device can directly display images in other applications that match the application type of the first application interface in the first application interface with a single input, without having to switch application interfaces. This reduces the process of searching for images and improves the efficiency of image searching by the electronic device.

[0047] The image search method provided in this application can be executed by an image search device, which can be an electronic device, or a functional module or functional entity within an electronic device. The following description uses a first electronic device as an example to illustrate the technical solution provided in this application.

[0048] Figure 1 A flowchart of an image search method provided in an embodiment of this application is shown, such as... Figure 1 As shown, the image search method provided in this application embodiment may include the following steps 201 to 204.

[0049] Step 201: When the first application interface is displayed, the first electronic device receives the first input to the first application interface.

[0050] Optionally, in this embodiment of the application, the first electronic device may be a mobile phone or a watch with communication function.

[0051] Optionally, in this embodiment of the application, the first application interface can be any application interface of any application in the first electronic device.

[0052] For example, the above-mentioned application can be any of the following: instant messaging application, image editing application, or document application, etc. The specific application can be determined according to actual usage needs, and this application embodiment does not impose any limitations.

[0053] For example, the first application interface described above can be any of the following: a chat interface, a document interface, or an image editing interface, etc. The specific interface can be determined according to actual usage needs, and this application embodiment does not impose any limitations.

[0054] In this embodiment of the application, the first input is used to trigger the first electronic device to search for at least one image in the first electronic device.

[0055] Optionally, in this embodiment of the application, the first application interface may include an image search control, and the first input may be the user's input to the image search control.

[0056] For example, the first input mentioned above can be a user's click input on the image search control using a touch device such as a finger or stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs. The specific input can be determined according to actual usage needs, and this application embodiment does not limit it.

[0057] Optionally, in the embodiments of this application, the aforementioned specific gesture can be any one of a single-click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, or a double-tap gesture.

[0058] Optionally, in the embodiments of this application, the above-mentioned click input can be single-click input, double-click input, or any number of click inputs, or it can be long-press input or short-press input.

[0059] For example, the first input mentioned above can be: the user's click input on the image search control mentioned above.

[0060] Step 202: The first electronic device responds to the first input and displays the interface window corresponding to the first application interface.

[0061] In this embodiment of the application, the interface window includes the identifier of at least one image, which is obtained by searching based on the application type corresponding to the first application interface.

[0062] Optionally, in the embodiments of this application, the above-mentioned identifier may include at least one of the following: text identifier, special symbol identifier, emoticon identifier, or thumbnail identifier.

[0063] Preferably, the above-mentioned identifier can be a thumbnail identifier.

[0064] Optionally, in this embodiment of the application, the at least one image can be obtained by the first electronic device from any application other than the application corresponding to the first application interface; or the at least one image can be obtained by the first electronic device from the application corresponding to the first application interface; or the at least one image can be obtained by the second electronic device.

[0065] For example, the other applications mentioned above could be photo album applications.

[0066] Optionally, in this embodiment, the first electronic device may display the interface window via a pop-up window in the first application interface; or the first electronic device may add a layer to the first application interface to display the interface window in that layer; or the first electronic device may display the interface window via a sidebar in the first application interface. The specific method can be determined according to actual usage requirements, and this embodiment does not impose any limitations.

[0067] Optionally, in this embodiment of the application, the first electronic device can obtain the application type corresponding to the first application interface through the first model.

[0068] Optionally, in the embodiments of this application, the first model mentioned above can be any of the following: a neural network model or an artificial intelligence (AI) model.

[0069] For example, the first electronic device can take a screenshot of the first application interface to obtain a first screenshot, and then input the first screenshot into a neural network model. The neural network model can perform OCR recognition on the first screenshot to obtain the interface information in the first screenshot, and perform classification processing through the interface information to obtain the application type corresponding to the first application interface.

[0070] For example, the above interface information may include at least one of the following: interface name, interface content, control names in the interface, interface layout, etc.

[0071] Optionally, in this embodiment of the application, the above-mentioned application type can be any of the following: image editing, shopping, document, or chat.

[0072] It should be noted that the images involved in the embodiments of this application are images in a broad sense, that is, the image can be a video or a picture.

[0073] For example, the above image can be a dynamic photo or GIF.

[0074] Optionally, in this embodiment of the application, the first electronic device may display at least one image identifier in the first display area of ​​the interface window.

[0075] For example, in conjunction with scenario 1, such as Figure 2 As shown, taking a mobile phone as the first electronic device, the user can click and input the image search control in the document application interface, so that the phone can search for three images in the photo album application that match the application type of the document application interface, and display the thumbnails of the three images. Figure 2 (Indicated by 1, 2, 3) are displayed in the first display area 11 of the interface window 10.

[0076] Step 203: The first electronic device receives a second input indicating the identifier of the first image in the interface window.

[0077] In this embodiment of the application, the second input is used to trigger the first electronic device to display the first image.

[0078] Optionally, in this embodiment, the second input can be a user clicking on the identifier of the first image using a touch device such as a finger or stylus, a voice command input by the user, a specific gesture input by the user, or other feasible inputs. The specific input can be determined according to actual usage needs, and this embodiment does not limit it.

[0079] Optionally, in this embodiment of the application, the identifier of the first image can be one or more of the identifiers of at least one image.

[0080] Step 204: The first electronic device responds to the second input and displays the first image in the first application interface.

[0081] Optionally, in this embodiment of the application, the first electronic device may display the first image in the first application interface through a pop-up window; or, the first electronic device may display the first image in the first application interface through a layer.

[0082] Optionally, in this embodiment of the application, when there are multiple first images, the first electronic device can display multiple first images in the first application interface through a pop-up window, and the multiple first images can be switched in the pop-up window by sliding input.

[0083] In the image search method provided in this application embodiment, when a first application interface is displayed, a first electronic device can receive a first input to the first application interface; then, in response to the first input, an interface window is displayed, the interface window including the identifier of at least one image, the at least one image being obtained based on the application type corresponding to the first application interface; next, a second input is received regarding the identifier of the first image in the interface window; finally, in response to the second input, the first image is displayed in the first application interface. In this solution, through user input in the first application interface, the electronic device can directly search for at least one image in other applications that matches the application type corresponding to the first application interface, and display the identifier of the at least one image in the first application interface, thereby determining the image requested by the user based on the at least one identifier. In other words, the electronic device can directly display images in other applications that match the application type of the first application interface in the first application interface with a single input, without needing to switch application interfaces, reducing the image search process and thus improving the efficiency of image search by the electronic device.

[0084] Optionally, in the embodiments of this application, combined with Figure 1 ,like Figure 3 As shown, before the “display interface window” in step 202 above, the image search method provided in this application embodiment further includes the following steps 301 and 302.

[0085] Step 301: The first electronic device generates a first search tag based on the application type corresponding to the first application interface.

[0086] Optionally, in this embodiment of the application, the first electronic device can input the application type into the second model to obtain the first search tag.

[0087] For example, the second model described above can be any of the following: a Natural Language Processing (NLP) model or a large language model. The specific model can be determined according to actual usage requirements, and this application embodiment does not impose any limitations.

[0088] For example, taking the second model as an NLP model, the first search tag is obtained through the following three methods.

[0089] Method 1: The first electronic device can input the application type into the NLP model, which can use the search tags that match the application type in the preset tag template library as the first search tags.

[0090] Optionally, in this embodiment of the application, the search tag that matches the application type can be a search tag in the tag template library whose relevance to the application type is greater than or equal to a first threshold.

[0091] For example, the first threshold mentioned above can be 80%, 90%, or 95%. The specific threshold can be determined according to actual usage requirements, and this application embodiment does not impose any restrictions.

[0092] Method 2: The first electronic device can input the application type into the NLP model. The NLP model can use the Transformer architecture to encode the application type and generate a label sequence. Then, through a multi-task learning algorithm, the search label with the highest probability value in the label sequence is determined as the first search label.

[0093] Method 3: The first electronic device can input the application type into the NLP model. The NLP model can first retrieve historical tags of similar interfaces. If the correlation between the historical tag and the application type is less than the first threshold mentioned above, the application type is input into the Transformer architecture to obtain the first search tag.

[0094] Step 302: The first electronic device searches for at least one image based on the first search tag.

[0095] In this embodiment of the application, the interface window also includes a first search tag.

[0096] Optionally, in this embodiment of the application, the first electronic device may display the first search tag in the second display area of ​​the interface window.

[0097] It is understandable that the first search tag mentioned above can be the name of the interface window.

[0098] For example, combined Figure 2 ,like Figure 4 As shown, the mobile phone can display the first search tab in the second display area 12 of the interface window 10. Figure 4 Take the scenery of China and Israel as an example.

[0099] Optionally, in this embodiment of the application, the first electronic device can obtain the image content of all images in the photo album application through an OCR algorithm, and then determine the image content corresponding to the image content of all images whose correlation with the first search tag is greater than or equal to the first threshold as at least one image.

[0100] Optionally, in this embodiment of the application, the first electronic device can input all the images in the photo album application into the first model, obtain the image content of all the images in the photo album application through the first model, and then determine the image content corresponding to the image content of all the images whose correlation with the first search tag is greater than or equal to the first threshold as at least one image.

[0101] In this embodiment of the application, the first electronic device can search for at least one image through the first search tag corresponding to the first application interface, and can filter out images that the user does not need, thereby improving the accuracy of the first electronic device in searching for images.

[0102] Optionally, in this embodiment of the application, the interface window may also include an input control.

[0103] Optionally, in this embodiment of the application, the input control can be any of the following: a text input box, a voice input box, a drawing input box, or a selection input box.

[0104] For example, combined Figure 4 ,like Figure 5 As shown, the interface window 10 includes a text input box 13, a voice input box 14, a drawing input box 15, and a selection input box 16.

[0105] For example, combined Figure 1 ,like Figure 6 As shown, after step 202 above, the image search method provided in this application embodiment further includes steps 401 to 403 as described below.

[0106] Step 401: The first electronic device receives a third input of image description information in the input control.

[0107] In this embodiment of the application, the third input is used to trigger the first electronic device to update the first search tag.

[0108] Optionally, in this embodiment of the application, when the input box is a text input box, the third input can be text input by the user to enter image description information in the input box.

[0109] Optionally, in this embodiment of the application, when the input box is a voice input box, the third input can be voice input by the user to input image description information in the input box.

[0110] For example, the first electronic device can convert the user's speech into text using an Automatic Speech Recognition (ASR) algorithm to obtain image description information.

[0111] Optionally, in this embodiment of the application, the first electronic device may acquire the user's voice through a microphone in the first electronic device.

[0112] Optionally, in this embodiment of the application, when the above-mentioned input box is a drawing input box, the above-mentioned third input can be a drawing input in which the user enters image description information in the input box.

[0113] For example, combined Figure 5 ,like Figure 7 As shown, the user can click on the drawing input box 15 to input, so that the mobile phone can display the drawing area 17 in the interface window 10. The user can then draw in the drawing area 17, and the mobile phone can perform graphic recognition on the user's drawing to obtain image description information.

[0114] Optionally, in this embodiment of the application, when the above input box is a selection input box, the third input can be a selection input in which the user enters image description information in the input box.

[0115] For example, combined Figure 5 ,like Figure 8 As shown, after the user inputs into the selection input box 16, the first electronic device can display the second image. Then, the user can select the object in any image of the second image, so that the first electronic device can perform graphic recognition on the image area selected by the user to obtain image description information.

[0116] Optionally, in this embodiment of the application, the second image described above can be one or more.

[0117] Optionally, in this embodiment, the second image can be preset by the first electronic device or user-defined. The specific image can be determined according to actual usage requirements, and this embodiment does not impose any limitations.

[0118] Optionally, in this embodiment of the application, the first electronic device can search for at least one image based on the first search tag and image description information.

[0119] For example, the first electronic device can search for all images matching the first search tag in a photo album application based on the first search tag; and then filter at least one image that matches the image description information from all the images based on the image description information.

[0120] For example, if the first electronic device determines that the first search tag is "travel" and the image description information is "recent trip", the first electronic device can search for all images that match the "travel" tag in the photo album application, and then filter out the image whose travel time is closest to the current time from all the images based on the image description information "recent trip" to obtain at least one of the above images.

[0121] In this way, the first electronic device can improve the flexibility of acquiring search emojis through multimodal input.

[0122] Step 402: In response to the third input, the first electronic device generates a second search tag based on the image description information and updates the first search tag in the interface window to the second search tag.

[0123] It should be noted that the process by which the first electronic device generates the second search tag based on the image description information can be found in the above embodiments, and will not be repeated here to avoid repetition.

[0124] In this embodiment of the application, the first electronic device can deselect the first search tag in the second display area and display the second search tag in the second display area.

[0125] For example, combined Figure 4 ,like Figure 9 As shown, the mobile phone can replace the "landscape" search tag displayed in the second display area 12 with the "people" search tag.

[0126] Step 403: The first electronic device searches for M images based on the second search tag, and updates the identifier of at least one image in the interface window to the identifier of the M images, where M is a positive integer.

[0127] It should be noted that the specific process by which the first electronic device searches for M images based on the second search tag can be found in the above embodiments, and will not be repeated here to avoid repetition.

[0128] In this embodiment of the application, the first electronic device can deselect the identifier of at least one image in the first display area and display the identifiers of M images in the first display area.

[0129] For example, combined Figure 9 ,like Figure 10 As shown, the mobile phone can replace the three landscape images displayed in the first display area 11 with three images containing people.

[0130] In this embodiment, the first electronic device can update the images displayed in the interface window in real time according to the update of the search tags, which improves the flexibility of the first electronic device in displaying images. Furthermore, through intelligent scene recognition and multimodal input, it can accurately filter images that meet the scene requirements, thereby improving the accuracy of the first electronic device in acquiring images.

[0131] Optionally, in the embodiments of this application, combined with Figure 6 ,like Figure 11 As shown, the step 403 above, "updating the identifier of at least one image in the interface window to the identifiers of M images", can be specifically implemented through the following step 403a.

[0132] Step 403a: The first electronic device updates the identifier of at least one image in the interface window to the identifiers of M images arranged in a first order.

[0133] In this embodiment of the application, the first order is determined based on the matching degree between the M images and the second search tag.

[0134] Optionally, in this embodiment of the application, the first electronic device can obtain the matching degree between each of the M images and the second search tag, so that the higher the matching degree, the higher the display position of the image in the first display area.

[0135] Optionally, in this embodiment of the application, the first electronic device can perform image recognition on each of the M images to obtain the image feature information corresponding to each image, and then calculate the similarity between the image feature information corresponding to each image and the second search tag, thereby obtaining the matching degree between each image and the second search tag.

[0136] In this embodiment of the application, the first electronic device can determine the display position of the M image identifiers in the interface window based on the matching degree between the M images and the second search tag, so that users can quickly find the images they need.

[0137] Optionally, in this embodiment of the application, the first search tag is a privacy-related tag.

[0138] For example, the aforementioned privacy tags can be any of the following: ID card tags, bank balance tags, personal address tags, etc. The specific tags can be determined according to actual usage needs, and this application embodiment does not impose any limitations.

[0139] For example, combined Figure 1 ,like Figure 12 As shown, step 204 above can be implemented through step 204a below.

[0140] Step 204a: The first electronic device responds to the second input, performs privacy processing on the first image, and displays the privacy-processed first image in the first application interface.

[0141] Optionally, in this embodiment, the privacy processing described above can be any of the following: adding a mosaic to the first image, adding a layer to the first image, or adding an emoji to the first image. The specific method can be determined according to actual usage needs, and this embodiment does not impose any limitations.

[0142] Optionally, in this embodiment of the application, the first electronic device can identify privacy information in the first image and perform privacy processing only on the privacy information.

[0143] Optionally, in this embodiment of the application, the first electronic device may display the privacy-processed first image in the first application interface through a pop-up window; or, the first electronic device may display the privacy-processed first image in the first application interface through a layer.

[0144] In this embodiment of the application, the first electronic device can perform privacy processing on the privacy information in the first image to avoid the risk of privacy leakage.

[0145] Optionally, in this embodiment of the application, the image search method provided in this embodiment of the application further includes the following step 501.

[0146] Step 501: The first electronic device determines whether the first search tag is a privacy-related tag based on the first information.

[0147] In this embodiment of the application, the first information includes at least one of the following: the application type corresponding to the first application interface, the interface elements in the first application interface, and the operation event corresponding to the first input.

[0148] For example, if the application type corresponding to the first application interface is a payment type or a financial type, the first electronic device can determine that the first search tag is a privacy type tag.

[0149] For example, the first electronic device can obtain the application type corresponding to the first application interface through the application programming interface (API) in the operating system.

[0150] For example, the first electronic device can obtain the application type corresponding to the first application interface from the application installation package of the application corresponding to the first application interface through an API.

[0151] It should be noted that the application type corresponding to the first application interface mentioned above can be understood as the application type of the application program corresponding to the first application interface.

[0152] Optionally, in this embodiment of the application, the above-mentioned interface elements may include at least one of the following: control name, control type, or interface content, etc.

[0153] For example, the interface content may include at least one of the following: links, text, audio or video, etc.

[0154] For example, if the interface elements in the first application interface include payment controls or payment links, the first electronic device can determine that the first search tag is a privacy-related tag.

[0155] Optionally, in this embodiment of the application, the above-mentioned operation event can be any of the following: the user clicks the upload control, the user clicks the image search control, or the user clicks the payment control, etc.

[0156] For example, when a user clicks on a payment control, the first electronic device can determine that the first search tag is a privacy-related tag.

[0157] Optionally, in this embodiment of the application, if the first electronic device determines that the first search tag is a privacy-related tag, the first electronic device may perform privacy processing on the image found according to the first search tag; or, if the first electronic device determines that the first search tag is a non-privacy-related tag, the first electronic device may directly display the image found according to the first search tag.

[0158] Optionally, in this embodiment of the application, when the first electronic device determines that the first search tag is a privacy tag, the first electronic device may display a first identifier in the interface window, which is used to indicate that the image displayed in the user interface window is a privacy image.

[0159] Optionally, in this embodiment of the application, after the first electronic device determines the privacy image, the privacy image can be filtered according to a first method to obtain at least one of the above-mentioned images.

[0160] Optionally, in the embodiments of this application, the first method described above can be any of the following: filtering privacy images that do not contain a background environment or privacy images with image clarity greater than or equal to a first threshold, etc.

[0161] Optionally, in this embodiment, the first electronic device can provide an optional privacy protection operation, prompting the user whether they need to blur non-document areas to protect privacy. For example, if the ID photos provided by the album contain other personal privacy content, such as home environment, and the uploader has not explicitly restricted this, the user can optionally blur the non-document areas to protect privacy.

[0162] In this embodiment, the first electronic device can reduce the risk of privacy leakage and enhance user trust in highly sensitive scenarios such as finance and government affairs. At the same time, it can reduce manual operation steps through automated processes, thereby achieving a balance between security and ease of use.

[0163] Optionally, in this embodiment of the application, the "receiving the first input to the first application interface" in step 201 can be specifically implemented by step 201a, and before the "displaying the interface window" in step 202, the image search method provided in this embodiment of the application further includes steps 601 and 602, and the "displaying the interface window" in step 202 can be specifically implemented by step 701.

[0164] Step 201a: The first electronic device receives the first input of image description information in the first application interface.

[0165] It should be noted that the specific implementation process of step 201a above can be found in the above embodiments, and will not be repeated here to avoid repetition.

[0166] Step 601: The first electronic device responds to the first input and sends image description information to the second electronic device.

[0167] Optionally, in this embodiment of the application, the second electronic device may be any of the following: a mobile phone, a watch, or a server.

[0168] Optionally, in this embodiment of the application, the first electronic device can send image description information to the second electronic device via Wireless Fidelity (Wi-Fi) or Bluetooth.

[0169] Optionally, in this embodiment of the application, after receiving the image description information, the second electronic device may search for at least one image that matches the image description information in the second electronic device and send the at least one image to the first electronic device.

[0170] Step 602: The first electronic device receives at least one image sent by the second electronic device.

[0171] In this embodiment of the application, the above-mentioned at least one image is obtained by the second electronic device based on the image description information and the application type corresponding to the first application interface.

[0172] Optionally, in this embodiment of the application, the first electronic device can receive at least one image sent by the second electronic device via Wi-Fi or Bluetooth.

[0173] Step 702: The first electronic device is based on at least one image display interface window.

[0174] In this embodiment of the application, the first electronic device can directly display at least one image sent by the second electronic device in the interface window.

[0175] Optionally, in this embodiment of the application, the first electronic device may store at least one image sent by the second electronic device in a photo album application.

[0176] Optionally, in this embodiment of the application, if at least one image sent by the second electronic device contains a privacy image, the first electronic device may perform privacy processing on the privacy image and store the privacy-processed privacy image in a photo album application or display it in an interface window.

[0177] For example, the following explanation will focus on specific sending scenarios to illustrate steps 201a to 702.

[0178] Scenario 1: When the first electronic device is a mobile phone and the second electronic device is a watch, the mobile phone can send image description information to the watch. Then, the watch can search for at least one image that matches the image description information and send the at least one image to the mobile phone, so that the mobile phone can display at least one image in the interface window.

[0179] Scenario 2: When the first electronic device is a mobile phone and the second electronic device is a server, the mobile phone can send image description information to the server. Then, the server can search for at least one image that matches the image description information in the server and send the at least one image to the mobile phone, so that the mobile phone can display at least one image in the interface window.

[0180] Scenario 3: When the first electronic device is a mobile phone (hereinafter referred to as the first mobile phone) and the second electronic device is a mobile phone (hereinafter referred to as the second mobile phone), the first mobile phone can send image description information to the second mobile phone. Then, the second mobile phone can search for at least one image that matches the image description information in the second mobile phone and send the at least one image to the first mobile phone, so that the first mobile phone can display at least one image in the interface window.

[0181] Scenario 4: When the first electronic device is a watch and the second electronic device is a mobile phone, the watch can send image description information to the mobile phone. Then, the mobile phone can search for at least one image that matches the image description information in the mobile phone and send the at least one image to the watch, so that the watch can display at least one image in the interface window.

[0182] Scenario 5: When the first electronic device is a watch and the second electronic device is a server, the watch can send image description information to the server. Then, the server can search for at least one image that matches the image description information in the server and send the at least one image to the watch, so that the watch can display at least one image in the interface window.

[0183] In this embodiment of the application, the first electronic device can determine at least one image based on the image stored in the second electronic device, thereby improving the flexibility of the first electronic device in acquiring images.

[0184] For example, such as Figure 13 As shown below, the image search method provided in this application embodiment will be explained in detail through specific examples. Specifically, it can be implemented through the following steps 1 to 5.

[0185] Step 1: The first electronic device triggers scene recognition.

[0186] In this embodiment, the aforementioned trigger scene recognition can be detected by the user clicking on the image selection control or uttering a wake word, such as "help me find photos." At this time, the first electronic device can display a multimodal input overlay interface, i.e., the aforementioned interface window.

[0187] For example, combined Figure 9 As shown, the multimodal input overlay interface includes a voice input box, a text input box, a sketching area, and an image selection area. Users can activate any of these input channels according to their needs.

[0188] Step 2: The first electronic device parses and semantically expands the image description information input by the user.

[0189] Optionally, in this embodiment of the application, the semantic expansion described above can be performed as follows if the first electronic device detects text input:

[0190] 1. Use NLP and other technologies to identify and extract core tags, such as "travel".

[0191] 2. Supplement semantics by combining context, for example, automatically associate synonyms such as "holiday" and "scenery".

[0192] 3. Obtain the target image labels and supplementary features.

[0193] Optionally, in this embodiment of the application, the semantic extension described above can be performed as follows if voice input is detected:

[0194] 1. Convert to text using technologies such as ASR, for example, "Photos from my recent outings".

[0195] 2. Use NLP and other technologies to identify and extract the core "travel" tags.

[0196] 3. Supplement semantics based on context, such as automatically associating synonyms like "holiday" and "scenery".

[0197] 4. Obtain the target image labels and supplementary features.

[0198] Optionally, in this embodiment of the application, the semantic expansion described above can be performed as follows if a selection input is detected:

[0199] 1. Through image recognition, convert images into tags, such as scenes like "beach" and "mountain".

[0200] 2. Extract other features from the hand-drawn areas of the sketch, such as color features (e.g., blue proportion > 40%).

[0201] 3. Obtain the target image labels and supplementary features.

[0202] Optionally, in this embodiment of the application, the above semantic extension can be performed as follows if a sketch input is detected:

[0203] 1. Convert the sketch into an image.

[0204] 2. Through image recognition, convert images into tags, such as scenes like "beach" and "mountain".

[0205] 3. Extract other features of the sketch's hand-drawn area, such as color features (e.g., blue proportion > 40%).

[0206] 4. Obtain the target image labels and supplementary features.

[0207] Step 3: The first electronic device calls the system photo album API to retrieve all images with the first search tag.

[0208] For example, assuming the first search tag is "travel", then all pictures tagged with "travel" are retrieved from the album.

[0209] Step 4: The first electronic device filters pictures in the photo album application based on the image description information.

[0210] In this embodiment of the application, intelligent image filtering is performed by combining the supplementary features obtained in the aforementioned steps with the metadata carried by the images to select images that meet the expectations.

[0211] For example, if the user enters "photos from recent outings", the system can filter out matching images.

[0212] Step 5: The first electronic device displays the filtered images in the interface window.

[0213] Optionally, in this embodiment, the first electronic device can display matching images arranged from high to low according to a specific dimension. If no suitable dimension exists, the images are arranged chronologically.

[0214] For example, "Recently Going Out Photos" are given higher weight to the timeline, and second-highest weight to landscape and portrait photos, and are displayed in a comprehensive sorting according to specific rules.

[0215] In this embodiment, through user input in the first application interface, the electronic device can directly search for at least one image in other applications that matches the application type corresponding to the first application interface, and display the identifier of the at least one image in the first application interface. Thus, the image requested by the user can be determined based on the at least one identifier. In other words, the electronic device can directly display images in other applications that match the application type of the first application interface in the first application interface without switching application interfaces, reducing the process of searching for images and thus improving the efficiency of image searching by the electronic device.

[0216] Each of the above-described method embodiments, or various possible implementations of each method embodiment, can be executed individually or in combination of any two or more. The specific implementation can be determined according to actual usage requirements, and this application does not impose any restrictions on this.

[0217] The image search method provided in this application can be executed by an image search device. This application uses an image search device executing the image search method as an example to illustrate the image search device provided in this application.

[0218] Figure 14 A schematic diagram of a possible structure of the image search device involved in some embodiments of this application is shown. For example... Figure 14 As shown, the image search device 70 may include a receiving module 71 and a display module 72.

[0219] The receiving module 71 is configured to receive a first input to the first application interface when the first application interface is displayed. The display module 72 is configured to display an interface window corresponding to the first application interface in response to the first input received by the receiving module 71. This interface window includes an identifier for at least one image, which is obtained by searching based on the application type corresponding to the first application interface. The receiving module 71 is also configured to receive a second input to the identifier of the first image in the interface window. The display module 72 is also configured to display the first image in the first application interface in response to the second input received by the receiving module 71.

[0220] In one possible implementation, the image search device further includes a generation module and a search module. The generation module generates a first search tag based on the application type corresponding to the first application interface before the display module 71 displays the interface window. The search module searches for at least one image based on the first search tag generated by the generation module; wherein the interface window also includes the first search tag.

[0221] In one possible implementation, the image search apparatus provided in this application embodiment further includes: an update module; and an input control is also included in the interface window. The receiving module 71 is further configured to receive a third input of image description information in the input control after the interface window is displayed. The generating module is further configured to generate a second search tag based on the image description information in response to the third input received by the receiving module 71. The update module is configured to update the first search tag in the interface window to the second search tag. The search module is further configured to search for M images based on the second search tag. The update module is further configured to update the identifier of at least one image in the interface window to the identifiers of M images, where M is a positive integer.

[0222] In one possible implementation, the update module is specifically used to update the identifier of at least one image in the interface window to the identifiers of M images arranged in a first order, the first order being determined based on the matching degree between the M images and the second search tag.

[0223] In one possible implementation, the first search tag is a privacy-related tag. The display module 72 is specifically configured to, in response to the second input received by the receiving module 71, perform privacy processing on the first image and display the privacy-processed first image in the first application interface.

[0224] This application provides an image search device. Through user input in a first application interface, the electronic device can directly search for at least one image in other applications that matches the application type corresponding to the first application interface, and display the identifier of the at least one image in the first application interface. Thus, the image requested by the user can be determined based on the at least one identifier. In other words, the image search device can directly display images in other applications that match the application type of the first application interface in the first application interface with a single input without having to switch application interfaces, reducing the process of searching for images and thus improving the efficiency of image search.

[0225] The image search device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.

[0226] The image search device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0227] The image search device provided in this application embodiment can implement the various processes implemented in the above method embodiments, and will not be described again here to avoid repetition.

[0228] Optionally, such as Figure 15 As shown, this application embodiment also provides an electronic device 1000, including a processor 1001 and a memory 1002. The memory 1002 stores a program or instructions that can run on the processor 1001. When the program or instructions are executed by the processor 1001, they implement the various steps of the above-described image search method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0229] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0230] Figure 16 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0231] The electronic device 100 includes, but is not limited to, components such as: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, and processor 110.

[0232] Those skilled in the art will understand that the electronic device 100 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 110 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 16 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0233] The user input unit 107 is configured to receive a first input to the first application interface when the first application interface is displayed. The display unit 106 is configured to display an interface window of the first application interface in response to the first input. The interface window includes an identifier for at least one image, which is obtained by searching based on the application type corresponding to the first application interface. The user input unit 107 is further configured to receive a second input regarding the identifier of the first image in the interface window. The display unit 106 is further configured to display the first image in the first application interface in response to the second input.

[0234] Optionally, in this embodiment of the application, the processor 110 is further configured to generate a first search tag based on the application type corresponding to the first application interface before displaying the interface window; and to search for at least one image based on the first search tag; wherein the interface window also includes the first search tag.

[0235] Optionally, in this embodiment, the interface window further includes an input control; the user input unit 107 is further configured to receive a third input of image description information in the input control after the interface window is displayed. The processor 110 is further configured to, in response to the third input, generate a second search tag based on the image description information, and update the first search tag in the interface window to the second search tag; and, based on the second search tag, search for M images, and update the identifier of at least one image in the interface window to the identifier of the M images, where M is a positive integer.

[0236] Optionally, in this embodiment of the application, the processor 110 is specifically used to update the identifier of at least one image in the interface window to the identifiers of M images arranged in a first order, wherein the first order is determined based on the matching degree between the M images and the second search tag.

[0237] Optionally, in this embodiment of the application, the first search tag is a privacy tag; the processor 110 is specifically used to respond to the second input, perform privacy processing on the first image, and display the privacy-processed first image in the first application interface.

[0238] This application provides an electronic device that, through user input in a first application interface, can directly search for at least one image in other applications that matches the application type corresponding to the first application interface, and display the identifier of the at least one image in the first application interface. Thus, the image requested by the user can be determined based on the at least one identifier. In other words, the electronic device can directly display images in the first application interface that match the application type of the first application interface through a single input without switching application interfaces, reducing the process of searching for images and thus improving the efficiency of image searching by the electronic device.

[0239] The electronic device provided in this application embodiment can implement all the processes implemented in the above method embodiments and achieve the same technical effects. To avoid repetition, it will not be described again here. The beneficial effects of the various implementation methods in this embodiment can be found in the beneficial effects of the corresponding implementation methods in the above method embodiments. To avoid repetition, it will not be described again here.

[0240] It should be understood that, in this embodiment, the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.

[0241] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 109 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 109 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0242] Processor 110 may include one or more processing units; optionally, processor 110 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 110.

[0243] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described image search method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0244] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0245] This application also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the above-described methods. These methods achieve the same technical effects and will not be described again here to avoid repetition.

[0246] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0247] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the image search method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0248] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0249] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0250] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An image search method, characterized in that, Performed by a first electronic device, the method includes: When the first application interface is displayed, receive the first input to the first application interface; In response to the first input, an interface window corresponding to the first application interface is displayed. The interface window includes the identifier of at least one image, which is obtained by searching based on the application type corresponding to the first application interface. Receive a second input identifying the first image in the interface window; In response to the second input, the first image is displayed in the first application interface.

2. The method according to claim 1, characterized in that, Before the display interface window is reached, the method further includes: Based on the application type corresponding to the first application interface, generate the first search tag; Based on the first search tag, the at least one image is obtained through search; The interface window also includes the first search tag.

3. The method according to claim 2, characterized in that, The interface window also includes input controls; After the display interface window is shown, the method further includes: Receive a third input of image description information into the input control; In response to the third input, a second search tag is generated based on the image description information, and the first search tag in the interface window is updated to the second search tag; Based on the second search tag, M images are obtained, and the identifier of at least one image in the interface window is updated to the identifier of the M images, where M is a positive integer.

4. The method according to claim 3, characterized in that, The step of updating the identifier of at least one image in the interface window to the identifier of the M images includes: The identifier of at least one image in the interface window is updated to the identifiers of the M images arranged in a first order, the first order being determined based on the matching degree between the M images and the second search tag.

5. The method according to claim 2, characterized in that, The first search tag is a privacy-related tag; The step of displaying the first image in the first application interface in response to the second input includes: In response to the second input, the first image is subjected to privacy processing, and the privacy-processed first image is displayed in the first application interface.

6. An image search device, characterized in that, The image search device includes: a receiving module and a display module; The receiving module is used to receive a first input to the first application interface when the first application interface is displayed. The display module is used to respond to the first input received by the receiving module and display an interface window corresponding to the first application interface. The interface window includes the identifier of at least one image, and the at least one image is obtained by searching based on the application type corresponding to the first application interface. The receiving module is also configured to receive a second input identifying the first image in the interface window; The display module is further configured to display the first image in the first application interface in response to the second input received by the receiving module.

7. The apparatus according to claim 6, characterized in that, The image search device further includes: a generation module and a search module; The generation module is used to generate a first search tag based on the application type corresponding to the first application interface before the display module displays the interface window; The search module is used to search for the at least one image based on the first search tag generated by the generation module. The interface window also includes the first search tag.

8. The apparatus according to claim 7, characterized in that, The image search device further includes: an update module; the interface window also includes input controls; The receiving module is also used to receive a third input of image description information in the input control after the display interface window; The generation module is further configured to generate a second search tag based on the image description information in response to the third input received by the receiving module; The update module is used to update the first search tag in the interface window to the second search tag; The search module is also used to search for M images based on the second search tag; The update module is further configured to update the identifier of at least one image in the interface window to the identifiers of the M images, where M is a positive integer.

9. The apparatus according to claim 8, characterized in that, The update module is specifically used to update the identifier of at least one image in the interface window to the identifiers of the M images arranged in a first order, wherein the first order is determined based on the matching degree between the M images and the second search tag.

10. The apparatus according to claim 7, characterized in that, The first search tag is a privacy-related tag; The display module is specifically used to perform privacy processing on the first image in response to the second input received by the receiving module, and to display the privacy-processed first image in the first application interface.

Images