Picture searching method and device, terminal and storage medium

By allowing a second search operation to refine the initial search area, the method improves image search accuracy by avoiding repetitive searches on the same area, enhancing precision.

CN120316285APending Publication Date: 2025-07-15SAMSUNG GUANGZHOU MOBILE R&D CENT +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410059415.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-01-15
Publication Date
2025-07-15

AI Technical Summary

Technical Problem

When the prior art recognizes pictures containing small pictures, it is easy to misidentify them as large pictures, resulting in inaccurate search results and unable to meet users' accurate search needs.

Method used

By acquiring multiple areas to be searched for the image to be searched, a first search area is determined in response to the user's first search operation, and a second search operation is performed on this basis, a target search area is determined, and these areas are searched in combination or individually to improve search accuracy.

Benefits of technology

By providing secondary search operations, repeated searches for the same area are avoided, the accuracy of image search is improved, and the user's accurate search needs are met.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120316285A_ABST
    Figure CN120316285A_ABST
Patent Text Reader

Abstract

The invention relates to a picture searching method and device, a terminal and a storage medium. The method comprises the steps of obtaining a to-be-searched picture, wherein the to-be-searched picture comprises a plurality of to-be-searched areas; in response to a first search operation of the user on the to-be-searched picture, determining a corresponding first search area according to a first operation position where the first search operation is located; in response to a second search operation of the user, determining a corresponding target search area according to a second operation position where the second search operation is located; and searching the first search area and / or the target search area to obtain a target search result. By adopting the method, the accuracy of picture search can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, and particularly to a method, apparatus, terminal, and storage medium for image search. Background Art

[0002] Currently, there is a search application that supports users to circle an image or text on the current page and search for the circled image or text. Specifically, after starting the search application, it is necessary to take a screenshot of the current page and analyze its content, analyze the image area and text area on the current page, and then quickly determine whether the currently selected area is an image area or a text area based on the position clicked by the user, quickly help the user automatically select the corresponding image, and perform a search.

[0003] However, in some application scenarios, there is a large image containing a small image on the current page, or multiple images are too close to each other and are easily recognized as a whole. When the user clicks on the small image for recognition, it is easy to directly recognize the large image, and the expected effect of accurate search cannot be achieved. The search results are not as expected by the user. When the user discovers this problem and clicks on the small image for recognition again, the large image is still recognized at this time, and accurate search cannot be achieved. Summary of the Invention

[0004] Based on this, in view of the above technical problems, it is necessary to provide an image search method, apparatus, terminal, and storage medium that can provide a secondary search operation based on the first search result, thereby improving the accuracy of image search.

[0005] An image search method, the method comprising:

[0006] Obtain an image to be searched, the image to be searched including a plurality of areas to be searched;

[0007] In response to a first search operation of a user on the image to be searched, determine a corresponding first search area according to a first operation position where the first search operation is located;

[0008] In response to a second search operation of the user, determine a corresponding target search area according to a second operation position where the second search operation is located;

[0009] Search the first search area and / or the target search area to obtain a target search result.

[0010] In one embodiment, obtaining an image to be searched, the image to be searched including a plurality of areas to be searched, includes:

[0011] In response to a trigger search operation of the user, perform a screenshot operation on the current page according to the trigger search operation to obtain the image to be searched;

[0012] Perform regional recognition on the image to be searched to obtain multiple search regions.

[0013] In one embodiment, after obtaining the image to be searched, where the image to be searched includes multiple regions to be searched, the method further includes:

[0014] Obtain the type corresponding to each region to be searched;

[0015] Obtain the location information corresponding to each region to be searched;

[0016] Calculate the corresponding region area according to each location information;

[0017] Determine the storage order of each region to be searched according to the size of the region area. When storing each region to be searched according to the storage order, store each region to be searched together with the corresponding type, location information, and region area to obtain a list of regions to be searched.

[0018] In one embodiment, in response to a user's first search operation on the image to be searched, determining a corresponding first search region according to the first operation position where the first search operation is located includes:

[0019] Respond to the user's first search operation on the image to be searched;

[0020] Obtain the first operation position where the first search operation is located;

[0021] Determine that the region to be searched in the list of regions to be searched that contains the first operation position and has the largest region area is the first search region.

[0022] In one embodiment, in response to a user's second search operation on the first search region, determining a corresponding target search region according to the second operation position where the second search operation is located includes:

[0023] Respond to the user's second search operation on the first search region;

[0024] Obtain the second operation position where the second search operation is located;

[0025] Determine that the region to be searched in the list of regions to be searched that contains the second operation position and has an area only smaller than the area of the first search region is the target search region.

[0026] In one embodiment, in response to a user's second search operation on the first search region, determining a corresponding target search region according to the second operation position where the second search operation is located includes:

[0027] Respond to the user's second search operation on the first search region;

[0028] Obtain the second operation position where the second search operation is located;

[0029] Determine that the search area to be searched in the list of search areas to be searched that contains the second operation position and has the smallest area is the target search area.

[0030] In one embodiment, in response to a user's first search operation on the picture to be searched, determine a corresponding first search area according to the first operation position where the first search operation is located, including:

[0031] In response to a user's first search operation on the picture to be searched;

[0032] Obtain the first operation position where the first search operation is located;

[0033] Determine that the search area to be searched in the list of search areas to be searched that contains the first operation position and has the smallest area is the first search area.

[0034] In one embodiment, in response to a user's second search operation on the first search area, determine a corresponding target search area according to the second operation position where the second search operation is located, including:

[0035] In response to a user's second search operation on the first search area;

[0036] Obtain the second operation position where the second search operation is located;

[0037] Determine that the search area to be searched in the list of search areas to be searched that contains the second operation position and has an area only larger than the area of the first search area is the target search area.

[0038] In one embodiment, search the first search area and / or the target search area to obtain a target search result, including:

[0039] Analyze the target search area to obtain a target search object;

[0040] Search according to the target search object to obtain a target search result.

[0041] In one embodiment, in response to a user's second search operation, determine a corresponding target search area according to the second operation position where the second search operation is located, including:

[0042] In response to a user's second search operation outside the first search area;

[0043] Determine a corresponding target search area according to the second operation position where the second search operation is located.

[0044] In one embodiment, before responding to a user's second search operation outside the first search area, further include:

[0045] Obtain the search results corresponding to the first search area;

[0046] A supplementary search control is provided on the display page of the search results;

[0047] In response to the user's supplementary search operation on the control, perform supplementary search according to the supplementary search operation.

[0048] In one embodiment, searching the first search area and / or the target search area to obtain the target search results includes:

[0049] Analyze the first search area to obtain the first search object;

[0050] Analyze the target search area to obtain the target search object;

[0051] Search according to the first search object and the target search object to obtain the target search results.

[0052] In one embodiment, when the target search area is a text area, analyzing the target search area to obtain the target search object includes:

[0053] Perform word segmentation on the text area to obtain at least one word;

[0054] In response to the user selecting at least one keyword from at least one word, determine the at least one keyword as the target search object.

[0055] An image search device, the device includes:

[0056] An acquisition module, configured to acquire the image to be searched, and the image to be searched includes multiple search areas;

[0057] A first response module, configured to respond to the user's first search operation on the image to be searched, and determine the corresponding first search area according to the first operation position where the first search operation is located;

[0058] A second response module, configured to respond to the user's second search operation, and determine the corresponding target search area according to the second operation position where the second search operation is located;

[0059] A search module, configured to search the first search area and / or the target search area to obtain the target search results.

[0060] In one embodiment, the acquisition module responds to the user's trigger search operation, performs a screenshot operation on the current page according to the trigger search operation to obtain the image to be searched, and performs area recognition on the image to be searched to obtain multiple search areas.

[0061] In one embodiment, the above device acquires the types corresponding to each area to be searched, acquires the position information corresponding to each area to be searched, calculates the corresponding area of each area based on the position information, determines the storage order of each area to be searched according to the size of the area, and when storing each area to be searched according to the storage order, stores each area to be searched together with the corresponding type, position information, and area, to obtain a list of areas to be searched.

[0062] In one embodiment, the first response module responds to a user's first search operation on a picture to be searched, acquires the first operation position where the first search operation is located, and determines the area to be searched in the list of areas to be searched that contains the first operation position and has the largest area as the first search area.

[0063] In one embodiment, the second response module responds to a user's second search operation on the first search area, acquires the second operation position where the second search operation is located, and determines the area to be searched in the list of areas to be searched that contains the second operation position and has an area only smaller than the area of the first search area as the target search area.

[0064] In one embodiment, the second response module responds to a user's second search operation on the first search area, acquires the second operation position where the second search operation is located, and determines the area to be searched in the list of areas to be searched that contains the second operation position and has the smallest area as the target search area.

[0065] In one embodiment, the first response module responds to a user's first search operation on a picture to be searched, acquires the first operation position where the first search operation is located, and determines the area to be searched in the list of areas to be searched that contains the first operation position and has the smallest area as the first search area.

[0066] In one embodiment, the second response module responds to a user's second search operation outside the first search area, and determines the corresponding target search area according to the second operation position where the second search operation is located.

[0067] In one embodiment, the search module analyzes the target search area to obtain a target search object, and performs a search based on the target search object to obtain a target search result.

[0068] In one embodiment, the second response module responds to a user's second search operation outside the first search area, and determines the corresponding target search area according to the second operation position where the second search operation is located.

[0069] In one embodiment, the second response module obtains the search results corresponding to the first search area. A supplementary search control is provided on the display page of the search results. In response to the user's supplementary search operation on the control, supplementary search is performed according to the supplementary search operation.

[0070] In one embodiment, the search module analyzes the first search area to obtain a first search object, analyzes the target search area to obtain a target search object, and performs a search according to the first search object and the target search object to obtain a target search result.

[0071] In one embodiment, when the target search area is a text area, the search module performs word segmentation on the text area to obtain at least one word. In response to the user selecting at least one keyword from the at least one word, it is determined that the at least one keyword is the target search object.

[0072] A terminal includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented:

[0073] Obtain a picture to be searched, where the picture to be searched includes multiple areas to be searched;

[0074] In response to the user's first search operation on the picture to be searched, determine the corresponding first search area according to the first operation position where the first search operation is located;

[0075] In response to the user's second search operation, determine the corresponding target search area according to the second operation position where the second search operation is located;

[0076] Search the first search area and / or the target search area to obtain a target search result.

[0077] A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the following steps are implemented:

[0078] Obtain a picture to be searched, where the picture to be searched includes multiple areas to be searched;

[0079] In response to the user's first search operation on the picture to be searched, determine the corresponding first search area according to the first operation position where the first search operation is located;

[0080] In response to the user's second search operation, determine the corresponding target search area according to the second operation position where the second search operation is located;

[0081] Search the first search area and / or the target search area to obtain a target search result.

[0082] The above-mentioned picture search method, device, terminal, and storage medium. The terminal obtains a picture to be searched, and the picture to be searched includes multiple regions to be searched. In response to a user's first search operation on the picture to be searched, a corresponding first search region is determined according to the first operation position where the first search operation is located. In response to the user's second search operation, a corresponding target search region is determined according to the second operation position where the second search operation is located. The first search region and / or the target search region are searched to obtain a target search result.

[0083] Therefore, it is possible to provide a re-search based on the first search region determined by the first search operation. In response to the user's second search operation, the target search region corresponding to the second search operation is determined, and the first search region is combined with the target search region or the target search region is searched, which can avoid the situation where multiple search operations always repeatedly search the same search region, and improve the accuracy of picture search. Brief Description of the Drawings

[0084] Figure 1 It is a schematic flowchart of a picture search method in an embodiment;

[0085] Figure 1A It is a schematic interface diagram of a picture to be searched in an embodiment;

[0086] Figure 2 It is a schematic flowchart of the step of obtaining a picture to be searched in an embodiment;

[0087] Figure 3 It is a schematic flowchart of a picture search method in an embodiment;

[0088] Figure 4 It is a schematic flowchart of the step of determining the first search region in an embodiment;

[0089] Figure 4A It is a schematic operation diagram of a picture to be searched in an embodiment;

[0090] Figure 5 It is a schematic flowchart of the step of determining the target search region in an embodiment;

[0091] Figure 5A It is a schematic operation diagram of a picture to be searched in an embodiment;

[0092] Figure 5B It is a schematic operation diagram of a picture to be searched in an embodiment;

[0093] Figure 6 It is a schematic flowchart of the step of determining the target search region in an embodiment;

[0094] Figure 6ASchematic diagram of operations for an image to be searched in an embodiment;

[0095] Figure 7 Schematic flowchart of the search steps in a search area in an embodiment;

[0096] Figure 8 Schematic flowchart of the step for determining a target search area in an embodiment;

[0097] Figure 9 Schematic flowchart of the supplementary search operation steps in an embodiment;

[0098] Figure 9A Schematic interface diagram of the supplementary search in an embodiment;

[0099] Figure 10 Schematic flowchart of the search steps in a search area in an embodiment;

[0100] Figure 11 Schematic flowchart of the step for determining a target search object in an embodiment;

[0101] Figure 12 Schematic diagram of operations for an image to be searched in an embodiment;

[0102] Figure 13 Schematic block diagram of an image search device in an embodiment;

[0103] Figure 14 Internal structure diagram of a computer device in an embodiment. Detailed implementation manners

[0104] In order to make the objectives, technical solutions and advantages of the present application clearer and more understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0105] The following detailed implementation manners are provided to help the reader obtain a comprehensive understanding of the methods, devices, terminals, and / or storage media described herein. However, after understanding the disclosed content of the present disclosure, various changes, modifications, and equivalents of the methods, devices, terminals, and / or storage media described herein will be clear. For example, the order of operations described herein is only an example and is not limited to those set forth herein, but may be changed as will be clear after understanding the disclosed content of the present disclosure, except for operations that must occur in a specific order. In addition, for the sake of clarity and conciseness, the description of features known in the art may be omitted.

[0106] The features described herein can be implemented in different forms and should not be construed as limited to the examples described herein. On the contrary, the examples described herein are provided only to illustrate some of the many viable ways of implementing the methods, terminals, and / or storage media described herein, and many viable ways will be apparent after understanding the present disclosure.

[0107] The terms used herein are for describing various examples only and will not be used to limit the disclosure. Unless the context clearly indicates otherwise, the singular forms are also intended to include the plural forms. The terms "comprising", "including", and "having" specify the presence of the recited features, quantities, operations, components, elements, and / or combinations thereof, but do not preclude the presence or addition of one or more other features, quantities, operations, components, elements, and / or combinations thereof. Unless otherwise specified, " / " means "or", for example, A / B can mean A or B; "and / or" in the text is merely a description of the associative relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present invention, "a plurality of" means two or more than two.

[0108] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present disclosure pertains after understanding the present disclosure. Unless explicitly defined herein, terms (such as those defined in a general dictionary) shall be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and shall not be interpreted idealistically or overly formally.

[0109] It should be noted that the terms "first", "second", etc. in the specification, claims, and above-mentioned drawings of the present disclosure are used to distinguish similar objects and do not necessarily have to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in some of the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0110] In addition, in the description of the examples, when a detailed description of a related structure or function that is considered well-known will cause an ambiguous interpretation of the present disclosure, such a detailed description will be omitted.

[0111] Hereinafter, embodiments will be described in detail with reference to the drawings. However, the embodiments can be implemented in various forms and are not limited to the examples described herein.

[0112] In one embodiment, as Figure 1 shown, a picture search method is provided. Taking the case where this method is applied to a terminal as an example, it includes the following steps:

[0113] Step 102, obtain a picture to be searched, where the picture to be searched includes multiple regions to be searched.

[0114] Among them, the picture to be searched is the picture that needs to be searched. The picture to be searched includes multiple regions to be searched, and the region to be searched is the region where the object that can be searched in the region to be searched is located. Among them, the object to be searched can be a picture or text content.

[0115] Among them, after obtaining the picture to be searched, content analysis can be performed on the picture to be searched, the search object in the picture to be searched can be analyzed, and the region where the search object is located can be divided into regions to be searched. For example, as Figure 1A shown, Figure 1A is a schematic diagram of a picture to be searched in an embodiment. The picture to be searched includes multiple regions to be searched, which are text region 1, text region 2, text region 3, picture region 1, picture region 2, picture region 3, and picture region 4 respectively.

[0116] Step 104, in response to the user's first search operation on the picture to be searched, determine a corresponding first search region according to the first operation position where the first search operation is located.

[0117] Among them, the first search operation is the user's first search operation on the picture to be searched. It can be a search operation at any position in the picture to be searched. The search operation can be but is not limited to a click operation, a voice operation, or a preset event trigger operation, etc. The click operation can be that the user clicks on any position in the picture to be searched, the voice operation can be that the user controls the click on any position in the picture to be searched through voice, and the preset event trigger operation can be that the click on any position in the picture to be searched is triggered through a preset timing event.

[0118] Specifically, in response to the user's first search operation on the picture to be searched, obtain the first operation position where the first search operation is located, and determine the corresponding first search region through the first operation position. The first search region here is the search region selected by the user for the first search operation.

[0119] Step 106, in response to the user's second search operation, determine a corresponding target search region according to the second operation position where the second search operation is located.

[0120] Among them, the second search operation is the user's re-search operation on the picture to be searched, which can be a search operation on the first search area or a search operation at any position outside the first search area. The search operation can be, but is not limited to, a click operation, a voice operation, or a preset event trigger operation, etc.

[0121] Specifically, in response to the user's second search operation, obtain the second operation position where the second search operation is located, and determine the corresponding target search area through the second operation position. The target search area here is the search area selected by the user for the second search operation.

[0122] Step 108, search the first search area and / or the target search area to obtain a target search result.

[0123] Specifically, after determining the first search area and the target search area, the search can be combined with the first search area and the target search area. Specifically, a new search object can be re-determined according to the search object in the first search area and the search object in the target search area, and the new search object can be searched to obtain the corresponding target search result. Or, the search object in the target search area can be searched to obtain the corresponding target search result.

[0124] In the above picture search method, the terminal obtains the picture to be searched, and the picture to be searched includes multiple search areas. In response to the user's first search operation on the picture to be searched, the corresponding first search area is determined according to the first operation position where the first search operation is located. In response to the user's second search operation, the corresponding target search area is determined according to the second operation position where the second search operation is located, and the first search area and / or the target search area are searched to obtain a target search result.

[0125] Therefore, it is possible to provide a re-search on the basis of the first search area determined by the first search operation. In response to the user's second search operation, the target search area corresponding to the second search operation is determined, and the first search area and the target search area are combined or the target search area is searched, which can avoid the situation that multiple search operations always repeatedly search the same search area, and improve the accuracy of picture search.

[0126] In one embodiment, as Figure 2 shown, obtaining the picture to be searched, and the picture to be searched includes multiple search areas, including:

[0127] Step 202, in response to the user's trigger search operation, perform a screenshot operation on the current page according to the trigger search operation to obtain the picture to be searched.

[0128] Step 204, perform area recognition on the picture to be searched to obtain multiple search areas.

[0129] Among them, the trigger search operation is generated by triggering the search operation. The terminal may be installed with a search application. In the search application, the user can trigger the search operation. In response to the user's trigger search operation, a screenshot operation is performed on the current page of the search application, and the picture obtained by the screenshot operation is determined as the picture to be searched. The so-called screenshot operation is to intercept the information of the current page, which is a way to intercept pictures or texts.

[0130] Further, after obtaining the picture to be searched, region recognition is performed on the picture to be searched, and the regions where different search objects are located are divided into corresponding search regions. Among them, performing region recognition on the picture to be searched may specifically be to determine each search object in the picture to be searched, and divide the regions where each search object is located to obtain the corresponding search regions.

[0131] For example, as Figure 1A shown, Figure 1A is a schematic diagram of a picture to be searched in an embodiment. The picture to be searched includes multiple regions to be searched, which are respectively text region 1, text region 2, text region 3, picture region 1, picture region 2, picture region 3, and picture region 4.

[0132] In an embodiment, as Figure 3 shown, after obtaining the picture to be searched, and the picture to be searched includes multiple regions to be searched, it further includes:

[0133] Step 302, obtain the type corresponding to each region to be searched.

[0134] Step 304, obtain the position information corresponding to each region to be searched.

[0135] Step 306, calculate the corresponding region area according to each position information.

[0136] Among them, since the region to be searched is the region where the search object is located, and the search object may include multiple types, for example, pictures or text contents. Therefore, the type corresponding to the region to be searched is the type corresponding to the search object. And the position information corresponding to the region to be searched is the coordinate position describing the region to be searched in the picture to be searched. For example, the coordinate position includes the up, down, left, and right coordinate positions of the region to be searched in the picture to be searched.

[0137] Further, after obtaining the position information corresponding to each area to be searched, the corresponding area size can be calculated based on the position information of each area to be searched. Here, the area size describes the size of the area to be searched. Specifically, it can be determined that the product of the difference in the upper and lower coordinate positions of the area to be searched and the difference in the left and right coordinate positions is the corresponding area size. For example, the position information of the area to be searched is: ((left, top, bottom, right)), and the corresponding area size S is calculated as: S = (bottom - top) * (right - left).

[0138] Step 308, determine the storage order of each area to be searched according to the size of the area size. When storing each area to be searched according to the storage order, store each area to be searched together with the corresponding type, position information, and area size to obtain a list of areas to be searched.

[0139] Specifically, after obtaining the area size corresponding to each area to be searched, determine the storage order corresponding to each area to be searched through the area size corresponding to each area to be searched. Here, the storage order is the storage order of each area to be searched. Specifically, it can be to store each area to be searched in descending order of the area size, or to store each area to be searched in ascending order of the area size, which can be determined according to actual business requirements, actual product requirements, or actual application scenarios.

[0140] Among them, when storing each area to be searched, it is necessary to bind and store each area to be searched with the corresponding type, position information, and area size to obtain a list of areas to be searched. That is, each area to be searched in the list of areas to be searched is stored according to the size of the area size, and each area to be searched is associated with the corresponding type, position information, and area size.

[0141] In one embodiment, as Figure 4 shown, in response to the user's first search operation on the image to be searched, determine the corresponding first search area according to the first operation position where the first search operation is located, including:

[0142] Step 402, respond to the user's first search operation on the image to be searched.

[0143] Step 404, obtain the first operation position where the first search operation is located.

[0144] Step 406, determine that the area to be searched in the list of areas to be searched that contains the first operation position and has the largest area size is the first search area.

[0145] Specifically, in response to a first search operation by the user on any position in the picture to be searched, obtain the first operation position where the first search operation is located, and determine whether the first operation position is in any of the search areas in the list of search areas to be searched. If so, determine the search area with the largest area in the list of search areas to be searched as the first search area.

[0146] For example, as Figure 4A shown, Figure 4A FIG. shows a schematic diagram of operations on a picture to be searched in an embodiment. Figure 4A In FIG., the first search operation is the user's search operation on picture area 2 of the picture to be searched. Since the first operation position where the first search operation is located falls within picture area 2 in the list of search areas to be searched, the picture area with the largest area in the list of search areas to be searched can be determined as the first search area, that is, Figure 4A picture area 4 in FIG. is the first search area ( Figure 4A the gray part in FIG.).

[0147] In one embodiment, as Figure 5 shown, in response to a second search operation by the user on the first search area, determine the corresponding target search area according to the second operation position where the second search operation is located, including:

[0148] Step 502, in response to the user's second search operation on the first search area.

[0149] Step 504, obtain the second operation position where the second search operation is located.

[0150] Step 506, determine the search area to be searched that contains the second operation position and has an area only smaller than the area of the first search area as the target search area.

[0151] Among them, after determining the first search area, the user can perform a second search operation on the first search area, that is, in response to a second search operation by the user on any position in the first search area, obtain the second operation position where the second search operation is located, and determine the search area to be searched that contains the second operation position and has an area only smaller than the area of the first search area as the target search area. And so on, in response to the user's next search operation, determine the next search operation as the second search operation, and return to the steps in response to the second search operation by the user on any position in the first search area until the search area to be searched that contains the second operation position and there is no smaller area search area to be searched. It can be understood that the target search area is the area where the second search operation lands, and the area is only smaller than the area of the first search area. In this way, secondary search can be realized on the basis of the first search area of the first search, and the search area of the secondary search can be determined.

[0152] For example, as Figure 5A shown, Figure 5A Fig. shows an operation schematic diagram of a picture to be searched in an embodiment. Figure 5A The first search area in Figure 5A is the picture area 4 with the largest area. The second search operation of the user is the search operation for the picture area 2 in Figure 5A . Since the picture area 1 and the picture area 2 are in an inclusion relationship, and the position where the second search operation lands can be in the picture area 1 and the picture area 2, and the area of the picture area 1 is larger than the area of the picture area 2, and the area of the picture area 1 is only smaller than the area of the picture area 4, the picture area 1 is determined as the target search area (

[0153] For another example, as Figure 5B shown, Figure 5B Fig. shows an operation schematic diagram of a picture to be searched in an embodiment. Figure 5B The first search area in Figure 5B is the picture area 4 with the largest area. The second search operation of the user is the search operation for the picture area 3 in Figure 5B . Since the picture area 3 is a separate area to be searched, the position where the second search operation lands is the picture area 3, and the area of the picture area 3 is only smaller than the area of the picture area 4, the picture area 3 is determined as the target search area (

[0154] In an embodiment, as Figure 6 shown, in response to the user's second search operation on the first search area, determining a corresponding target search area according to the second operation position where the second search operation is located includes:

[0155] Step 602, in response to the user's second search operation on the first search area.

[0156] Step 604, obtaining the second operation position where the second search operation is located.

[0157] Step 606, determining that the search area to be searched in the list that contains the second operation position and has the smallest area is the target search area.

[0158] Wherein, after determining the first search area, the user can perform a second search operation on the first search area, that is, in response to the user's second search operation on any position in the first search area, obtaining the second operation position where the second search operation is located, and taking the search area to be searched in the list that contains the second operation position and has the smallest area as the target search area, so as to be closer to the user experience, and the user can intuitively search for the area with the smallest area in the first search area.

[0159] For example, as Figure 6A shown, Figure 6A FIG. 5 shows an operation schematic diagram of a picture to be searched in an embodiment. Figure 6A In FIG. 5, the first search area is the picture area 4 with the largest area. The second search operation of the user is a search operation for the picture area 2 in Figure 6A FIG. 5. Since the picture area 1 and the picture area 2 are in an inclusion relationship, the position where the second search operation lands can be the picture area 1 and the picture area 2, and the area of the picture area 1 is larger than the area of the picture area 2. Therefore, the picture area 2 with the smallest area can be determined as the target search area ( Figure 6A the gray part in FIG. 5).

[0160] In an embodiment, as Figure 7 shown, search the first search area and / or the target search area to obtain a target search result, including:

[0161] Step 702: Analyze the target search area to obtain a target search object.

[0162] Step 704: Search according to the target search object to obtain a target search result.

[0163] Specifically, after determining the target search area, identify the target search object corresponding to the target search area, and search for the target search object to obtain a target search result. Specifically, it can be to analyze the area content included in the target search area to obtain the target search object, and then search for the target search object to obtain the final target search result.

[0164] In this embodiment, the target search result is obtained by searching the target search area identified by the second search operation, and the second search operation is performed on the basis of the search area corresponding to the first search operation, which can avoid the situation in the prior art where both the first search operation and the second search operation always search the same search area, and improve the accuracy of picture search.

[0165] In an embodiment, as Figure 8 shown, in response to the user's second search operation, determine the corresponding target search area according to the second operation position where the second search operation is located, including:

[0166] Step 802: Respond to the user's second search operation outside the first search area.

[0167] Step 804: Determine the corresponding target search area according to the second operation position where the second search operation is located.

[0168] Among them, the second search operation may be a search operation outside the first search area, that is, it may be a search operation at any position in the image to be searched except for the first search area, such as a search operation in a search area to be searched adjacent to the first search area. Specifically, in response to a second search operation by the user outside the first search area, the second operation position where the second search operation is located is obtained, and the corresponding target search area is determined through the second operation position, which may be to determine the search area to be searched where the second operation position is located as the target search area.

[0169] In one embodiment, as Figure 9 shown, before responding to a second search operation by the user outside the first search area, it further includes:

[0170] Step 902, obtaining the search result corresponding to the first search area.

[0171] Step 904, a supplementary search control is provided on the display page of the search result.

[0172] Step 906, in response to a supplementary search operation by the user on the control, a supplementary search is performed according to the supplementary search operation.

[0173] Among them, since the second search operation is based on the user's first search operation and belongs to the user's supplementary search, therefore, a supplementary search control can be set in the search result of the user's first search operation, and the control is triggered to perform a supplementary search.

[0174] Specifically, after determining the first search area, the search object in the first search area is searched to obtain the corresponding search result, and the search result is displayed through the display page. Among them, a supplementary search control is provided at a preset position on the display page, and the user can perform a supplementary search operation on the control, and a supplementary search is performed according to the supplementary search operation. Among them, the supplementary search operation may be a click operation on the control, or a voice operation on the control, etc. Among them, the preset position of the supplementary search control can be determined in advance according to actual business requirements, actual product requirements or actual application scenarios.

[0175] For example, as Figure 9A shown, Figure 9A shows a schematic diagram of the interface for supplementary search in one embodiment, Figure 9A is the display page of the search result of the first search area. The display page includes the display position of the search result, and a "further search" control is provided at the upper right corner of the display position of the search result. This control is the supplementary search control.

[0176] In one embodiment, as Figure 10 shown, searching the first search area and / or the target search area to obtain the target search result includes:

[0177] Step 1002: Analyze the first search area to obtain the first search object.

[0178] Step 1004: Analyze the target search area to obtain the target search object.

[0179] Step 1006: Perform a search based on the first search object and the target search object to obtain the target search result.

[0180] Among them, after determining the target search area, re - determine a new search object by combining the search objects in the first search area and the target search area, and perform a search through the new search object to obtain the target search result.

[0181] Specifically, analyze the area content included in the first search area and the target search area respectively to obtain the corresponding first search object and target search object. Determine a new search object through the first search object and the target search object. The new search object can include the first search object and the target search object, or can be a combination of the first search object and the target search object, etc. Further, perform a search on the new search object to obtain the target search result.

[0182] In this embodiment, the target search result is obtained by combining the first search object identified in the first search operation and the target search object identified in the second search operation, and re - determining a new search object for search. When the search result corresponding to the first search operation does not meet the user's expectations, it is possible to further search based on the search result of the first search operation. Re - determine a new search object through the first search object of the first search operation and the target search object of the second search operation, and perform a new search to obtain the target search result.

[0183] In one embodiment, as Figure 11 shown, when the target search area is a text area, analyze the target search area to obtain the target search object, including:

[0184] Step 1102: Perform word segmentation on the text area to obtain at least one word.

[0185] Step 1104: In response to the user selecting at least one keyword from at least one word, determine the at least one keyword as the target search object.

[0186] Among them, when the target search area is a text area, keyword(s) can be selected from the text area, and the selected keyword(s) is / are determined as the target search object of the second search operation.

[0187] Specifically, perform word segmentation on the text area to obtain at least one word. Among them, the word segmentation can be performed according to the collocation habits of each word in the text area or the subject-predicate-object syntactic structure to obtain at least one word. Further, the user can select at least one keyword from at least one word according to actual business requirements, actual product requirements, or actual application scenarios. In response to the user's selection operation, determine at least one keyword selected by the user as the target search object corresponding to the second search operation according to the selection operation.

[0188] In one embodiment, in response to the user's first search operation on the picture to be searched, determine the corresponding first search area according to the first operation position where the first search operation is located, including:

[0189] In response to the user's first search operation on the picture to be searched;

[0190] Obtain the first operation position where the first search operation is located;

[0191] Determine the to-be-searched area in the to-be-searched area list that contains the first operation position and has the smallest area as the first search area.

[0192] Specifically, in response to the user's first search operation on any position of the picture to be searched, obtain the first operation position where the first search operation is located, and determine whether the first operation position is in any of the to-be-searched areas in the to-be-searched area list. If so, determine the to-be-searched area with the smallest area in the to-be-searched area list as the first search area.

[0193] For example, as Figure 12 shown, Figure 12 shows an operation schematic diagram of the picture to be searched in one embodiment. Figure 12 In [the figure], the first search operation is on the picture area 2 of the picture to be searched. Since the first operation position where the first search operation is located falls within the picture area 2 in the to-be-searched area list, therefore, the to-be-searched area with the smallest area in the to-be-searched area list can be determined as the first search area, that is, Figure 12 the picture area 2 in [the figure] is the first search area ( Figure 12 the gray part determined by the first search operation on the left is the first search area).

[0194] In one embodiment, in response to the user's second search operation on the first search area, determine the corresponding target search area according to the second operation position where the second search operation is located, including:

[0195] In response to the user's second search operation on the first search area;

[0196] Obtain the second operation position where the second search operation is located;

[0197] Determine that the search area to be searched in the list of search areas to be searched, which contains the second operation position and the area of the area is only larger than the area of the first search area, is the target search area.

[0198] Wherein, after determining the first search area, the user can perform a second search operation on the first search area, that is, in response to the user's second search operation on any position in the first search area, obtain the second operation position where the second search operation is located, and determine the search area to be searched in the list of search areas to be searched, which contains the second operation position and the area of the area is only larger than the area of the first search area, as the target search area, and so on. In response to the user's next search operation, determine the next search operation as the second search operation, and return to the step of responding to the user's second search operation on any position in the first search area until there is no search area to be searched in the list of search areas to be searched that contains the second operation position and has a larger area.

[0199] For example, as Figure 12 shown, Figure 12 shows a schematic diagram of the operation of the picture to be searched in an embodiment. Figure 12 The first search area in is the picture area 2 with the smallest area. The user's second search operation is the search operation on Figure 12 the picture area 2 in. Since the picture areas 1, 2, and 4 are in an inclusion relationship, the position where the second search operation lands can be in the picture areas 4, 1, and 2, and the area of the picture area 4 is larger than the picture area 1 which is larger than the picture area 2. Then, the picture area 1 with the second largest area is determined as the target search area ( Figure 12 The gray part in the middle determined by the second search operation is the target search area).

[0200] Furthermore, as Figure 12 shown, Figure 12 shows a schematic diagram of the operation of the picture to be searched in an embodiment. Obtain the user's next search operation. The next search operation is still the search operation on Figure 12 the picture area 2 in. Since the picture areas 4, 1, and 2 are in an inclusion relationship, the position where the next search operation lands can be in the picture areas 4, 1, and 2, and the area of the picture area 4 is larger than the picture area 1 which is larger than the picture area 2. The previous search operation has determined that the picture area 1 is the corresponding target search area. This search operation can determine the picture area 4 as the corresponding target search area ( Figure 12 The gray part on the right determined by the next search operation is the target search area).

[0201] It should be understood that although the various steps in the above flowchart are shown in sequence according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the above flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0202] In one embodiment, as Figure 13 shown, a picture search device 1200 is provided, including: an acquisition module 1202, a first response module 1204, a second response module 1206, and a search module 1208, where:

[0203] The acquisition module 1202 is configured to acquire a picture to be searched, and the picture to be searched includes a plurality of regions to be searched.

[0204] The first response module 1204 is configured to, in response to a first search operation of a user on the picture to be searched, determine a corresponding first search region according to a first operation position where the first search operation is located.

[0205] The second response module 1206 is configured to, in response to a second search operation of the user, determine a corresponding target search region according to a second operation position where the second search operation is located.

[0206] The search module 1208 is configured to search the first search region and / or the target search region to obtain a target search result.

[0207] In one embodiment, the acquisition module 1202, in response to a trigger search operation of the user, performs a screenshot operation on the current page according to the trigger search operation to obtain a picture to be searched, and performs region recognition on the picture to be searched to obtain a plurality of search regions.

[0208] In one embodiment, the above device 1200 acquires the type corresponding to each region to be searched, acquires the position information corresponding to each region to be searched, calculates the corresponding region area according to each position information, determines the storage order of each region to be searched according to the size of the region area, and when storing each region to be searched according to the storage order, stores each region to be searched together with the corresponding type, position information, and region area to obtain a list of regions to be searched.

[0209] In one embodiment, the first response module 1204, in response to a user's first search operation on an image to be searched, obtains the first operation position where the first search operation is located, and determines the search area with the largest area among the search areas to be searched that contains the first operation position as the first search area.

[0210] In one embodiment, the second response module 1206, in response to a user's second search operation on the first search area, obtains the second operation position where the second search operation is located, and determines the search area with an area only smaller than that of the first search area among the search areas to be searched that contains the second operation position as the target search area.

[0211] In one embodiment, the second response module 1206, in response to a user's second search operation on the first search area, obtains the second operation position where the second search operation is located, and determines the search area with the smallest area among the search areas to be searched that contains the second operation position as the target search area.

[0212] In one embodiment, the first response module 1204, in response to a user's first search operation on an image to be searched, obtains the first operation position where the first search operation is located, and determines the search area with the smallest area among the search areas to be searched that contains the first operation position as the first search area.

[0213] In one embodiment, the second response module 1206, in response to a user's second search operation on the first search area, obtains the second operation position where the second search operation is located, and determines the search area with an area only larger than that of the first search area among the search areas to be searched that contains the second operation position as the target search area.

[0214] In one embodiment, the search module 1208 analyzes the target search area to obtain a target search object, and performs a search based on the target search object to obtain a target search result.

[0215] In one embodiment, the second response module 1206, in response to a user's second search operation outside the first search area, determines a corresponding target search area according to the second operation position where the second search operation is located.

[0216] In one embodiment, the second response module 1206 obtains the search result corresponding to the first search area. A supplementary search control is provided on the display page of the search result. In response to a user's supplementary search operation on the control, a supplementary search is performed according to the supplementary search operation.

[0217] In one embodiment, the search module 1208 analyzes the first search area to obtain a first search object, analyzes the target search area to obtain a target search object, and performs a search based on the first search object and the target search object to obtain a target search result.

[0218] In one embodiment, when the target search area is a text area, the search module 1208 performs word segmentation on the text area to obtain at least one word, and in response to the user selecting at least one keyword from the at least one word, determines the at least one keyword as the target search object.

[0219] For the specific limitations of the image search device, reference can be made to the limitations of the image search method in the foregoing text, which will not be elaborated herein. Each module in the above image search device can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or be stored in the memory of the computer device in software form so that the processor can call and execute the operations corresponding to the above respective modules.

[0220] In one embodiment, a computer device is provided. The computer device can be a terminal, and its internal structure diagram can be as Figure 14 shown. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it implements an image search method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0221] Those skilled in the art can understand that Figure 14 the structure shown in

[0222] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented: obtaining a picture to be searched, where the picture to be searched includes multiple regions to be searched; in response to a first search operation of a user on the picture to be searched, determining a corresponding first search region according to a first operation position where the first search operation is located; in response to a second search operation of the user, determining a corresponding target search region according to a second operation position where the second search operation is located; searching the first search region and / or the target search region to obtain a target search result.

[0223] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a trigger search operation of the user, performing a screenshot operation on the current page according to the trigger search operation to obtain a picture to be searched, and performing region recognition on the picture to be searched to obtain multiple search regions.

[0224] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtaining the type corresponding to each region to be searched, obtaining the position information corresponding to each region to be searched, calculating the corresponding region area according to each position information, determining the storage order of each region to be searched according to the size of the region area, and when storing each region to be searched according to the storage order, storing each region to be searched together with the corresponding type, position information, and region area to obtain a list of regions to be searched.

[0225] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a first search operation of the user on the picture to be searched, obtaining a first operation position where the first search operation is located, and determining the region to be searched in the list of regions to be searched that contains the first operation position and has the largest region area as the first search region.

[0226] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a second search operation of the user on the first search region, obtaining a second operation position where the second search operation is located, and determining the region to be searched in the list of regions to be searched that contains the second operation position and has a region area only smaller than the region area of the first search region as the target search region.

[0227] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a second search operation of the user on the first search region, obtaining a second operation position where the second search operation is located, and determining the region to be searched in the list of regions to be searched that contains the second operation position and has the smallest region area as the target search region.

[0228] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a user's first search operation on a picture to be searched, obtain a first operation position where the first search operation is located, and determine, as the first search area, the to-be-searched area in the to-be-searched area list that contains the first operation position and has the smallest area.

[0229] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a user's second search operation on the first search area, obtain a second operation position where the second search operation is located, and determine, as the target search area, the to-be-searched area in the to-be-searched area list that contains the second operation position and has an area only larger than the area of the first search area.

[0230] In one embodiment, when the processor executes the computer program, the following steps are further implemented: analyze the target search area to obtain a target search object, and perform a search based on the target search object to obtain a target search result.

[0231] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a user's second search operation outside the first search area, determine a corresponding target search area according to the second operation position where the second search operation is located.

[0232] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtain a search result corresponding to the first search area, there is a supplementary search control on the display page of the search result, and in response to a user's supplementary search operation on the control, perform a supplementary search according to the supplementary search operation.

[0233] In one embodiment, when the processor executes the computer program, the following steps are further implemented: analyze the first search area to obtain a first search object, analyze the target search area to obtain a target search object, and perform a search based on the first search object and the target search object to obtain a target search result.

[0234] In one embodiment, when the target search area is a text area, when the processor executes the computer program, the following steps are further implemented: perform word segmentation on the text area to obtain at least one word, and in response to a user selecting at least one keyword from the at least one word, determine the at least one keyword as the target search object.

[0235] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: obtaining a picture to be searched, where the picture to be searched includes a plurality of regions to be searched; in response to a first search operation of a user on the picture to be searched, determining a corresponding first search region according to a first operation position where the first search operation is located; in response to a second search operation of the user, determining a corresponding target search region according to a second operation position where the second search operation is located; searching the first search region and / or the target search region to obtain a target search result.

[0236] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a trigger search operation of the user, performing a screenshot operation on the current page according to the trigger search operation to obtain a picture to be searched, and performing region recognition on the picture to be searched to obtain a plurality of search regions.

[0237] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtaining the type corresponding to each region to be searched, obtaining the position information corresponding to each region to be searched, calculating a corresponding region area according to each position information, determining the storage order of each region to be searched according to the size of the region area, and when storing each region to be searched according to the storage order, storing each region to be searched together with the corresponding type, position information, and region area to obtain a list of regions to be searched.

[0238] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a first search operation of the user on the picture to be searched, obtaining a first operation position where the first search operation is located, and determining the region to be searched in the list of regions to be searched that contains the first operation position and has the largest region area as the first search region.

[0239] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a second search operation of the user on the first search region, obtaining a second operation position where the second search operation is located, and determining the region to be searched in the list of regions to be searched that contains the second operation position and has a region area only smaller than the region area of the first search region as the target search region.

[0240] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a second search operation of the user on the first search region, obtaining a second operation position where the second search operation is located, and determining the region to be searched in the list of regions to be searched that contains the second operation position and has the smallest region area as the target search region.

[0241] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a first search operation of the user on the picture to be searched, obtain the first operation position where the first search operation is located, and determine the to-be-searched area with the smallest area among the to-be-searched area list that contains the first operation position as the first search area.

[0242] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a second search operation of the user on the first search area, obtain the second operation position where the second search operation is located, and determine the to-be-searched area with an area only larger than the area of the first search area among the to-be-searched area list that contains the second operation position as the target search area.

[0243] In one embodiment, when the processor executes the computer program, the following steps are further implemented: analyze the target search area to obtain a target search object, and perform a search based on the target search object to obtain a target search result.

[0244] In one embodiment, when the processor executes the computer program, the following steps are further implemented: in response to a second search operation of the user outside the first search area, determine the corresponding target search area according to the second operation position where the second search operation is located.

[0245] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtain the search result corresponding to the first search area, there is a supplementary search control on the display page of the search result, and in response to the supplementary search operation of the user on the control, perform a supplementary search according to the supplementary search operation.

[0246] In one embodiment, when the processor executes the computer program, the following steps are further implemented: analyze the first search area to obtain a first search object, analyze the target search area to obtain a target search object, and perform a search based on the first search object and the target search object to obtain a target search result.

[0247] In one embodiment, when the target search area is a text area, when the processor executes the computer program, the following steps are further implemented: perform word segmentation processing on the text area to obtain at least one word, and in response to the user selecting at least one keyword from the at least one word, determine the at least one keyword as the target search object.

[0248] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the embodiments provided in the present application can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and Rambus dynamic RAM (RDRAM), etc.

[0249] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0250] The above-described embodiments merely represent several implementation manners of the present application. Their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A method for image search, the method comprising: Obtaining an image to be searched, the image to be searched including a plurality of regions to be searched; In response to a first search operation of the user on the image to be searched, determining a corresponding first search region according to a first operation position where the first search operation is located; In response to a second search operation of the user, determining a corresponding target search region according to a second operation position where the second search operation is located; Searching the first search region and / or the target search region to obtain a target search result.

2. The method according to claim 1, characterized in that, The obtaining the image to be searched, the image to be searched including a plurality of regions to be searched, includes: In response to a trigger search operation of the user, performing a screenshot operation on the current page according to the trigger search operation to obtain the image to be searched; Performing region recognition on the image to be searched to obtain a plurality of search regions.

3. The method according to claim 1, characterized in that, After the obtaining the image to be searched, the image to be searched including a plurality of regions to be searched, further includes: Obtaining the type corresponding to each of the regions to be searched; Obtaining the position information corresponding to each of the regions to be searched; Calculating a corresponding region area according to each of the position information; Determining the storage order of each of the regions to be searched according to the size of the region area, and when storing each of the regions to be searched according to the storage order, storing each of the regions to be searched together with the corresponding type, position information, and region area to obtain a list of regions to be searched.

4. The method according to claim 3, wherein The in response to a first search operation of the user on the image to be searched, determining a corresponding first search region according to a first operation position where the first search operation is located, includes: In response to a first search operation of the user on the image to be searched; Obtaining a first operation position where the first search operation is located; Determining the region to be searched in the list of regions to be searched that includes the first operation position and has the largest region area as the first search region.

5. The method according to claim 4, characterized in that, The in response to a second search operation of the user on the first search region, determining a corresponding target search region according to a second operation position where the second search operation is located, includes: In response to a second search operation of the user on the first search region; Obtaining a second operation position where the second search operation is located; Determining the region to be searched in the list of regions to be searched that includes the second operation position and has a region area only smaller than the region area of the first search region as the target search region.

6. The method according to claim 4, wherein The in response to a second search operation of the user on the first search region, determining a corresponding target search region according to a second operation position where the second search operation is located, includes: In response to a second search operation of the user on the first search region; Obtaining a second operation position where the second search operation is located; Determining the region to be searched in the list of regions to be searched that includes the second operation position and has the smallest region area as the target search region.

7. The method according to claim 3, wherein The in response to a first search operation of the user on the image to be searched, determining a corresponding first search region according to a first operation position where the first search operation is located, includes: In response to a first search operation of the user on the image to be searched; Obtain the first operation position where the first search operation is located; Determine that the search area to be searched that contains the first operation position and has the smallest area in the list of search areas to be searched is the first search area.

8. The method according to claim 7, wherein The responding to the user's second search operation on the first search area and determining the corresponding target search area according to the second operation position where the second search operation is located includes: Respond to the user's second search operation on the first search area; Obtain the second operation position where the second search operation is located; Determine that the search area to be searched that contains the second operation position and has an area only larger than the area of the first search area in the list of search areas to be searched is the target search area.

9. The method according to any one of claims 3-8, characterized in that The searching the first search area and / or the target search area to obtain a target search result includes: Analyze the target search area to obtain a target search object; Search according to the target search object to obtain a target search result.

10. The method according to claim 1, wherein The responding to the user's second search operation and determining the corresponding target search area according to the second operation position where the second search operation is located includes: Respond to the user's second search operation outside the first search area; Determine the corresponding target search area according to the second operation position where the second search operation is located.

11. The method according to claim 10, wherein Before the responding to the user's second search operation outside the first search area, it further includes: Obtain the search result corresponding to the first search area; There is a supplementary search control on the display page of the search result; Respond to the user's supplementary search operation on the control and perform a supplementary search according to the supplementary search operation.

12. The method according to any one of claims 10-11, characterized in that, The searching the first search area and / or the target search area to obtain a target search result includes: Analyze the first search area to obtain a first search object; Analyze the target search area to obtain a target search object; Search according to the first search object and the target search object to obtain a target search result.

13. The method according to claim 12, wherein When the target search area is a text area, the analyzing the target search area to obtain a target search object includes: Perform word segmentation on the text area to obtain at least one word; Respond to the user's selection of at least one keyword from the at least one word, and determine the at least one keyword as the target search object.

14. An image search device, characterized in that, The device includes: An acquisition module, configured to acquire a picture to be searched, where the picture to be searched includes a plurality of search areas to be searched; A first response module, configured to respond to the user's first search operation on the picture to be searched, and determine a corresponding first search area according to the first operation position where the first search operation is located; A second response module, configured to respond to the user's second search operation, and determine a corresponding target search area according to the second operation position where the second search operation is located; A search module, configured to search the first search area and / or the target search area to obtain a target search result.

15. A terminal, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 13.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 13.