Searching method and device, electronic equipment and readable storage medium

Abstract

The invention discloses a search method and device, electronic equipment and a readable storage medium, and belongs to the technical field of electronic equipment. The method comprises the following steps: receiving first input; entering an object selection state in response to the first input; receiving a second input in the object selection state; and in response to the second input, displaying a search interface of the first object corresponding to the second input.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to a search method, device, electronic equipment and readable storage medium. Background Art

[0002] Currently, a user can trigger an electronic device to display search results corresponding to the image information by selecting search information. For example, a user can select image content of a local area in an image as search information.

[0003] However, when users use electronic devices, they often make mistaken selections. For example, the user has no intention to search for information, but the electronic device mistakenly identifies the user's interactive behavior as a selection behavior to search for information, and the user needs to cancel the selection, resulting in cumbersome operations. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a search method, device, electronic device and readable storage medium, which can avoid cumbersome operations of users using electronic devices.

[0005] In a first aspect, an embodiment of the present application provides a search method, which includes: receiving a first input; entering an object selection state in response to the first input; receiving a second input in the object selection state; and displaying a search interface for the first object corresponding to the second input in response to the second input.

[0006] In a second aspect, an embodiment of the present application provides a search device, which includes: a receiving module, a processing module and a display module; the receiving module is used to receive a first input; the processing module is used to enter an object selection state in response to the first input; the receiving module is also used to receive a second input in the object selection state; the display module is used to display a search interface for the first object corresponding to the second input in response to the second input.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, the electronic device receives a first input, responds to the first input, enters an object selection state, receives a second input in the object selection state, responds to the second input, and displays a search interface for the first object corresponding to the second input. In this solution, the electronic device can correctly identify the selection behavior of the search information in the object selection state, avoids the situation of misidentification, and avoids the cumbersome operation of the user canceling the selection. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is a flowchart of a search method provided in an embodiment of the present application;

[0013] Figure 2A This is one of the schematic diagrams for calling up a smart sidebar provided in an embodiment of the present application;

[0014] Figure 2B This is a second schematic diagram of calling up a smart sidebar provided in an embodiment of the present application;

[0015] Figure 3 This is one of the schematic diagrams of re-pressing a navigation bar provided in an embodiment of the present application;

[0016] Figure 4 This is a second schematic diagram of re-pressing a navigation bar provided in an embodiment of the present application;

[0017] Figure 5 This is a third schematic diagram of re-pressing a navigation bar provided in an embodiment of the present application;

[0018] Figure 6 This is one of the schematic diagrams of selecting a search object provided in an embodiment of the present application;

[0019] Fig. 7A This is the second schematic diagram of selecting a search object provided in an embodiment of the present application;

[0020] Figure 7B This is a third schematic diagram of selecting a search object provided in an embodiment of the present application;

[0021] Figure 7C This is a fourth schematic diagram of selecting a search object provided in an embodiment of the present application;

[0022] Fig. 8A is a schematic diagram of a click-to-question control provided in an embodiment of the present application;

[0023] Figure 8B is a schematic diagram showing a feedback result of follow-up information provided by an embodiment of the present application;

[0024] Fig. 9A is a schematic diagram of a click-to-question control provided in an embodiment of the present application;

[0025] Fig. 9B is a schematic diagram showing a feedback result of follow-up information provided by an embodiment of the present application;

[0026] Fig.10 is a structural schematic diagram of a search device provided in an embodiment of the present application;

[0027] Fig.11 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;

[0028] Fig.12 This is the second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0030] The following is an explanation of the nouns and terms involved in the claims and description of this application.

[0031] Circle search: A search mode provided by electronic devices. After entering this mode, users can directly circle certain areas on the screen with their fingers and directly trigger a search for images in the circled area.

[0032] Smart Sidebar: A combination of application and service shortcuts that displays different applications or services based on the usage scenarios of different electronic devices.

[0033] Knuckle: The joint structure connecting the bones of the fingers, usually referring to the finger joints.

[0034] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0035] The terms "at least one (item)", "at least one of" and the like in the specification and claims of this application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" means two or more, and its meaning is similar to that of "at least one (item)".

[0036] It should be noted that the search method provided in the embodiments of the present application can be executed by electronic devices such as mobile phones, tablet computers, laptop computers, PDAs, and vehicle-mounted electronic devices. In some embodiments of the present application, the search method provided in the embodiments of the present application is described by taking the electronic device as the execution subject to execute the search method as an example.

[0037] The search method, device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0038] Currently, when searching for partial content in an image on a smartphone, users usually need to go through a series of cumbersome steps: first, they need to capture the image on the screen; then, they need to open a third-party or system-provided image processing software to crop the area of ​​interest from the screenshot; then, they need to start the search app and upload the cropped image for search. This series of operations is not only cumbersome, but also requires a high level of understanding, and is not user-friendly.

[0039] When selecting the search information in the image, the user only needs to circle the area of ​​interest on the screen, and the system will immediately search the area online. However, this direct circle selection method also brings some challenges. Because common operations such as sliding and clicking are similar to circle selection actions, it is sometimes difficult for the system to accurately judge the user's true intention, which may cause false touches and affect the user experience.

[0040] Therefore, in this embodiment, a more intuitive and easier to understand interactive action is designed. Only when the system recognizes this specific interactive action will it enter the state of selecting a part of the image. Such a design is not only more in line with the user's operating habits, but also can effectively reduce the probability of accidental touches and improve the overall user experience.

[0041] Specifically, in the search method provided in the embodiment of the present application, the electronic device receives a first input, responds to the first input, enters an object selection state, receives a second input in the object selection state, responds to the second input, and displays a search interface for the first object corresponding to the second input. In this solution, the electronic device can correctly identify the selection behavior of the search information in the object selection state, avoids the situation of misidentification, and avoids the cumbersome operation of the user canceling the selection.

[0042] The execution subject of the search method provided in this embodiment may be a search device, which may be an electronic device, or a control module or a processing module in the electronic device, etc. The technical solution provided in the embodiment of the present application is described below using an electronic device as an example.

[0043] The present application embodiment provides a search method. Figure 1 FIG. 1 is a flowchart of a search method provided by an embodiment of the present application, which can be applied to electronic devices. Figure 1 As shown, the search method provided in the embodiment of the present application may include the following steps 201 to 204.

[0044] Step 201: An electronic device receives a first input.

[0045] Step 202: The electronic device enters an object selection state in response to a first input.

[0046] In some embodiments of the present application, the first input is used to trigger the electronic device to enter an object selection state.

[0047] Exemplarily, in the above object selection state, the user can select the search object that he wants to search in the interface displayed by the electronic device.

[0048] In some embodiments of the present application, the above-mentioned first input may include a touch input by a user clicking on a display screen area of ​​the electronic device, or a voice command input by a user, or a specific gesture input by a user. The specific input may be determined based on actual usage requirements and is not limited by the embodiments of the present application.

[0049] Exemplarily, the above touch input includes a user sliding input, clicking input, or pressing input on the display screen of the electronic device. The specific gesture in the embodiment of the present application may be any one of a single-click gesture, a sliding gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application may be a single-click input, a double-click input, or any number of click inputs, and the above click input may also be a long-press input or a short-press input.

[0050] Exemplarily, before the user wants to select a search object, the electronic device may be triggered to enter an object selection state by receiving a first input from the user.

[0051] For example, when a certain interface is displayed on the display screen of the electronic device, for example, an interface displaying clothing, if the user wants to search for a certain clothing in the interface displaying clothing, the user can first trigger the electronic device to enter the object selection state through a first input. Then, in the object selection state, the user receives a second input for a certain clothing, and in response to the second input, the electronic device searches for the clothing and displays the search interface corresponding to the clothing.

[0052] In some embodiments of the present application, the first input is at least one of the following: a finger joint trigger input, a function control trigger input, and a navigation key trigger input.

[0053] The following three possible embodiments are used to describe in detail the technical solution for the electronic device to enter the object selection state when the first input is different. In this way, the electronic device can recognize different inputs of the user to trigger the electronic device to enter the object selection state, thereby avoiding the problem of input recognition errors caused by the electronic device confusing the input, thereby improving the efficiency of searching for information.

[0054] In the first possible embodiment:

[0055] In the case where the first input is a knuckle-triggered input, the electronic device uses a knuckle recognition algorithm to identify the user's input on the electronic device screen, that is, whether the first input is a knuckle input. If it is detected that the user's input is a knuckle input, the electronic device enters an object selection state; if it is detected that the user's input is not a knuckle input, the electronic device determines the user's intention based on the input and controls the electronic device to perform a corresponding operation.

[0056] Exemplarily, the above-mentioned knuckle trigger input can be a click input of the knuckle on the screen of the electronic device, or can be a pressing input of the knuckle on the screen of the electronic device.

[0057] In this way, the electronic device can enter a specific state, such as an object selection state, based on identifying the user's knuckle input to accurately determine the user's intention.

[0058] In the second possible embodiment:

[0059] In the case that the first input is a function control trigger input, the electronic device controls the electronic device to enter an object selection state according to the functional purpose of the function control.

[0060] Further, in the embodiment of the present application, the above step 201 "the electronic device receives the first input" specifically includes step 201a:

[0061] Step 201a: The electronic device receives a first input to a function control in a function bar.

[0062] Exemplarily, the above-mentioned function control is used to trigger the electronic device to enter an object selection state.

[0063] Exemplarily, the above-mentioned functional controls may be: geometric figures, pictures, characters, etc., which may be set specifically according to actual needs, and the embodiments of the present application are not limited to this.

[0064] Exemplarily, the above-mentioned function controls can be displayed at any position in the display area of ​​the electronic device, or can be displayed in the function bar. The specific settings can be made according to actual needs, and the embodiments of the present application are not limited to this.

[0065] For example, the object selection state control may be a smart sidebar of an electronic device, that is, a control in the function bar.

[0066] Optionally, in the embodiment of the present application, before the above step 201a, the search method provided in the embodiment of the present application further includes steps 301 and 302:

[0067] Step 301: The electronic device receives a fourth input from the user

[0068] Step 302: When an input parameter of the fourth input satisfies a first condition, the electronic device displays a function control in response to the fourth input.

[0069] In some embodiments of the present application, the fourth input is used to trigger the electronic device to display a function control.

[0070] In some embodiments of the present application, the fourth input may include a touch input of a user clicking on an interface of an electronic device, or a voice command input by a user, or a specific gesture input by a user. The specific input may be determined based on actual usage requirements and is not limited by the embodiments of the present application.

[0071] Exemplarily, the touch input includes a user sliding input on the display screen of the electronic device, or a click input, etc. The specific gesture in the embodiment of the present application may be any one of a single-click gesture, a sliding gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application may be a single-click input, a double-click input, or any number of click inputs, etc., and the click input may also be a long-press input or a short-press input.

[0072] In some embodiments of the present application, the input parameter of the fourth input includes at least one of the following: a starting input position, an input direction, an input distance, and an input type.

[0073] Exemplarily, the input direction may be any direction, for example, sliding from left to right, from right to left, from top to bottom, or from bottom to top.

[0074] In some embodiments of the present application, the first condition includes at least one of the following:

[0075] The starting input position is within the preset area;

[0076] The input direction is the preset direction;

[0077] The input distance is greater than or equal to the preset distance;

[0078] The input type is the second preset input type.

[0079] Exemplarily, the above-mentioned preset area may be any area in a display screen of an electronic device.

[0080] For example, an area 0.5 centimeters (cm) wide on the side of an electronic device, or an area 0.5 cm wide on the top of an electronic device, is not limited in the embodiments of the present application.

[0081] Exemplarily, the preset area is used to display a function control after receiving the fourth input.

[0082] Exemplarily, the above-mentioned preset area may be set by the user himself or by default of the electronic device.

[0083] Exemplarily, the preset direction may be set by the user or by default of the electronic device.

[0084] For example, the preset distance may be set by the user or by default of the electronic device, for example, 1 cm, 0.5 cm, or 0.3 cm.

[0085] Exemplarily, the above-mentioned preset input type may be the duration of stay.

[0086] For example, Figure 2A As shown in FIG. 1 , the user can start from the left or right edge of the display screen of the electronic device and slide inwards to an area exceeding 1 / 3 of the screen width, and keep pausing for 0.5 seconds after the sliding is completed. Figure 2B As shown, the smart sidebar 21, that is, the above-mentioned function bar will be triggered and displayed, wherein the function control 22 is displayed in the smart sidebar, such as circle search. The user can trigger the electronic device to enter the object selection state by clicking the function control 22.

[0087] In this way, users can quickly enter the object selection state through the smart sidebar. This trigger mechanism can quickly respond to user operations, reduce waiting time, and improve search efficiency.

[0088] In the third possible embodiment:

[0089] In the case that the first input is a navigation key trigger input, the electronic device can determine whether the electronic device enters the object selection state by identifying the pressure value of the user pressing a specific navigation key.

[0090] Exemplarily, if it is recognized that the pressure value of the user pressing a specific navigation key is greater than or equal to the preset pressure value, the electronic device enters the object selection state; if it is recognized that the pressure value of the user pressing a specific navigation key is less than the preset pressure value, the electronic device performs the operation according to the corresponding function of the navigation key.

[0091] Exemplarily, the preset pressure value may be customized by the electronic device or may be set by the user.

[0092] For example, when the first button is a virtual button, Figure 3 As shown, if the navigation mode of the electronic device is full-screen gesture, the first button is the input of the navigation bar 31 below the display screen; Figure 4 As shown, if the navigation mode of the electronic device is a navigation key mode, the first button is any navigation key below the display screen, such as the home button 41; Figure 5 As shown, if the navigation mode of the electronic device is the classic three-segment mode, the first button is any navigation bar below the display screen, such as the navigation bar 51 in the middle segment.

[0093] Exemplarily, the first button may also be a physical button.

[0094] For example, when the first button is a physical button, it may be a volume button, a home button, or a power button.

[0095] Thus, considering that different users may have different perceptions and preferences for pressure, this embodiment can provide a personalized preset pressure value setting function. Users can adjust the size of the preset pressure value according to their own habits and preferences, so that the interaction is more in line with personal needs.

[0096] Step 203: The electronic device receives a second input in the object selection state.

[0097] In some embodiments of the present application, the electronic device receives a second input from the user on the first interface in an object selection state.

[0098] In some embodiments of the present application, the first interface is an interface for displaying the search object, that is, the first object, in the electronic device.

[0099] In some embodiments of the present application, the first interface may be any interactive interface.

[0100] For example, a desktop interface, an application interface, a conversation interface, a web page, a shopping interface, or an image display interface.

[0101] In some embodiments of the present application, the first interface may include images, text, voice or video.

[0102] In some embodiments of the present application, the second input is used to select the first interface to enter the object selection state.

[0103] Exemplarily, in the above-mentioned object selection state, the user can select the search object that he wants to search, that is, the first object described below, in the first interface displayed by the electronic device through the second input.

[0104] In some embodiments of the present application, the second input may include a touch input in which a user clicks on a display screen area of ​​the electronic device, or a voice command input by a user, or a specific gesture input by a user. The specific input may be determined based on actual usage requirements and is not limited in the embodiments of the present application.

[0105] Exemplarily, the above touch input includes a user sliding input, clicking input, or pressing input on the display screen of the electronic device. The specific gesture in the embodiment of the present application may be any one of a single-click gesture, a sliding gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application may be a single-click input, a double-click input, or any number of click inputs, and the above click input may also be a long-press input or a short-press input.

[0106] In some embodiments of the present application, the second input may be a knuckle input, a two-finger input, or a three-finger input.

[0107] Optionally, in some embodiments of the present application, the second input may include: a circle selection input by a user's finger joint on the first interface, or a smear input by a user's finger joint on the first interface, and step 203 may include step 203a or step 203b:

[0108] Step 203a: The electronic device receives a circle selection input by the user's finger joint on the first interface.

[0109] The first object may include an object located within a circle selection track of the circle selection input in the first interface.

[0110] For the description of the first interface, please refer to the relevant description of the first interface in the above embodiment. In order to avoid repetition, it will not be repeated here.

[0111] For example, Figure 6 is a display interface of a landscape image 60, such as Figure 6 As shown, the user can circle the building element 61 in the landscape image 60 with his finger joints, and the electronic device can select the building element 61 in the landscape image 60; that is, the electronic device selects the object located within the circle track of the circle input in the first interface, that is, the above-mentioned first object.

[0112] Step 203b: The electronic device receives a smear input by the user's finger joints on the first interface.

[0113] The first search object may include an object that a smearing track of the smear input passes through in the first interface.

[0114] For example, Fig. 7A As shown, the electronic device displays a social sharing interface, which includes a character image 70 shared by netizens; if the user is interested in the headband element 71 on the character image 70, Figure 7B As shown, the user can use the knuckles to paint on the headband element 71 of the character image 70, so as to Figure 7C As shown, the electronic device can select the headband element 71 in the character image 70, that is, select the object through which the smearing track of the smearing input passes in the first interface.

[0115] In the above steps 203a and 203b, since the knuckles have the advantages of small force bearing area and not easy to be accidentally touched, applying the knuckle interaction to the interface element selection can improve the accuracy of the interface element selection.

[0116] It should be noted that this embodiment can further expand the scenarios of multi-fingertip collaborative operation, for example, by drawing circles with two fingers at the same time, a more complex or more accurate search function can be achieved. This method of finger joint collaborative operation can provide users with more interactive options and personalized experience.

[0117] In this way, since the knuckles have the advantages of small force area and not easy to touch by mistake, some interface elements in the first interface can be selected as search information by smearing or circling on the first interface with the knuckles, the accuracy of the search information can be achieved, thereby improving the accuracy of the search results.

[0118] Step 204: In response to the second input, the electronic device displays a search interface for the first object corresponding to the second input.

[0119] In some embodiments of the present application, the first object is an object selected by the user through the second input.

[0120] In some embodiments of the present application, the first object is: a search object corresponding to the input track of the second input in the first interface.

[0121] In some embodiments of the present application, the first object may be an object in any interactive interface.

[0122] Exemplarily, the first object may include at least one type of object among text, image, voice and video.

[0123] When the first object includes one type of information among text, image, voice and video, the first object can be called unimodal information. When the first object can include at least two types of information among text, image, voice and video, the first object can be called multimodal information.

[0124] For example, the user can select at least one conversation message in the conversation interface through the second input, and the conversation interface is the above-mentioned first interface. The at least one conversation message may include: at least one of an image message, a voice message, a text message and a video message.

[0125] For example, the user can select some image elements in the image from the display interface of the image through the second input, such as selecting an architectural element, a beam element with carved beams and painted buildings, a commodity element, etc., wherein the display interface of the image is the above-mentioned first interface.

[0126] In some embodiments of the present application, the above-mentioned search interface is an interface obtained based on the search of the first object.

[0127] In some embodiments of the present application, the above-mentioned search interface displays the search information obtained after the electronic device searches for the first object.

[0128] It should be noted that the above-mentioned first input and second input can be continuous inputs. When the electronic device recognizes the input of the user's knuckles touching the display screen, that is, the above-mentioned first input, the electronic device enters the object selection state, and then the user uses the user's knuckles to perform a circle selection input in the first interface, that is, the above-mentioned second input, and determines the first search object according to the circle selection trajectory, and finally displays the search results according to the determined search object.

[0129] Optionally, in some embodiments of the present application, before "the electronic device displays a search interface for the first object corresponding to the second input in response to the second input" in the above step 204, the search method provided by the present application further includes step 401 or step 402:

[0130] Step 401: The electronic device determines an object in an area enclosed by an input track of a second input in a first interface as a first object.

[0131] In some embodiments of the present application, the input trajectory is a closed shape.

[0132] For example, the closed shape may be a circle, a rectangle, a polygon, or an irregular closed shape, and the present application does not impose any limitation on this.

[0133] Exemplarily, the starting position and the ending position of the second input should be the same position.

[0134] Step 402: The electronic device determines the object passed by the input track of the second input in the first interface as the first search object.

[0135] In some embodiments of the present application, the user smears in the first interface, and determines the corresponding object shown in the area passed by the input track of the smear input as the search object.

[0136] It is understandable that in the object selection state, this embodiment can also dynamically adjust the image search range according to the size and position of the circle drawn by the user. This dynamic adjustment method can more accurately meet the user's search needs and improve the accuracy and relevance of the search results.

[0137] Thus, this embodiment provides a unique circle drawing trajectory determination mechanism, which determines the starting point, end point and trajectory continuity of the user's circle drawing to ensure that the circle selection search mode is triggered only when the user draws a complete circle. This determination mechanism effectively avoids misoperation and improves the accuracy and reliability of interaction.

[0138] In the search method provided in the embodiment of the present application, the electronic device receives a first input, responds to the first input, enters an object selection state, receives a second input in the object selection state, responds to the second input, and displays a search interface for the first object corresponding to the second input. In this solution, the electronic device can correctly identify the selection behavior of the search information in the object selection state, avoids the situation of misidentification, and avoids the cumbersome operation of the user canceling the selection.

[0139] Optionally, in some embodiments of the present application, the electronic device is a mobile phone, and the search method provided in the embodiments of the present application is described in detail through different ways of triggering the electronic device to enter the object selection state.

[0140] Method 1: Through the smart sidebar

[0141] In a possible embodiment, the user slides inward on the edge of the display screen of the electronic device and holds it for 1 second, i.e., the fourth input, to call out the smart sidebar, i.e., the function bar. The smart sidebar provides an object selection state control, and the user clicks the icon, i.e., the first input, to trigger the electronic device to enter the object selection state. Specifically, steps A1 to A4 are included:

[0142] Step A1: When the electronic device displays a certain interface, the user starts from the left or right screen edge of the phone and slides inwards over 1 / 3 of the screen width with a finger, and pauses for 0.5 seconds after the sliding is completed. At this time, the smart sidebar will be triggered and displayed.

[0143] Exemplarily, when a user is using a mobile phone, the user can perform this step operation no matter which interface the user is currently in.

[0144] Step A2: Multiple quick function entrances are displayed in the smart sidebar, including a quick function icon for circle-select image search, i.e., the above-mentioned function control. The user can select the icon by visual inspection or touch, i.e., the above-mentioned first input.

[0145] Step A3: After the user clicks the quick function icon of the circle search function, the mobile phone will immediately enter the circle search mode, that is, the object selection state mentioned above. In this mode, the user can freely circle the image content on the current mobile phone interface, that is, the second input mentioned above, and the search interface of the selected image content will be displayed.

[0146] Step A4: In the circle selection search mode, the user can use a finger or a dedicated drawing tool to perform a circle selection operation. When the circle selection is completed, the electronic device will automatically identify the circled area and start the search function to display the search interface with the circled content, that is, the first object mentioned above. If the user needs to exit the circle selection search mode, it can be achieved by clicking the close button in the upper left corner of the interface.

[0147] In this way, after selecting a function control, the electronic device can confirm that it has entered the object selection state, and then determine the input of the search object, thereby avoiding the problem of the electronic device misidentifying the input intention and improving the accuracy of selecting the search object.

[0148] Method 2: Press the navigation bar again, i.e. the navigation key mentioned above

[0149] In a possible embodiment, the user presses the home button or navigation bar of the mobile phone again to trigger the electronic device to enter the object selection state. Specifically, steps B1 to B3 are included:

[0150] Step B1: The user operates the mobile phone normally and stays on any interface where he wants to search for images, that is, the first interface mentioned above.

[0151] Step B2: Perform corresponding interactive operations based on the navigation method currently used by the user:

[0152] Full screen gestures: see Figure 3 For full-screen gesture navigation, the user needs to press the small horizontal bar 21 at the bottom of the screen. At this time, the built-in pressure sensor of the mobile phone will detect the pressure change of the small horizontal bar 21. When the pressure gravity, that is, the first pressure value mentioned above exceeds the preset pressure value, the mobile phone will automatically enter the circle selection image search mode.

[0153] It is understandable that the preset pressure value can be customized according to different mobile phone models.

[0154] Navigation key: Reference Figure 4 For the navigation key navigation mode, the user needs to re-press the navigation home key 31. Similarly, the mobile phone will detect the pressure change of the home key 31 and trigger the circle selection image search mode when the pressure value exceeds the preset pressure value.

[0155] Classic three-stage: reference Figure 5 Based on the classic three-stage navigation method, the user needs to press the middle horizontal bar 41. At this time, the mobile phone will detect the pressure on the horizontal bar 41 and trigger the circle selection image search mode when the pressure value exceeds the preset pressure value.

[0156] Step B3: In the circle search state, the user can easily circle and perform the search operation in the mobile phone interface. If you want to exit, you can exit through the close button in the upper left corner.

[0157] It should be noted that this embodiment uses advanced pressure detection and recognition technology to accurately sense the pressure changes when the user presses the navigation bar. Through the built-in pressure sensor and algorithm, the system can capture and analyze the user's pressing behavior in real time and accurately identify different levels of pressure.

[0158] Thus, this embodiment sets one or more preset pressure values ​​to determine the user's intention when pressing the navigation bar. When the user's pressing pressure exceeds the preset pressure value, the system will automatically trigger the circle selection image search mode. This preset pressure value setting and determination mechanism ensures the accuracy and reliability of the interaction and avoids the occurrence of misoperation.

[0159] Method 3: Knuckle trigger

[0160] In a possible embodiment, the user presses on the interface with a knuckle, i.e., the first input, to trigger the object selection state. Then, the user can circle or smear the search object on the screen with a knuckle, i.e., the second input. When the knuckle leaves the mobile phone desktop, the electronic device is triggered to search for the circled or smeared search object. Specifically, steps C1 to C5 are included:

[0161] Step C1: The user operates the mobile phone normally and stays on any interface where he wants to search for images, that is, the first interface mentioned above.

[0162] Step C2: The mobile phone detects the user's operation mode in real time through the built-in sensor and bone joint recognition algorithm. Once it is recognized that the user presses on the interface with the knuckles, it triggers the entry into the object selection state or the circle selection image search mode.

[0163] Step C3: The mobile phone receives the user's input of circling or smearing on the screen through the knuckles, and the screen starts to record the trajectory of the knuckle sliding or smearing, and displays it on the screen in a visual way to provide intuitive feedback to the user.

[0164] Step C4: When the knuckle sliding track forms a complete circle, the system determines it as a valid circle selection operation. At this time, if the user lifts the knuckle off the screen, the system will immediately enter the circle selection image search mode.

[0165] Step C5: After entering the circle-select image search mode, the mobile phone immediately searches for the circled image and displays the search results on the mobile phone screen for the user to view.

[0166] Thus, this embodiment uses an advanced knuckle recognition algorithm to accurately recognize the user's knuckle circle operation on the mobile phone. The algorithm can accurately recognize the knuckle operation by capturing and analyzing the user's finger movement trajectory, effectively preventing accidental touch operations and improving the user experience.

[0167] Optionally, in some embodiments of the present application, when the above-mentioned search interface includes: search results corresponding to the first object and a query control, the search method provided by the embodiment of the present application further includes step 501 and step 502:

[0168] Step 501: The electronic device receives a third input to a query control.

[0169] In some embodiments of the present application, the above-mentioned query control is used to perform a query search on the search results displayed in the search interface.

[0170] In some embodiments of the present application, "the query control is used to perform a query search on the first search result" may include: 1) inputting additional query information through the query control, so that the electronic device combines the query information with the object information of the first object to perform a joint search to update the search interface. 2) inputting query information through the query control, so that the electronic device can correct, edit, extend, refine or specifically describe the search results in the search interface in combination with the query information.

[0171] Among them, extended refinement can be understood as a more detailed and specific description of the search results in the search interface, or a targeted and refined description of a part of the search results in the search interface, which can be determined specifically based on the follow-up information.

[0172] Step 502: The electronic device displays a feedback result of the follow-up information corresponding to the third input in response to the third input.

[0173] In some embodiments of the present application, the third input may include question information input by the user in the question control.

[0174] In some embodiments of the present application, the additional information includes at least one of the following: text, image, audio, and video.

[0175] In some embodiments of the present application, the above-mentioned inquiry information may be a question or an instruction.

[0176] For example, the follow-up information may be "Are U-shaped pillows useful?" or "Book a hotel near the palace tomorrow."

[0177] Further, in some embodiments of the present application, the above step 502 specifically includes step 502a:

[0178] Step 502a: The electronic device displays a query interface in response to the fifth input.

[0179] In some embodiments of the present application, the above-mentioned inquiry interface includes a feedback result of the inquiry information corresponding to the fifth input.

[0180] In some embodiments of the present application, when the above-mentioned follow-up information is a question, the feedback result of the follow-up information is a question-and-answer result.

[0181] For example, combined with Figure 6 ,like Fig. 8AAs shown, the search result in the search interface is "This building is the only remaining example of an ancient famous hall-style building. The building is located on C Road, B District, City A." and a "Ask Again" control 81 is displayed. Then, if Figure 8B As shown, if the inquiry information input through the "Ask Again" control 81 (i.e., the inquiry control) is the text "What other attractions are suitable for tourism in the surrounding area?", the electronic device can display the extended results of the search results in the search interface, that is, the feedback result of the inquiry information: "The attractions near the palace are: D Square, Art District, E Street, Park, etc."

[0182] In some embodiments of the present application, when the above-mentioned inquiry information is an instruction, the feedback result of the inquiry information is the instruction execution result.

[0183] For example, the user takes the blood test report as the first object, so Fig. 9A As shown, the electronic device can continue to display the routine blood test form 90, and display part of the interpretation result 91 of the routine blood test form 90 and the question control 92. The user can click the question control 92 and enter the command "help me register". At this time, the electronic device can enter the registration page of at least one associated hospital, such as the outpatient registration page of at least one hospital that is close to the user, that is, the above feedback result. Specifically, Fig. 9B As shown, the electronic device can display the outpatient registration page 93 of the XX hospital closest to the user. The outpatient registration page 93 may include registration information of at least one outpatient doctor. The user can make an appointment with the relevant doctor according to his actual medical needs.

[0184] Alternatively, the user can click the question control 92 and enter the command "online consultation" to jump to the online consultation page of at least one associated hospital, that is, the above feedback result. At this time, the user can realize online consultation by entering instructions in the question control 92.

[0185] In this way, the user can input additional search information through the query control, so that the electronic device performs an additional search in association with the additional search information and the first search result, thereby quickly obtaining search results that meet the user's needs.

[0186] Each of the above-mentioned method embodiments, or various possible implementation methods in each method embodiment can be executed separately, or any two or more of them can be executed in combination with each other. The specific implementation method can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0187] The search method provided in the embodiment of the present application can be executed by an electronic device or a search device. In the embodiment of the present application, the search device provided in the embodiment of the present application is described by taking the search method executed by the search device as an example.

[0188] Fig.10 A possible structural diagram of a search device involved in an embodiment of the present application is shown. Fig.10 As shown, the search device 700 may include: a receiving module 701, a processing module 702 and a display module 703;

[0189] Among them, the above-mentioned receiving module 701 is used to receive a first input; the above-mentioned processing module 702 is used to enter an object selection state in response to the first input; the above-mentioned receiving module 701 is also used to receive a second input in the object selection state; the above-mentioned display module 703 is used to display a search interface of the first object corresponding to the second input in response to the second input.

[0190] Optionally, in some embodiments of the present application, the first input is at least one of the following: a finger joint trigger input, a function control trigger input, and a navigation key trigger input.

[0191] Optionally, in some embodiments of the present application, the receiving module 701 is specifically configured to receive a first input to a function control in a function bar.

[0192] Optionally, in some embodiments of the present application, the search interface includes: search results and follow-up control corresponding to the first object; the receiving module 701 is also used to receive a third input to the follow-up control; the display module 703 is also used to respond to the third input and display feedback results of the follow-up information corresponding to the third input.

[0193] Optionally, in some embodiments of the present application, the first inquiry information is a question, and the feedback result of the first inquiry information is a question and answer result; or, the first inquiry information is an instruction, and the feedback result of the first inquiry information is an instruction execution result.

[0194] Optionally, in some embodiments of the present application, the additional information includes at least one of the following: text, image, audio, and video.

[0195] Optionally, in some embodiments of the present application, the display module 703 is specifically configured to display a follow-up questioning interface in response to the fifth input; the follow-up questioning interface includes a feedback result of the follow-up questioning information corresponding to the fifth input.

[0196] In the search device provided in the embodiment of the present application, the electronic device receives a first input, responds to the first input, enters an object selection state, receives a second input in the object selection state, responds to the second input, and displays a search interface for the first object corresponding to the second input. In this solution, the electronic device can correctly identify the selection behavior of the search information in the object selection state, avoids the situation of misidentification, and avoids the cumbersome operation of the user canceling the selection.

[0197] The search device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0198] The search device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0199] The search device provided in the embodiment of the present application can implement each process implemented in the embodiment of the search method, and to avoid repetition, it will not be described again here.

[0200] Alternatively, if Fig.11 As shown, an embodiment of the present application also provides an electronic device 800, including a processor 801 and a memory 802, wherein the memory 802 stores programs or instructions that can be executed on the processor 801, and when the program or instructions are executed by the processor 801, the various steps of the above-mentioned search method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

[0201] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0202] Fig.12 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0203] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0204] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.12 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0205] Among them, the above-mentioned user input unit 107 is used to receive a first input; the above-mentioned processor 110 is used to enter an object selection state in response to the first input; the above-mentioned user input unit 107 is also used to receive a second input in the object selection state; the above-mentioned display unit 106 is used to display a search interface of the first object corresponding to the second input in response to the second input.

[0206] Optionally, in some embodiments of the present application, the first input is at least one of the following: a finger joint trigger input, a function control trigger input, and a navigation key trigger input.

[0207] Optionally, in some embodiments of the present application, the user input unit 107 is specifically used to receive a first input to a function control in the function bar.

[0208] Optionally, in some embodiments of the present application, the search interface includes: search results and follow-up control corresponding to the first object; the user input unit 107 is also used to receive a third input to the follow-up control; the display unit 106 is also used to respond to the third input and display feedback results of the follow-up information corresponding to the third input.

[0209] Optionally, in some embodiments of the present application, the first inquiry information is a question, and the feedback result of the first inquiry information is a question and answer result; or, the first inquiry information is an instruction, and the feedback result of the first inquiry information is an instruction execution result.

[0210] Optionally, in some embodiments of the present application, the additional information includes at least one of the following: text, image, audio, and video.

[0211] Optionally, in some embodiments of the present application, the display unit 106 is specifically configured to display a follow-up questioning interface in response to the fifth input; the follow-up questioning interface includes a feedback result of the follow-up questioning information corresponding to the fifth input.

[0212] In the electronic device provided in the embodiment of the present application, the electronic device receives a first input, responds to the first input, enters an object selection state, receives a second input in the object selection state, responds to the second input, and displays a search interface for the first object corresponding to the second input. In this solution, the electronic device can correctly identify the selection behavior of the search information in the object selection state, avoids the situation of misidentification, and avoids the cumbersome operation of the user canceling the selection.

[0213] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0214] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0215] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0216] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned search method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0217] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0218] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned search method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0219] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0220] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned search method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0221] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0222] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0223] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A search method, characterized in that: The method comprises: receiving a first input; In response to the first input, entering an object selection state; In the object selection state, receiving a second input; In response to the second input, a search interface for the first object corresponding to the second input is displayed.

2. The method according to claim 1, characterized in that The first input is at least one of the following: a finger joint trigger input, a function control trigger input, and a navigation key trigger input.

3. The method according to claim 1, characterized in that The receiving a first input comprises: A first input to a function control in the function bar is received.

4. The method according to claim 1, characterized in that: The search interface includes: search results corresponding to the first object and a query control; The method further comprises: receiving a third input to the question control; In response to the third input, a feedback result of the follow-up information corresponding to the third input is displayed.

5. The method according to claim 4, characterized in that The first inquiry information is a question, and the feedback result of the first inquiry information is a question-answering result; or, the first inquiry information is an instruction, and the feedback result of the first inquiry information is an instruction execution result.

6. The method according to claim 4, characterized in that The additional information includes at least one of the following: text, image, audio, and video.

7. The method according to claim 4, characterized in that The step of displaying the feedback result of the follow-up information corresponding to the fifth input in response to the fifth input includes: In response to the fifth input, a follow-up question interface is displayed; the follow-up question interface includes a feedback result of the follow-up question information corresponding to the fifth input.

8. A search device, characterized in that: The search device comprises: a receiving module, a processing module and a display module; The receiving module is used to receive a first input; The processing module is configured to enter an object selection state in response to the first input received by the receiving module; The receiving module is used to receive a second input in the object selection state; The display module is configured to display a search interface for the first object corresponding to the second input in response to the second input received by the receiving module.

9. An electronic device, characterized in that: The method comprises a processor, a memory and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the search method as claimed in any one of claims 1 to 7.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the search method according to any one of claims 1 to 7 are implemented.

Images