Control method and device and electronic equipment

Abstract

The invention discloses a control method and device and electronic equipment, and belongs to the technical field of images. The control method comprises the following steps: receiving a first input of a target image; and in response to the first input, determining a target application program corresponding to the target image and a target action corresponding to the image feature information of the target image. And controlling the target application program to execute the target action according to the image feature information of the target image.

Description

Technical Field

[0001] The present application belongs to the field of image technology, and specifically relates to a control method, device and electronic equipment. Background Art

[0002] With the development of electronic devices, there are more and more types of applications, including shopping applications, sports applications, food applications, etc. Users can buy various items through shopping applications, exercise various parts of the body through sports applications, and experience food from all over the country through food applications. It can be seen that the increasing number of applications in electronic devices makes people's lives more and more convenient.

[0003] When using an application, users often need to go through multiple steps to make the electronic device control the application to perform an action. Based on their operating habits, users will frequently make the electronic device control the application to perform an action, which makes the operation cumbersome. For example, if a user has a pet puppy, he or she needs to frequently control the application to perform the action of searching for dog food items so as to buy items for the puppy. In order to make the electronic device control the application to perform the action of searching for dog food items, a series of operations are performed, including clicking the icon of the shopping application in the desktop interface, Figure 1 is a schematic diagram of an interface of an electronic device of the prior art in some embodiments of the present application, such as Figure 1 As shown, the application (application, app) 1 icon 10001, so that the screen displays the home page of the application; further, Figure 2 is a schematic diagram of an interface of an electronic device of the prior art in some embodiments of the present application, such as Figure 2 As shown, a search box 201 is displayed on the home page, and the user fills in the name of the item, such as dog food, in the search box 201, and then clicks the search control, so that the electronic device controls the shopping application to perform the action of searching for dog food items, and finally multiple searched item results can be displayed to the user.

[0004] It can be seen that in the prior art, the user needs to perform a series of operations to enable the electronic device to control the application program to perform corresponding actions. The entire process is cumbersome and the implementation cost is high. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a control method that can solve the problems of complicated operation and high implementation cost.

[0006] In a first aspect, an embodiment of the present application provides a control method, the method comprising:

[0007] Receiving a first input of a target image;

[0008] In response to the first input, determining a target application corresponding to the target image and a target action corresponding to image feature information of the target image;

[0009] The target application is controlled to execute the target action according to the image feature information of the target image.

[0010] In a second aspect, an embodiment of the present application provides a control device, the device comprising:

[0011] A first receiving module, configured to receive a first input of a target image;

[0012] A first determination module, configured to determine, in response to the first input, a target application corresponding to the target image and a target action corresponding to image feature information of the target image;

[0013] A control module is used to control the target application to perform the target action according to the image feature information of the target image.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps described in the first aspect are implemented.

[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0018] In an embodiment of the present application, a first input to a target image is received. In response to the first input, a target application corresponding to the target image and a target action corresponding to the image feature information of the target image are determined. The target application is controlled to perform the target action according to the image feature information of the target image. Compared with a method in which a series of operations are required to achieve the target action, in this way, the user can control the target application to perform the target action through the first input to the target image, which can simplify the operation process and reduce the implementation cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic diagram of an interface of an electronic device in the prior art of some embodiments of the present application;

[0020] Figure 2 is a schematic diagram of an interface of an electronic device in the prior art of some embodiments of the present application;

[0021] Figure 3 is a flow chart of a control method of some embodiments of the present application;

[0022] Figure 4 is a schematic diagram of an interface of an electronic device in some embodiments of the present application;

[0023] Figure 5 is a schematic diagram of an interface of an electronic device in some embodiments of the present application;

[0024] Figure 6 is a schematic diagram of an interface of an electronic device in some embodiments of the present application;

[0025] Figure 7 is a schematic diagram of an interface of an electronic device in some embodiments of the present application;

[0026] Figure 8 is a schematic diagram of an interface of an electronic device in some embodiments of the present application;

[0027] Fig. 9 is a schematic diagram of an interface of an electronic device in some embodiments of the present application;

[0028] Fig.10 is a schematic diagram of an interface of an electronic device in some embodiments of the present application;

[0029] Fig.11 is a block diagram of a control device of some embodiments of the present application;

[0030] Fig.12 Schematic diagram of the hardware structure of the electronic device of some embodiments of the present application;

[0031] Fig.13 It is a schematic diagram of the hardware structure of an electronic device of some embodiments of the present application. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present application belong to the scope of protection of this application.

[0033] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally a class, and the number of objects is not limited. For example, the target object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0034] The control method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0035] Figure 3 is a flow chart of the control method of some embodiments of the present application, such as Figure 3 FIG. 1 is a flowchart of a control method according to an embodiment of the present application, and takes the method applied to an electronic device as an example. The method includes:

[0036] Step 110: Receive a first input of a target image.

[0037] The target image may be an image inserted by a user in the display area, and accordingly, the first input may be performed on the displayed target image. Figure 4 is a schematic diagram of an interface of an electronic device of some embodiments of the present application, such as Figure 4 As shown, the user inserts an image 401 in a blank area of ​​the desktop interface, thereby displaying the image 401. Optionally, the image may be from a photo album application or may be recommended by the system.

[0038] For example, in one application scenario, when a user uses a shopping application, most of the time he or she is buying items for a pet dog. Therefore, the operations performed by the user in the shopping application are all centered around the pet dog's needs. At this time, the user can insert an image of a pet dog in a blank area of ​​the desktop interface.

[0039] In another application scenario, when users use a food application, most of the time they are looking for food stores in a city. Therefore, the operations performed by users in the food application are all centered around the city. At this time, users can insert an image of the city map in a blank area of ​​the desktop interface.

[0040] Optionally, the image is a static image.

[0041] In some embodiments of the present application, the above-mentioned first input is used for the user to operate on the target image to trigger the target application corresponding to the image feature information of the target image to automatically execute the target action corresponding to the image feature information of the target image. The first input can be a first operation. Exemplarily, the above-mentioned first input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiments of the present application are not limited. The specific gesture in the embodiments of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0042] Step 120: In response to the first input, determine a target application corresponding to the target image and a target action corresponding to the image feature information of the target image.

[0043] Optionally, the target application corresponding to the target image may be an application that has a first binding relationship established with the target image in advance, and the target action corresponding to the image feature information of the target image may be an action that has a second binding relationship established with the target image in advance. On the basis of pre-establishing the first binding relationship with the application and the second binding relationship with the action executable by the application based on the image feature information, the first input may be a long press operation performed on a certain area of ​​the target image.

[0044] Among them, based on the first binding relationship, the application bound to the image feature information of the target image can be called as the target application. Furthermore, based on the second binding relationship, the action bound to the image feature information of the target image can be determined as the target action, which is at least one action that the bound application can perform.

[0045] Image feature information can represent what object is presented in the image. For example, based on the image feature information, it can be clearly concluded that the object in the image is a dog. Therefore, the binding relationship between image feature information and applications and actions can be understood as the binding relationship between objects and applications and actions.

[0046] For example, the target image is an image of a dog, the bound target application may be a shopping application, and the bound target action may be searching for dog-related items in the item search bar of the shopping application, and the items may not be limited to dog food, dog toys, and dog clothes. Accordingly, the specific action of controlling the target application to perform may be: entering the homepage of the shopping application, automatically filling in the keyword "dog-related items" in the item search bar, and then triggering the search control. Because users often have the same or similar needs in their daily lives, for example, users often frequently buy items such as toys, clothes, and food for their puppies. Therefore, users often frequently control the electronic device to control the application to perform the action of searching for dog-related items. In the embodiment of the present application, the user can control the electronic device to control the purchasing application to search for dog-related items only through the first input, thereby simplifying the operating steps of controlling the application to perform the action of searching for dog-related items and reducing the implementation cost.

[0047] Step 130: Control the target application to execute the target action according to the image feature information of the target image.

[0048] In this step, based on the user's first input to the target image, the corresponding target application automatically executes the corresponding target action, so that the page of the application obtained by executing the target action can be finally presented to the user.

[0049] For example, taking the target action of searching for dog food items in the item search bar of a shopping application as an example, Figure 5 is a schematic diagram of an interface of an electronic device in some embodiments of the present application, Figure 5 In the example, the page of the application displayed is a page of search results for purchasing the application, and the search results include multiple dog food item results.

[0050] Furthermore, when a binding relationship established based on a certain image is no longer needed, the user can delete the target image in the desktop interface, and the binding relationship will be deleted accordingly. Figure 6 is a schematic diagram of an interface of an electronic device of some embodiments of the present application, such as Figure 6 As shown, the user can perform a long press at any position of the image to trigger the electronic device to display an option 601 for deleting the image. The user can delete the image by clicking the option 601 for deleting the image, thereby deleting the binding relationship.

[0051] Furthermore, the user can insert multiple images as target images in the desktop interface, and the user can switch the displayed target images, and different target images have different binding relationships. Figure 6As shown, the user can trigger the electronic device to display option 602 for changing the image by long pressing any position of the currently displayed target image. The user can trigger the electronic device to change the currently displayed target image by clicking option 602 for changing the image.

[0052] In an embodiment of the present application, a user can select an image as a target image to be displayed in a blank area such as a desktop interface. Based on the image feature information of the target image, a first binding relationship with the application and a second binding relationship with the action are pre-created. When the user makes a first input to the target image, the system automatically starts the bound target application, and automatically executes the bound target action through the target application, thereby directly displaying the obtained action execution result, that is, a page of the application. The embodiment of the present application can be applied to scenarios where users repeatedly perform certain operations in a certain application. In such scenarios, users only need to make simple inputs such as long pressing on the image to trigger the application to automatically execute the action, thereby getting rid of the traditional steps of users frequently clicking on application icons and frequently performing certain operations. It can be seen that the embodiment of the present application can use image features to provide a shortcut operation method, which can improve the convenience and playability of user operations.

[0053] In summary, in the control method provided in the embodiment of the present application, a first input to a target image is received. In response to the first input, a target application corresponding to the target image and a target action corresponding to the image feature information of the target image are determined. The target application is controlled to perform the target action according to the image feature information of the target image. Compared with the method of achieving the target action through a series of operations, in this way, the user can control the target application to perform the target action through the first input to the target image, which can simplify the operation process and reduce the implementation cost.

[0054] In the process of the control method of another embodiment of the present application, before the step of receiving the first input of the image, the method further includes:

[0055] Step A1: receiving a second input of a target image and a target application.

[0056] In some embodiments of the present application, the second input is used to create a corresponding relationship between the target image and the target application, that is, to create a first binding relationship. The second input can be a second operation. Exemplarily, the second input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiments of the present application are not limited. The specific gesture in the embodiments of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0057] For example, the second input may be: the user long presses the target image area to display the option of binding the application; the user clicks the option of binding the application to display multiple application types; the user clicks the option of any application type to display multiple application options of the type; the user clicks the option of a certain application. The application represented by the option of the application clicked is the target application.

[0058] Figure 6 is a schematic diagram of an interface of an electronic device of some embodiments of the present application, such as Figure 6 As shown, after the user long presses, an option 603 for binding the application is displayed.

[0059] Step A2: In response to the second input, determining a corresponding relationship between the target image and the target application.

[0060] In this step, a correspondence between the target image and the target application can be created, thereby determining the correspondence between the target image and the target application, that is, binding the target image and the target application. Accordingly, when the user performs a first input on the target image, the corresponding target application performs a corresponding target action.

[0061] Optionally, in the embodiment of the present application, a third input of a target object and a target action in the target image may be received. In response to the third input, a second corresponding relationship between the target object and the target action is determined; wherein, when the target image includes a plurality of target objects, each target object corresponds to the target action.

[0062] Among them, the target action can be an action obtained by matching the image feature information of the target object and executed by the target application. In an embodiment of the present application, each object in the target image can be identified as a target object based on the image feature information of the target image. Optionally, the area where the target object is located can be marked, for example, the area where each target object is located is highlighted to facilitate the user to bind each object. When the target image is bound to the target application, different target objects can be bound to different target actions of the target application, thereby providing a quick and sophisticated operation method.

[0063] In some embodiments of the present application, the third input is used to create a correspondence between each target object in the target image and each target action, that is, to create a second binding relationship. The third input can be a third operation. Exemplarily, the third input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiments of the present application are not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0064] For example, the third input may be, based on the establishment of the first binding relationship, an add option is displayed at each target object of the target image, the user clicks the add option, multiple action options and custom action options are displayed, and the multiple action options displayed may be the action options that can be performed on the target application matched according to the image feature information of the current target object. Further, the user clicks an action option to use the action represented by the clicked option as the target action, and binds the target action to the target object, i.e., creates a corresponding relationship between the target action and the target object.

[0065] For example, the target image is an image of a puppy, and the target object: puppy's mouth is bound to the target action: search for dog food related items, and the target object: puppy's ball is bound to the target action: search for dog toy related items.

[0066] Figure 7 is a schematic diagram of an interface of an electronic device of some embodiments of the present application, such as Figure 7 As shown, based on the user's click on the add option 701, multiple action options are displayed, among which the keyword "dog food" in the option 702 for quick search of dog food can be customized by the user.

[0067] Furthermore, if Figure 7 As shown, area 1 where the puppy's mouth is located is bound to the action of quickly searching for dog food, area 2 where the puppy's ball is located is bound to the action of quickly searching for dog toys, area 3 where the puppy's back is located is bound to the action of quickly searching for dog shampoo, and the remaining areas are bound to the action of opening the application home page by default.

[0068] Figure 8 is a schematic diagram of an interface of an electronic device of some embodiments of the present application, such as Figure 8 As shown, the user can also put a photo of himself as the target image, bind the target object: his own facial area with the target action: quick search for cosmetics, bind the target object: his own top area with the target action: quick search for tops, bind the target object: his own skirt and pants area with the target action: quick search for skirts and pants, and bind the target object: his own bag area with the target action: quick search for bags.

[0069] Correspondingly, in an implementation manner of the first input, the first input may be long pressing an area where any target object is located on the target image.

[0070] In an embodiment of the present application, after the target image is bound to the target application, each target object in the target image can be bound to different target actions of the target application, so that when the user inputs different target objects on the target image, different target action results can be obtained.

[0071] In a control method process of another embodiment of the present application, the target application includes a first target application and a second target application, the first target application and the second target application are different applications, and the target object in the target image includes the first target object and the second target object; before the step of receiving the first input of the target image, the method further includes:

[0072] Step B1: Receive fourth input of the first target object, the first target application, and the first target action.

[0073] In some embodiments of the present application, the fourth input is used to bind the first target application to the first target object in the target image, and to bind the first target action of the first target application to the first target object. The fourth input can be a fourth operation. Exemplarily, the fourth input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiments of the present application are not limited. The specific gesture in the embodiments of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0074] For example, the fourth input may be that, in the target image, the user long presses the area where the first target object is located, and options for binding applications are displayed. The user clicks on an application option to use the application represented by the clicked option as the first target application, and binds the first target application to the first target object; then, the user clicks on the Add option at the first target object, and based on a series of inputs, finally selects the first target action for binding.

[0075] Step B2: In response to a fourth input, determining a first corresponding relationship between the target image and the first target application, and determining a second corresponding relationship between the first target object and the first target action.

[0076] The first target action is obtained by matching the image feature information of the first target object and is an action performed by the first target application.

[0077] Sub-step B3: Receive a fifth input to the second target object, the second target application, and the second target action.

[0078] In some embodiments of the present application, the fifth input is used to bind the second target application to the second target object in the target image, and to bind the second target action of the second target application to the second target object. The fifth input can be a fifth operation. Exemplarily, the fifth input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiments of the present application are not limited. The specific gesture in the embodiments of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0079] For example, the fifth input may be that, in the target image, the user long presses the area where the second target object is located, and options for binding the application are displayed. The user clicks based on a series of inputs to use the application represented by the clicked option as the second target application, and binds the second target application to the second target object; then, the user clicks the Add option at the second target object, and based on a series of inputs, finally selects the second target action for binding.

[0080] Sub-step B4: In response to the fifth input, determining a first corresponding relationship between the target image and the second target application, and determining a second corresponding relationship between the second target object and the second target action.

[0081] The second target action is obtained by matching the image feature information of the second target object and is an action executed by the second target application.

[0082] In the embodiment of the present application, a target object corresponds to an image area in the target image, an image area can correspond to a feature in the target image, and a target action corresponds to an application function. For a target image, multiple target applications can be bound, specifically, multiple target objects therein can be respectively bound to corresponding multiple target applications, and different operations applicable to different target applications can be bound based on the different bound target applications. For example, the target action of searching for dog food of shopping application A is bound to the puppy's mouth area; the target action of searching for pet toys of shopping application B is bound to the puppy's toy area. The embodiment of the present application can realize the binding of the functions of multiple applications to a target image, reducing the troublesome operation of users switching back and forth between applications.

[0083] In some embodiments of the present application, a target object can be bound to multiple target applications of the same type. Since multiple target applications belong to the same type, they can perform the same operation, that is, a target object can be bound to the same target action performed by different target applications. Fig. 9 is a schematic diagram of an interface of an electronic device of some embodiments of the present application, such as Fig. 9 As shown, multiple applications are popped up: options for executable actions of application A and application B, and the user can make a selection.

[0084] In the process of the control method of another embodiment of the present application, the above-mentioned receiving the first input to the target image may specifically include: Step 1101, receiving an input of dragging the icon of the first application to the target image.

[0085] The above-mentioned determination of the target application corresponding to the target image may specifically include: Step 1201, determining the first application as the target application corresponding to the target image.

[0086] In an embodiment of the present application, the first input may specifically be an operation of dragging the icon of the first application to the target image. The first application may be any application installed on the electronic device. The user may select an application as the first application from the applications installed on the electronic device as needed, and drag the icon of the first application to the target image. Specifically, the icon of the first application may be dragged to the area where the target image is located.

[0087] Furthermore, the application represented by the icon dragged to the target image can be determined as the target application. Accordingly, the first application can be determined as the target application corresponding to the target image.

[0088] In the embodiment of the present application, an input of dragging the icon of the first application to the target image is received, and the first application is determined as the target application corresponding to the target image. In this way, the target application corresponding to the target image can be determined without establishing a correspondence between the target image and the target application in advance, which is easier to implement.

[0089] In the process of the control method of another embodiment of the present application, the target object in the target image can be first determined by the following steps:

[0090] Step C1: identifying a target object in the target image according to image feature information of the target image.

[0091] In this step, each target object is identified in the target image according to the image feature information of each target object. For example, in an image of a dog, the dog's mouth, back, and dog's toys are identified, so that the electronic device determines all the identified objects as target objects, so that the target actions corresponding to all the automatically identified target objects are executed this time.

[0092] Alternatively, the target object in the target image can be determined by the following steps:

[0093] Step C2: receiving a sixth input of a target area of ​​the target image.

[0094] In some embodiments of the present application, the target area may be any image area included in the target image, and the sixth input is used to frame the image area in the target image to trigger the framed image area as a target area, and further, the image content in the target area can be identified as a target object. The sixth input may be a sixth operation. Exemplarily, the sixth input includes but is not limited to: a user's touch input of a control on the screen or a screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input, which may be determined according to actual use requirements, and is not limited in the embodiments of the present application. The specific gesture in the embodiments of the present application may be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application may be a single-click input, a double-click input, or any number of click inputs, etc., and may also be a long-press input or a short-press input.

[0095] For example, the sixth input mentioned above may be that the user long presses a position on the target image until a rectangular box is displayed. The position where the user long presses is a vertex where the rectangular box is located. The user drags the finger to determine the opposite vertex where the rectangular box is located. After releasing the finger, a rectangular box is displayed in the image. The area where the rectangular box is located is the selected image area.

[0096] Step C3: In response to the sixth input, determine the image content in the target area as a target object.

[0097] In this step, the image content selected by a marked box is determined as a target object. The marked box serves as a mark to inform the electronic device that this is an independent object, so that the electronic device determines the object selected by the user as the target object, so that only the target action corresponding to the target object selected by the user is executed this time.

[0098] In the embodiment of the present application, the target object can be automatically identified, and the user can also be supported to manually select the target object.

[0099] Correspondingly, the above-mentioned control of the target application to perform the target action according to the image feature information of the target image may specifically include: step 1301, controlling the target application to perform the target action according to the target object. Specifically, the target action corresponding to the image feature information of the target image can be first determined to have a corresponding relationship with the target object. Then the target application is controlled to perform the target action corresponding to the target object. Among them, the target action corresponding to the image feature information of the target image includes the target actions corresponding to all target objects in the target image. In this way, by controlling the execution of the target action corresponding to the target object, more precise control can be achieved.

[0100] In the process of the control method of another embodiment of the present application, the method further includes:

[0101] Step D1: When the notification message of the target application is associated with the target object in the target image and the target action, prompt information associated with the target object is displayed in the target image; wherein the prompt information is used to prompt the notification message; wherein the target action corresponds to the image feature information of the target object.

[0102] Among them, the image feature information of any target object corresponds to a target action. When a notification message from a target application is received, the notification message can be analyzed to determine whether the notification message is associated with the target object in the target image and the corresponding target action. Exemplarily, the semantics of the notification message can be matched with the semantics of the target object and the target action. If the semantics are related, it is determined that there is an association. For example, the target object is a dog's mouth, the target action is a quick search for dog food, and the notification message is about a certain dog food item, then it can be determined that the notification message is associated with both the target object and the target action, and the prompt information can be displayed in the dog's mouth area of ​​the target image. Among them, the prompt information can be used to characterize the number of notification messages.

[0103] Fig.10 is a schematic diagram of an interface of an electronic device of some embodiments of the present application, such as Fig.10 As shown, a corner mark is displayed at the dog's mouth, and the number therein is the number of related notification messages; a corner mark is displayed at the dog's toy, and the number therein is the number of related notification messages.

[0104] In an embodiment of the present application, the notification message pushed by the application is associated with the area where the target object of the target image is located, so that prompt information of the bound target application can be displayed in different areas of the target image. This can more directly prompt the user that there is a related notification message, thereby increasing the probability of the message being viewed and reducing the probability of missing the message.

[0105] In the process of the control method of another embodiment of the present application, before the step of displaying the target image, the method further includes:

[0106] Step E1: Receive a seventh input of an image in the photo album application.

[0107] In some embodiments of the present application, the seventh input is used to select an image for display in the album application. The seventh input can be the seventh operation. Exemplarily, the seventh input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiments of the present application are not limited. The specific gesture in the embodiments of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0108] For example, the seventh input may be that the user long presses a blank area of ​​the desktop interface to display an option to add an image, the user clicks the option to display an option for the photo album application, and the user clicks the option to enter the photo album application and clicks an image.

[0109] Step E2: In response to the seventh input, display the selected image as the target image.

[0110] In this step, the album image selected by the user is used as the target image and can be displayed in a blank area of ​​the desktop interface, and the user can perform subsequent binding input and shortcut operation input.

[0111] or,

[0112] Step E3: Receive an eighth input for the icon of the application.

[0113] In some embodiments of the present application, the eighth input is used to operate the icon of the application to be bound to trigger the display of an associated image for the user to perform subsequent binding input and shortcut operation input. The association method here needs to refer to the properties of the application and the user behavior. The eighth input can be the eighth operation. Exemplarily, the eighth input includes but is not limited to: the user uses a touch device such as a finger or a stylus to touch the controls on the screen, the touch input to the screen area, or the voice command input by the user, or the specific gesture input by the user, or other feasible input, which can be determined according to the actual use requirements, and the embodiment of the present application is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0114] For example, the eighth input may be that the user long presses the icon of the application.

[0115] Step E4: In response to the eighth input, based on the attribute characteristics of the application and the user behavior characteristics of the application, an image matching at least one of the attribute characteristics and the user behavior characteristics is displayed as a target image.

[0116] Among them, the user behavior characteristics of the application include the historical operation data of the user in the application. For example, if the application is a food application and its attribute is to provide food from various places, combined with the regions that users often search, a map image of the whole country or the whole province can be provided as a target image to facilitate users to search for food by region. Or, if the application is a shopping application and its attribute is to search for items, combined with the pet field that users often buy, an image of a pet can be provided as a target image to facilitate users to search for items according to pet needs.

[0117] In an embodiment of the present application, the user can also manually add an image as a target image for quick operation, and the system can also recommend an image as a target image for user quick operation. The user can use different image display schemes according to needs, thereby providing the user with more choices and increasing the fun of using this function.

[0118] In the embodiment of the present application, a target object corresponds to an image area in the target image, and an image area can specifically correspond to a feature object in the target image. In the embodiment of the present application, the feature objects of an image on the desktop, such as people, animals or other objects and their parts, are used to combine different image areas in the target image with specific functions of different applications (one target action corresponds to one application function). When the user inputs in the image area where the feature object is located, the target action corresponding to the image area can be quickly executed, and then jump to the corresponding application function page. It can be seen that the embodiment of the present application can effectively combine feature objects and application functions in the scene, which increases portability and playability compared to the existing situation of clicking an application icon to enter application search.

[0119] In the control method provided in the embodiment of the present application, the execution subject may be a control device. In the embodiment of the present application, the control device provided in the embodiment of the present application is described by taking the control method executed by the control device as an example.

[0120] Fig.11 is a block diagram of a control device of some embodiments of the present application, such as Fig.11 As shown, the device comprises:

[0121] A first receiving module 201 is used to receive a first input of a target image;

[0122] A first determination module 202, configured to determine, in response to the first input, a target application corresponding to the target image and a target action corresponding to image feature information of the target image;

[0123] The control module 203 is used to control the target application to execute the target action according to the image feature information of the target image.

[0124] In summary, in the control device provided in the embodiment of the present application, a first input to a target image is received. In response to the first input, a target application corresponding to the target image and a target action corresponding to the image feature information of the target image are determined. The target application is controlled to perform the target action according to the image feature information of the target image. Compared with the method of achieving the target action through a series of operations, in this way, the user can control the target application to perform the target action through the first input to the target image, which can simplify the operation process and reduce the implementation cost.

[0125] Optionally, the device further comprises:

[0126] A second receiving module, used for receiving a second input of a target image and a target application;

[0127] The second determining module is used to determine the corresponding relationship between the target image and the target application in response to the second input.

[0128] Optionally, the first receiving module 201 is specifically configured to:

[0129] receiving an input of dragging an icon of a first application to a target image;

[0130] The first determining module 202 is specifically configured to:

[0131] The first application is determined as a target application corresponding to the target image.

[0132] Optionally, the device further comprises:

[0133] A recognition module, used for recognizing a target object in the target image according to image feature information of the target image;

[0134] Alternatively, a third receiving module is used to receive a sixth input of a target area of ​​the target image;

[0135] a third determining module, configured to determine, in response to the sixth input, the image content in the target area as a target object;

[0136] The control module 203 is specifically used to control the target application to execute the target action according to the target object.

[0137] Optionally, the device further comprises:

[0138] A display module, configured to display prompt information associated with the target object in the target image when the notification message of the target application is associated with both the target object and the target action in the target image; wherein the prompt information is used to prompt the notification message;

[0139] The target action corresponds to the image feature information of the target object.

[0140] The device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0141] The device of the embodiment of the present application may be a device having an action system. The action system may be an Android action system, an iOS action system, or other possible action systems, which are not specifically limited in the embodiment of the present application.

[0142] The device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0143] Alternatively, if Fig.12 As shown, an embodiment of the present application also provides an electronic device 100, including a processor 101, a memory 102, and a program or instruction stored in the memory 102 and executable on the processor 101. When the program or instruction is executed by the processor 101, each step of any of the above-mentioned control method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0144] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0145] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0146] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, a camera 1011 and other components.

[0147] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0148] Among them, the user input unit 1007 is used to receive a first input to a target image; the processor 1010 is used to determine, in response to the first input, a target application corresponding to the target image and a target action corresponding to image feature information of the target image; and control the target application to perform the target action according to the image feature information of the target image.

[0149] Optionally, the user input unit 1007 is used to receive a second input for a target image and a target application; the processor 1010 is used to determine a correspondence between the target image and the target application in response to the second input; optionally, the user input unit 1007 is used to receive an input of dragging an icon of a first application to the target image; the processor 1010 is used to determine the first application as a target application corresponding to the target image.

[0150] Optionally, the processor 1010 is used to identify the target object in the target image based on image feature information of the target image; or, the user input unit 1007 is used to receive a sixth input to a target area of ​​the target image, and the processor 1010 is used to determine the image content in the target area as the target object in response to the sixth input; and control the target application to perform the target action according to the target object.

[0151] Optionally, processor 1010 is used to display prompt information associated with the target object in the target image when the notification message of the target application is associated with both the target object and the target action in the target image; wherein the prompt information is used to prompt the notification message; wherein the target action corresponds to image feature information of the target object.

[0152] In summary, in the control method provided in the embodiment of the present application, a first input to a target image is received. In response to the first input, a target application corresponding to the target image and a target action corresponding to the image feature information of the target image are determined. The target application is controlled to perform the target action according to the image feature information of the target image. Compared with the method of achieving the target action through a series of operations, in this way, the user can control the target application to perform the target action through the first input to the target image, which can simplify the operation process and reduce the implementation cost.

[0153] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video image obtained by the image capture device (such as a camera) in the video image capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and an action rod, which will not be repeated here. The memory 1009 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1010.

[0154] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0155] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0156] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by the processor, each process of the above control method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. Among them, the processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a disk or an optical disk, etc.

[0157] The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface and the processor are coupled, the processor is used to run programs or instructions to implement the various processes of the above-mentioned control method embodiment, and can achieve the same technical effect, to avoid repetition, it will not be repeated here. It should be understood that the chip mentioned in the embodiment of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc. The embodiment of the present application provides a computer program product, the program product is stored in a storage medium, the program product is executed by at least one processor to implement the various processes of the above-mentioned control method embodiment, and can achieve the same technical effect, to avoid repetition, it will not be repeated here.

[0158] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0159] Through the description of the above implementation mode, the technicians in this field can clearly understand that the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, and of course, it can also be implemented by hardware, but in many cases the former is a better implementation mode. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, disk, CD), including several instructions to enable a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) to execute the method of each embodiment of the present application. The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation modes, which are merely illustrative and not restrictive. Under the enlightenment of the present application, the ordinary technicians in this field can also make many forms without departing from the scope protected by the purpose of the present application and the claims, all of which belong to the protection of the present application.

Claims

1. A control method, characterized in that: The method comprises: Receiving a first input of a target image; In response to the first input, determining a target application corresponding to the target image and a target action corresponding to image feature information of the target image; The target application is controlled to execute the target action according to the image feature information of the target image.

2. The method according to claim 1, characterized in that: Before receiving the first input of the target image, the method further includes: receiving a second input of a target image and a target application; In response to the second input, a corresponding relationship between the target image and the target application is determined.

3. The method according to claim 1, characterized in that The receiving a first input of a target image comprises: receiving an input of dragging an icon of a first application to a target image; The determining a target application corresponding to the target image includes: The first application is determined as a target application corresponding to the target image.

4. The method according to claim 1, characterized in that: The method further comprises: identifying a target object in the target image according to image feature information of the target image; or, receiving a sixth input of a target area of ​​the target image; In response to the sixth input, determining the image content in the target area as a target object; The controlling the target application to perform the target action according to the image feature information of the target image comprises: The target application is controlled to execute the target action according to the target object.

5. The method according to claim 1, characterized in that The method further comprises: In the case where the notification message of the target application is associated with both the target object in the target image and the target action, prompt information associated with the target object is displayed in the target image; wherein the prompt information is used to prompt the notification message; The target action corresponds to the image feature information of the target object.

6. A control device, characterized in that: The device comprises: A first receiving module, configured to receive a first input of a target image; A first determination module, configured to determine, in response to the first input, a target application corresponding to the target image and a target action corresponding to image feature information of the target image; A control module is used to control the target application to perform the target action according to the image feature information of the target image.

7. The device according to claim 6, characterized in that The device also includes: A second receiving module, configured to receive a second input of a target image and a target application; The second determining module is used to determine the corresponding relationship between the target image and the target application in response to the second input.

8. The device according to claim 6, characterized in that The first receiving module is specifically used for: receiving an input of dragging an icon of a first application to a target image; The first determining module is specifically configured to: The first application is determined as a target application corresponding to the target image.

9. The device according to claim 6, characterized in that The device also includes: A recognition module, used for recognizing a target object in the target image according to image feature information of the target image; Alternatively, a third receiving module is used to receive a sixth input of a target area of ​​the target image; a third determining module, configured to determine, in response to the sixth input, the image content in the target area as a target object; The control module is specifically used to control the target application to execute the target action according to the target object.

10. The device according to claim 6, characterized in that The device also includes: A display module, configured to display prompt information associated with the target object in the target image when the notification message of the target application is associated with both the target object and the target action in the target image; wherein the prompt information is used to prompt the notification message; The target action corresponds to the image feature information of the target object.

11. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the control method according to any one of claims 1 to 5 are implemented.

Images