Control method and control device

Abstract

The invention discloses a control method and a control device, and belongs to the technical field of electronic equipment. The method comprises the steps that under the condition that a first interface is displayed, operation information of a touch pen on a first plane is obtained, and the first plane is a plane except a screen of the electronic equipment; according to operation information, corresponding control operation is executed on a target object in the first interface, and the operation information comprises an input track of the touch pen on the first plane, an angle between the touch pen and the first plane and pressing parameters of a pen point of the touch pen.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to a control method and a control device. Background Art

[0002] With the continuous advancement of electronic device technology, stylus, as an input device, has become an indispensable tool for users in life and work.

[0003] In the related art, as the screens of mobile devices gradually increase, users often need to raise the devices to operate when using large-screen devices (such as folding screens or pads). In this usage scenario, users need to frequently raise their hands to touch the screen when using a stylus, which not only brings inconvenience to users, but also reduces the efficiency of operation. Therefore, improving the operating efficiency of the stylus has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a control method and a control device, which can improve the operating efficiency of a stylus pen.

[0005] In a first aspect, an embodiment of the present application provides a control method, which includes: when displaying a first interface, obtaining operation information of a stylus on a first plane, the first plane being a plane other than a screen of the electronic device; wherein the operation information includes: an input trajectory of the stylus on the first plane, an angle between the stylus and the first plane, and a pressing parameter of the tip of the stylus, and performing corresponding control operations on a target object in the first interface.

[0006] In a second aspect, an embodiment of the present application provides a control device, which includes: an acquisition module and a processing module, wherein: the acquisition module is used to acquire operation information of the stylus on a first plane when displaying a first interface, and the first plane is a plane other than the screen of the electronic device; the processing module is used to perform corresponding control operations on the target object in the first interface according to the operation information acquired by the acquisition module, wherein the operation information includes: the input trajectory of the stylus on the first plane, the angle between the stylus and the first plane, and the pressing parameters of the tip of the stylus.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, when the first interface is displayed, the operation information of the stylus on the first plane is obtained, and the first plane is a plane other than the screen of the electronic device; according to the above operation information, a corresponding control operation is performed on the target object in the first interface, wherein the above operation information includes: the input trajectory of the above stylus on the above first plane, the angle between the above stylus and the above first plane, and the pressing parameters of the tip of the above stylus. Through this method, the electronic device can obtain the operation information of the stylus on the plane other than the screen, and perform corresponding control operations according to the operation information, so that the touch operation is no longer limited to the screen of the electronic device, but can be extended to any plane (i.e., the first plane), so that the user can control the electronic device with the stylus in a larger space range without having to keep the arm suspended in the air at all times or move frequently to touch the screen, thereby improving the flexibility and convenience of the operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A flow chart of a control method provided in an embodiment of the present application;

[0013] Figure 2A One of the schematic diagrams of the interface used by the control method provided in the embodiment of the present application;

[0014] Figure 2B A second schematic diagram of an interface used by a control method provided in an embodiment of the present application;

[0015] Figure 2C A third schematic diagram of an interface used by a control method provided in an embodiment of the present application;

[0016] Figure 2D A fourth schematic diagram of an interface used by a control method provided in an embodiment of the present application;

[0017] Figure 2E A fifth schematic diagram of an interface used by a control method provided in an embodiment of the present application;

[0018] Figure 3A A sixth schematic diagram of an interface for providing a control method for an embodiment of the present application;

[0019] Figure 3B A seventh schematic diagram of an interface for providing a control method for an embodiment of the present application;

[0020] Figure 4 An eighth schematic diagram of an interface used by a control method provided in an embodiment of the present application;

[0021] Figure 5 A ninth schematic diagram of an interface for providing a control method for an embodiment of the present application;

[0022] Figure 6 A tenth schematic diagram of an interface for providing a control method for an embodiment of the present application;

[0023] Figure 7 An eleventh schematic diagram of an interface used by a control method according to an embodiment of the present application is provided;

[0024] Figure 8 A twelfth schematic diagram of an interface used by a control method according to an embodiment of the present application is provided;

[0025] Fig.9A A thirteenth schematic diagram of an interface used by a control method provided in an embodiment of the present application;

[0026] Fig. 9B A fourteenth schematic diagram of an interface used by a control method according to an embodiment of the present application;

[0027] Fig. 9C A fifteenth schematic diagram of an interface for providing a control method for an embodiment of the present application;

[0028] Fig.9D A sixteenth schematic diagram of an interface for providing a control method for an embodiment of the present application;

[0029] Fig. 10A A seventeenth schematic diagram of an interface for providing a control method for an embodiment of the present application;

[0030] Fig. 10B Schematic diagram 18 of an interface for providing a control method for an embodiment of the present application;

[0031] Fig.11 A schematic diagram of the structure of a control device is provided for an embodiment of the present application;

[0032] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0033] Fig.13 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0034] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0035] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0036] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0037] The control method provided in the embodiment of the present application can be applied to the scenario of selecting an application through a stylus.

[0038] In the related art, when a user needs to select an application in an interface using a stylus, the user needs to click on the application logo in the interface using the stylus. However, when the user uses the stylus to operate an electronic device, the user needs to frequently raise his hand to operate on the screen to select the application in some cases, which makes the operation convenience and efficiency poor.

[0039] In the control method provided in the embodiment of the present application, when the user needs to select an application in the interface through the stylus, the user can perform touch operations on any plane other than the screen of the electronic device. For example, the user can use the stylus to perform touch operations on the desktop, and the electronic device can obtain the operation information of the stylus on the desktop and select the corresponding application according to the operation information, so that the touch operation is no longer limited to the screen of the electronic device, but can be extended to other planes, so that the user can select applications more conveniently and efficiently through the stylus, thereby improving the flexibility and convenience of operation.

[0040] The execution subject of the control method provided in the embodiment of the present application may be a control device, which may be an electronic device, or a functional module or functional entity in the electronic device. The control method provided in the embodiment of the present application is described below by taking the electronic device executing the control method as an example.

[0041] The control method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0042] Figure 1 A flow chart of the control method provided in the embodiment of the present application is as follows: Figure 1 As shown, the control method may include the following steps 201 and 202:

[0043] Step 201: The electronic device obtains operation information of the stylus on the first plane while displaying the first interface.

[0044] The first plane is a plane other than the screen of the electronic device.

[0045] In some embodiments of the present application, the above-mentioned first interface may include at least one of the following: a desktop, an application program interface, a negative one screen, a taskbar interface, etc.

[0046] In some embodiments of the present application, the stylus pen may be a capacitive stylus pen.

[0047] It should be noted that the above-mentioned touch pen can also be called a stylus.

[0048] In some embodiments of the present application, the first plane may be any plane other than a screen of the electronic device that can support the stylus operation.

[0049] Exemplarily, the first plane may be a plane on which the electronic device is placed, such as a desktop, a ground surface, or a wall surface.

[0050] It should be noted that the first plane is a plane different from the plane where the electronic device screen is located. For example, the first plane may be a plane that forms an arbitrary angle with the plane where the electronic device screen is located.

[0051] In some embodiments of the present application, the operation information may include at least one of the following: an input track of the stylus, an angle between the stylus and the first plane, and a pressing parameter of the stylus tip. For example, the pressing parameter of the stylus tip may include at least one of the following: pressing force, pressing duration, etc.

[0052] In some embodiments of the present application, the electronic device can obtain operation information collected by the stylus.

[0053] Exemplarily, the stylus pen can obtain its own operation information on the first plane through the internal module, and send the operation information to the electronic device through the communication connection, and the electronic device can receive the operation information from the stylus pen.

[0054] It should be noted that the stylus pen can establish a connection with the electronic device through Bluetooth or other means, that is, the stylus pen can establish a communication connection with the electronic device so that the data collected by the stylus pen can be transmitted to the electronic device, and the electronic device can then perform subsequent processing based on the data.

[0055] Step 202: The electronic device performs a corresponding control operation on the target object in the first interface according to the operation information.

[0056] In some embodiments of the present application, the target object includes but is not limited to at least one of the following: an application, a window, a page, a text, etc.

[0057] In some embodiments of the present application, the above-mentioned control operations may include at least one of the following: selecting a target object, updating the display position of a target object, updating the size of a target object, starting a target object, displaying a function menu of a target object, exiting or closing a target object, returning to the main interface of an electronic device, etc.

[0058] In some embodiments of the present application, the electronic device can obtain operation information of the stylus on any plane except the screen, and perform the above-mentioned control operation on the target object in the first interface according to the operation information, so that the touch operation can be extended to other planes, thereby improving the flexibility and convenience of the operation.

[0059] In some embodiments of the present application, the electronic device can obtain operation information of the stylus on the first plane when entering the control operation mode, and perform corresponding control operations on the target object in the first interface according to the operation information.

[0060] In some embodiments of the present application, the electronic device may start the air operation mode when a pressing operation on a key of the stylus is detected. Further, the electronic device may start the air operation mode when a pressing operation on a key of the stylus is detected and the track drawn in the pressed state of the key matches the preset track.

[0061] For example, when the user holds the stylus, the user can press a button on the stylus on any plane and slide out any graphic / pattern / text preset by the user to enter the control operation mode.

[0062] Exemplarily, after the electronic device enters the control operation mode, after the user releases the button, the control operation mode is maintained, and the operating parameters of the stylus (such as coordinate data) are transmitted through the communication connection with the stylus.

[0063] Exemplarily, after the electronic device fails to successfully enter the control operation mode, no operation parameters are transmitted between the electronic device and the stylus, thereby reducing power consumption of the stylus and the electronic device.

[0064] In some embodiments of the present application, the electronic device may exit the control operation mode when it is detected that the trajectory of the stylus matches a preset trajectory.

[0065] For example, when the user holds the stylus pen, the user only needs to slide out any graphic preset by the user on any plane to directly exit the control operation mode.

[0066] The control method provided in the embodiment of the present application obtains the operation information of the stylus on the first plane when the first interface is displayed, and the first plane is a plane other than the screen of the electronic device; according to the above operation information, the corresponding control operation is performed on the target object in the first interface. Through this method, the electronic device can obtain the operation information of the stylus on the plane other than the screen, and perform the corresponding control operation according to the operation information, so that the touch operation is no longer limited to the screen of the electronic device, but can be extended to any plane (i.e., the first plane), so that the user can control the electronic device with the stylus in a larger space range without having to keep the arm suspended in the air at all times or move frequently to touch the screen, thereby improving the flexibility and convenience of the operation.

[0067] In some embodiments of the present application, the operation information includes: an input track of the stylus on the first plane; illustratively, the step 202 may include the following steps 202a:

[0068] Step 202a: The electronic device performs a corresponding control operation on the target object in the first interface according to the input track of the stylus on the first plane.

[0069] The target object includes at least one of the following: a target application, a target page, and a target window; the control operation includes at least one of the following: selecting a target object, updating a display position of a target object, and updating a size of a target object.

[0070] In some embodiments of the present application, the input trajectory may be a trajectory formed by continuous input by a stylus pen on the first plane.

[0071] In some embodiments of the present application, the input trajectory may be a sliding trajectory of the stylus pen on the first plane.

[0072] Exemplarily, taking the target object as the target application and the first plane as the desktop where the electronic device is placed, when the electronic device displays the main interface and the main interface includes at least one application, the user can control the stylus to slide on the desktop where the electronic device is placed, and the electronic device can obtain the coordinate data of the sliding operation of the stylus on the desktop, and then determine the sliding trajectory of the stylus based on the coordinate data, and then select the application identifier of the target application in the main interface based on the sliding trajectory, thereby selecting the target application.

[0073] For example, the target object is a target window and the first plane is a wall. Figure 2A As shown, the interface of the electronic device includes three windows: window 1, window 2 and window 3. When the user needs to adjust the display positions of the three windows, the user can control the stylus to slide on the plane, and the electronic device can obtain the coordinate data of the sliding operation of the stylus on the plane, and then determine the sliding trajectory of the touch according to the coordinate data, and then adjust the display positions of window 1, window 2 and window 3 according to the trajectory direction of the sliding trajectory. For example, the user can trigger the switching of the current air operation window position by drawing a circle with the stylus, such as Figure 2B shown.

[0074] It should be noted that Figure 2A The picture on the right side of the middle is a schematic diagram of a user drawing a circle on the wall using a stylus.

[0075] It should be noted that Figure 2A The arrow in the figure indicates the direction of the sliding track. When the direction of the sliding track is clockwise, the electronic device can adjust the display positions of the three windows clockwise, that is, adjust window 1 to the position of window 2, adjust window 2 to the position of window 3, and adjust window 3 to the position of window 1. The adjusted window positions are as shown in FIG. Figure 2B shown.

[0076] As another example, take the target object as the target page and the first plane as the desktop as an example. Figure 2CAs shown, the first interface of the electronic device includes page 4 and page 5. When page 4 is currently operated by the stylus, if the user needs to operate page 5 by the stylus, the user can control the stylus to slide on the desktop, and then select page 5 in the first interface according to the sliding trajectory, so that the user can operate page 5.

[0077] It should be noted that Figure 2C The arrow in indicates that the stylus pen switches from selecting page 4 to selecting page 5. In the actual interface, the arrow may not be displayed.

[0078] As another example, take the target object as the target window and the first plane as the desktop as an example. Figure 2D As shown, the interface of the electronic device includes a window 6. When the user needs to adjust the size of the window, the user can control the stylus to slide on the plane, and then adjust the size of the window according to the direction of the sliding track. Specifically, when the electronic device detects a sliding track to the left, the window width is reduced, or when a sliding track to the right is detected, the window width is enlarged. Similarly, moving upwards enlarges the window height, and moving downwards reduces the window height, such as Figure 2E shown.

[0079] It should be noted that Figure 2E The "X"-shaped arrow on the right side of the center indicates the direction in which the stylus can be moved when adjusting the window size by moving the stylus, that is, up, down, left, and right. Figure 2E The arrows above and to the right of the middle window 6 indicate the adjustment direction of the window 6 boundary.

[0080] In some embodiments of the present application, the electronic device may enter a window size adjustment mode after detecting a pressing operation of the stylus tip, and then, in the window size adjustment mode, adjust the window size according to the sliding trajectory of the stylus.

[0081] In some embodiments of the present application, the electronic device may exit the window resizing mode after detecting a pressing operation of the stylus pen tip.

[0082] Exemplarily, in combination with the above example, when the user needs to adjust the size of the window, the user can control the stylus to slide on the plane, and then adjust the size of the window according to the direction of the sliding trajectory. Specifically, after selecting the operation window, press the pen tip lightly for 0.5 seconds. After a slight motor vibration, enter the window size adjustment mode of the current window. Then, when the electronic device detects a sliding trajectory to the left, the window width is reduced, or, when a sliding trajectory to the right is detected, the window width is enlarged. Similarly, moving up will enlarge the window height, and moving down will reduce the window height. Press the pen tip lightly for 0.5 seconds again to exit this operation.

[0083] In some embodiments of the present application, the electronic device can close the target application or return to the desktop of the electronic device according to the sliding trajectory of the stylus.

[0084] For example, a user may draw a “<” symbol on any plane using a stylus pen to trigger the electronic device to execute an exit operation of the application.

[0085] As another example, the user can use the stylus to draw a preset shape, such as an ellipse, a rectangle, etc., on any plane to trigger the electronic device to return to the desktop.

[0086] In an embodiment of the present application, the electronic device can obtain the input trajectory of the stylus on any plane, and perform corresponding control operations on the applications, pages, windows, etc. in the interface according to the input trajectory, for example, selecting objects in the interface, updating the display position of objects in the interface, updating the size of objects in the interface, etc., thereby being able to conveniently and quickly perform control operations on the target object according to the input trajectory on any plane.

[0087] In some embodiments of the present application, the above step 202a may include the following steps 202a1 and 202a2:

[0088] Step 202a1: the electronic device determines a control instruction corresponding to the input trajectory according to whether the input trajectory of the stylus on the first plane matches a preset trajectory.

[0089] Step 202a2: the electronic device selects a target object in the first interface according to the control instruction.

[0090] In some embodiments of the present application, the preset trajectory may include at least one of the following: a preset shape, a preset graphic, or a preset stroke, etc.

[0091] It should be noted that the above-mentioned graphics can be alternatively described as patterns.

[0092] Exemplarily, the preset trajectory may be a translation stroke, such as “-”; or a vertical stroke, such as “|”, or any other shape or stroke such as a semicircle.

[0093] In some embodiments of the present application, the above-mentioned control instruction may include at least one of the following: a selection instruction, a move instruction, a zoom instruction, a copy instruction, a delete instruction, etc.

[0094] In some embodiments of the present application, different input trajectories may correspond to different control instructions.

[0095] In some embodiments of the present application, the electronic device can obtain the input trajectory of the stylus on the first plane, match the input trajectory with a preset input trajectory (i.e., preset trajectory), and then determine the control instruction corresponding to the preset trajectory matching the input trajectory as the control instruction corresponding to the input trajectory.

[0096] In some examples, taking the target object as a target application, when the electronic device detects that the input track of the stylus is "-", it selects an application in the horizontal direction; or when the electronic device detects that the input track of the stylus is "|", it selects an application in the vertical direction. Further, the electronic device can determine the target application that needs to be selected currently according to the length and direction of the input track.

[0097] For example, take the target object as the target application. Figure 3A As shown, the electronic device displays a main interface 31, which includes nine application icons APP1 to APP9. Assuming that the current touch position of the stylus pen is the position of the APP1 icon, if the user wants to select APP2, the user can use the stylus pen to draw a "-" with a length of approximately the distance between the APP1 and APP2 icons from left to right on the desktop where the electronic device is placed. The electronic device can then update the touch position of the stylus pen to the position of the APP2 icon according to the "-" drawn by the user, and select the APP2 icon to select APP2.

[0098] It should be noted that Figure 3A The right side is a schematic diagram of the stylus drawing a “-” from left to right on the desktop.

[0099] For example, take the target object as the target application. Figure 3B As shown, the electronic device displays a main interface 31, which includes nine application icons from APP1 to APP9. Assuming that the current touch position of the stylus pen is the position of the APP1 icon in the main interface 31, if the user wants to select APP7, the user can use the stylus pen to draw a "|" with a length of approximately the distance between the APP1 and APP7 icons from top to bottom on the desktop where the electronic device is placed. The electronic device can then update the touch position of the stylus pen to the position of the APP7 icon according to the "|" drawn by the user, and select the APP7 icon to select APP7.

[0100] It should be noted that Figure 3B The right side is a schematic diagram of the stylus pen drawing a “|” from top to bottom on the desktop.

[0101] It should be noted that Figure 3A and Figure 3B The arrow in represents the starting position of the stylus mapped to the main interface 31 and the direction in which the stylus moves.

[0102] In this way, the electronic device can automatically jump to the application at the corresponding distance according to the length of the user's horizontal / vertical stroke, thereby realizing quick selection of the application.

[0103] In other examples, taking the target object as the target application, when the electronic device detects that the input track of the stylus is "-" or "|", it directly jumps from the application in the current row or column to the last application in the current row / column. Specifically, when the screen of the electronic device is large, the user can press the button of the stylus pen and quickly repeat the horizontal / vertical strokes such as "-" or "|" twice, so as to directly jump from the application in the current row / column to other applications in the current row / column.

[0104] For example, taking the target object as the target page, Figure 4 As shown, the first interface of the electronic device includes page 4 and page 5. When the user is currently operating page 4 with the stylus, if the user needs to operate page 5 with the stylus, the user can control the stylus to draw a semicircle from left to right on the desktop. The electronic device updates the touch position of the stylus on the screen from page 4 to page 5 according to the semicircle drawn by the user, and selects page 5. In this way, when dual interfaces appear in the electronic device, page selection across another screen can be achieved by drawing a "semicircle".

[0105] It should be noted that Figure 4 The right side is a schematic diagram of the stylus drawing a semicircle from left to right on the desktop.

[0106] In other examples, taking the target object as a target window, when the electronic device detects that the input track of the stylus pen is “-” or “|”, it locates the corresponding operation window.

[0107] For example, Figure 5 As shown, the first interface of the electronic device includes window 1, window 2 and window 3. Assuming that the current touch position of the stylus is window 1, if the user needs to operate window 3 with the stylus, the user can draw “|” from top to bottom on the desktop with the stylus. According to the operation, the electronic device updates the touch position of the stylus to the location of window 3 and selects window 3.

[0108] It should be noted that Figure 5 The arrow in indicates that the touch position of the stylus pen switches from window 1 to window 3.

[0109] In an embodiment of the present application, the electronic device can obtain the input trajectory of the stylus on any operable plane, match the input trajectory with a preset trajectory, determine the corresponding control instructions, and then perform the corresponding control operations according to the control instructions, so as to accurately operate the target object in the interface.

[0110] In some embodiments of the present application, the above step 202a may include the following steps 202a3 and 202a4:

[0111] Step 202a3: The electronic device determines a target area in the first interface according to the input track of the stylus.

[0112] Step 202a4: the electronic device selects at least one target object in the target area.

[0113] In some embodiments of the present application, the target area may be any area in the first interface that corresponds to the input track.

[0114] In some embodiments of the present application, the electronic device maps the input trajectory of the stylus pen to the first interface, and determines the area surrounded by the closed figure formed by the input trajectory in the first interface as the target area.

[0115] In some embodiments of the present application, after detecting a pressing operation of the tip of the stylus pen, the electronic device enters a long press selection mode, and after the duration of the pressing operation is greater than a preset duration, outputs touch feedback to prompt the user to make an application selection.

[0116] For example, when multiple application icons are displayed in the main interface of the electronic device, if the user wants to select at least one of the application icons, the user can long press the tip of the stylus to trigger the electronic device to enter the long press selection mode, and then, after the user keeps pressing for 0.5 seconds, the electronic device controls the motor to vibrate slightly. Then, the user can use the stylus to draw a rectangle on any operable plane, and the electronic device maps the rectangle to the main interface and selects at least one application icon within the rectangular range in the main interface.

[0117] In an embodiment of the present application, the electronic device can determine the corresponding area from the first interface according to the input trajectory of the stylus on any operable plane, and select all applications in the area at one time, thereby quickly selecting applications in batches in the interface.

[0118] In some embodiments of the present application, the above step 202a may include the following steps 202a5 and 202a6:

[0119] Step 202a5: the electronic device displays the first content in the identification display area of ​​the first interface according to the input track of the stylus pen.

[0120] Step 202a6: The electronic device selects a target object in the first interface according to the first content.

[0121] The first content is text or graphics.

[0122] In some embodiments of the present application, the identification display area may be any area in the first interface. For example, the identification display area may be located in the lower right corner of the first interface.

[0123] In some embodiments of the present application, the identification display area is used to display the first content obtained by identifying the input trajectory of the stylus pen.

[0124] Exemplarily, the first content may include Chinese, English, numbers, etc., or the first content may be a graphic of any shape such as a circle, a rectangle, a triangle, etc.

[0125] In some embodiments of the present application, the electronic device may display an identification display area in the first interface when entering a control operation mode.

[0126] In some embodiments of the present application, the electronic device may cancel the display of the identification display area in the first interface after performing a corresponding control operation on the target object.

[0127] In some embodiments of the present application, the electronic device may obtain an input track of the stylus pen, and draw the first content in the above-mentioned recognition display area according to the input track.

[0128] For example, taking the first content as text, the electronic device displays a main interface, which includes at least one application identifier. If the user wants to select an application in the main interface, the user can directly use the stylus to draw the first character of the name of the application to be selected on the plane. For example, for an atom reading program, the user can use the stylus to draw the word "original" on any operable plane, and the electronic device synchronously draws the word "original" in the recognition display area 61 of the main interface according to the input trajectory of the stylus. Figure 6 shown.

[0129] As another example, taking the first content as a graphic, the electronic device displays a main interface, which includes at least one application identifier. If the user wants to select an application in the main interface, the user can directly use the stylus to draw the main graphic of the icon of the application to be selected on the plane. For example, for the "Phone & Contacts" application, the main content of the graphic of the application is a "phone" graphic, and the user can use the stylus to draw a "phone" graphic that resembles a phone on any operable plane.

[0130] Exemplarily, taking the first content as a graphic, the electronic device displays a main interface, which includes at least one application icon. If the user wants to select a certain application in the main interface, the user can directly use a stylus to draw the main graphic of the icon of the application to be selected on a plane. For example, for the call application, the main content of the graphic of this application is a "C" - shaped graphic. The user can use the stylus to draw a graphic "C" on any operable plane, and the electronic device synchronously draws the graphic "C" in the recognition display area 70 of the main interface, as Figure 7 shown.

[0131] In some embodiments of the present application, the electronic device can match the first content with at least one object in the first interface, and select the target object that matches the first content from the at least one object.

[0132] Exemplarily, in combination with the above Figure 6 , after the electronic device synchronously draws "yuan" in the recognition display area of the main interface according to the input trajectory of the stylus, the electronic device recognizes the drawn "yuan" to obtain the corresponding character "yuan", and matches the character "yuan" with the application names of all applications in the main interface, and then selects the application icon whose first character of the application name is "yuan", so as to select the atomic reading application program.

[0133] Exemplarily again, in combination with the above example, after the electronic device synchronously draws the graphic "phone" in the recognition display area of the main interface according to the input trajectory of the stylus, the electronic device can match the drawn graphic "phone" with the graphics included in the application icons in the main interface, and select the application icon that matches the graphic "phone", so as to select the "Phone and Contacts" application.

[0134] Exemplarily again, in combination with the above Figure 7 , the electronic device uses the stylus to draw a graphic "C" on any operable plane according to the input trajectory of the stylus. The electronic device recognizes the shape of the drawn graphic "C" and the shape of the graphics included in the application icons in the main interface, and then selects the application icon that matches the shape of the graphic "C", so as to select the call application.

[0135] In the embodiments of the present application, by using a stylus to draw text or graphics, and matching the drawn text with the application name of the application, or matching the drawn graphics with the identifier of the application, the selection of application programs can be made more flexibly.

[0136] In some embodiments of the present application, the above - mentioned step 202a6 may include the following steps A1 and A2:

[0137] Step A1: The electronic device filters out at least one first object that matches the first content from all the applications on the first interface according to the first content.

[0138] Step A2: The electronic device selects a target object that matches the second content from at least one first object according to the second content in the recognition display area.

[0139] Wherein, the second content is text or a graph.

[0140] It should be noted that the explanation of the process of selecting the first object from all the applications on the first interface according to the first content can refer to the above embodiments, and will not be elaborated here.

[0141] In some embodiments of the present application, when there are multiple first objects that match the first content on the first interface, the electronic device can determine a target object that matches the second content from the multiple first objects according to the second content, and select the target object.

[0142] In some embodiments of the present application, after the electronic device determines a target object that matches the second content from multiple first objects, it can cancel the display of the recognition display area.

[0143] In some embodiments of the present application, when multiple first objects that match the first content are recognized on the first interface, the electronic device can mark the multiple first objects and number each first object.

[0144] Exemplarily, taking the multiple first objects including multiple applications as an example, as Figure 8 shown, after the electronic device synchronously draws "yuan" in the recognition display area 80 of the main interface according to the input trajectory of the stylus, the electronic device recognizes the drawn "yuan" to obtain the corresponding character "yuan", and matches the character "yuan" with the application names of all the applications on the main interface. Assuming that the application identifier 81, the application identifier 82, and the application identifier 83 on the main interface all match the character "yuan", then the above application identifiers 81, 82, and 83 are circled on the main interface, and at the same time, the multiple application identifiers are numbered in the order from top to bottom and from left to right, that is, the serial number 1 is added to the application identifier 81, the serial number 2 is added to the application identifier 82, and the serial number 3 is added to the application identifier 83.

[0145] Further, after the electronic device recognizes the application program, the above recognition display area disappears, that is, the display of the above recognition display area is cancelled.

[0146] In some embodiments of the present application, after marking the above-mentioned multiple first objects and numbering each first object, the electronic device selects a corresponding target object from at least one first object according to the sequence number drawn by the stylus.

[0147] For example, in combination with the above Figure 8 , circle application logo 81, application logo 82, and application logo 83 in the main interface, and mark the multiple application logos with serial numbers in order from top to bottom and from left to right. If the user wants to select application logo 81, the user can directly use the stylus to draw the serial number of application logo 81, that is, serial number "1", and the electronic device selects application logo 81 according to the serial number "1".

[0148] In an embodiment of the present application, when there are multiple applications matching the first content, the electronic device can number the multiple applications and select the target object that the user ultimately wants to select from the multiple applications based on the numbers drawn by the user using the stylus, thereby making application selection more flexible.

[0149] In some embodiments of the present application, the operation information includes: an angle between the stylus and the first plane; illustratively, the step 202 may include step 202b:

[0150] Step 202b: The electronic device selects a target object at a target position in the first interface according to an angle between the stylus and the first plane.

[0151] In some embodiments of the present application, the above angle may be an angle formed between the stylus pen and the first plane when the stylus pen operates on the first plane.

[0152] In some embodiments of the present application, the target position may be a preset position in the first interface. For example, the target position may include at least one of the following: upper left corner, upper right corner, lower right corner, lower left corner, center position, etc.

[0153] In some embodiments of the present application, when the electronic device detects key input and pen tip pressing operations on the stylus, the electronic device may start detecting the angle between the stylus and the first plane to perform corresponding control operations based on the angle.

[0154] In some embodiments of the present application, different angles may correspond to different target positions.

[0155] For example, in combination with the above Figure 3A, the main interface of the electronic device includes nine application logos from APP1 to APP9. When the user presses the button on the stylus, he or she taps the tip of the stylus twice on a flat surface. The electronic device detects the angle between the stylus and the flat surface, that is, the angle at which the stylus is gripped, and automatically identifies the application logo that needs to be located or selected based on the angle at which the stylus is gripped. In this way, by identifying the angle at which the user grips the stylus, it is more convenient to quickly locate the application located in the corners of the interface on the electronic device.

[0156] Specifically, when the angle of the stylus is greater than or equal to 45 degrees, the first application in the upper left corner of the interface is located. Fig.9A is a schematic diagram of the angle between the stylus and the plane, such as Fig.9A As shown, the angle between the stylus pen and the plane is greater than or equal to 45 degrees.

[0157] Or, when the angle of the stylus is less than or equal to 45 degrees, locate the first application in the upper right corner of the interface. Fig. 9B is another schematic diagram of the angle between the stylus and the plane, such as Fig. 9B As shown, the angle between the stylus and the plane is less than or equal to 45 degrees;

[0158] Or, when the angle of the stylus is greater than or equal to 45 degrees and the coordinates of the pen axis are offset downward, the first application in the lower left corner is located. Fig. 9C is another schematic diagram of the angle between the stylus and the plane, such as Fig. 9C As shown, the angle between the stylus pen and the plane is greater than or equal to 45 degrees, and the coordinate of the pen axis moves downward;

[0159] Or, when the angle of the stylus is less than or equal to 45 degrees and the coordinates of the pen axis move downward, locate the first application in the lower right corner. Fig.9D is another schematic diagram of the angle between the stylus and the plane, such as Fig.9D As shown, the angle between the stylus pen and the plane is less than or equal to 45 degrees, and the coordinate of the pen axis moves downward.

[0160] In an embodiment of the present application, the electronic device can detect the angle between the stylus and the plane, and locate the application at the corresponding position according to the angle, so that the user can more conveniently quickly locate the application in the four corners on the electronic device, that is, quickly jump to the first component in the four corners.

[0161] In some embodiments of the present application, the operation information includes: a pressing parameter of the tip of the stylus; illustratively, the step 202 may include step 202c:

[0162] Step 202c: The electronic device performs a corresponding control operation on the target application in the first interface according to the pressing parameters of the stylus tip.

[0163] The above control operation includes at least one of the following: starting a target application and displaying a function menu of the target application.

[0164] In some embodiments of the present application, after selecting a target application in the first interface, the electronic device detects a pressing parameter of the tip of the stylus pen, and performs corresponding control operations on the target application in the first interface according to the pressing parameter of the tip of the stylus pen.

[0165] It should be noted that the explanation of the process of selecting the target application in the first interface can be found in the description of the above embodiment, which will not be repeated here.

[0166] In some embodiments of the present application, the function menu includes at least one function option. For example, the function option may include an "uninstall application" option, a "remove application" option, a "share" option, etc.

[0167] For example, in combination with the above Figure 8 After the electronic device selects the atomic reading program corresponding to the application identifier 71 in the main interface, if the user needs to start the atomic reading program, the user can lightly press the tip of the stylus on the operable surface. After the electronic device detects the operation of lightly pressing the tip of the stylus, it starts the atomic reading program.

[0168] Again illustratively, in combination with the above Figure 8 After the electronic device selects the atomic reading program corresponding to the application identifier 71 in the main interface, if the user needs to view the function menu of the atomic reading program, the user can press the tip of the stylus pen on the operable plane with a greater pressing force. After the electronic device detects the above-mentioned pressing operation on the tip of the stylus pen, the function menu of the atomic reading program is displayed in the display area around the application identifier 71.

[0169] In an embodiment of the present application, after selecting a target application, the electronic device can quickly start the target application or call out a function menu of the target application according to the pressing parameters of the stylus tip, thereby enabling more complex operations on the target application through the stylus.

[0170] In some embodiments of the present application, after the above step 201, the control method provided by the embodiment of the present application may further include the following steps 203 and 204:

[0171] Step 203: The electronic device displays the stylus logo in the first interface according to the operation information of the stylus on the first plane.

[0172] The stylus mark is used to indicate the touch position of the stylus on the screen.

[0173] Step 204: The electronic device calculates and updates the display position of the stylus pen logo in the first interface in real time according to the movement parameters of the stylus pen in the first plane.

[0174] It should be noted that the above steps 203 and 204 may be performed after step 201 and before step 202 .

[0175] In some embodiments of the present application, the electronic device may display a stylus logo on the screen to indicate to the user that it has successfully switched to the control operation mode of the stylus. At the same time, the stylus movement coordinate data begins to be transmitted, and the corresponding operation coordinates are calculated through the movement range of the stylus on any operable plane to perform corresponding operations based on the operation coordinates.

[0176] In this way, the new interaction method allows users to operate more conveniently without directly touching the screen, thereby improving the user experience of the stylus.

[0177] In some embodiments of the present application, the stylus pen mark may be a graphic, a symbol, etc. For example, the stylus pen mark may be a pencil-shaped graphic.

[0178] It should be noted that the above-mentioned touch pen logo can also be called a stylus logo.

[0179] In some embodiments of the present application, the electronic device may determine a touch position of the stylus pen in the first interface according to operation information of the stylus pen on the first plane, and display a stylus pen logo at the position.

[0180] In some embodiments of the present application, the electronic device may update the display position of the stylus identifier in the first plane according to the movement parameters (ie, operation parameters) of the stylus in the first plane, so that the stylus identifier may move synchronously with the movement of the stylus.

[0181] In some embodiments of the present application, the electronic device may control the stylus marker to move the same distance in the electronic device according to the moving distance of the stylus in the first plane.

[0182] It can be understood that controlling the stylus marker to move the same distance in the electronic device means controlling the stylus movement coordinates to move proportionally in the screen of the electronic device, that is, the coordinate range of the stylus movement is proportional to the movement range of the electronic device screen.

[0183] For example, in combination with the above Figure 3AThe electronic device displays a main interface 31, which includes nine application icons APP1 to APP9. After the electronic device enters the control operation mode, Fig. 10A As shown, the electronic device displays a stylus mark 32 in the main interface 31 , and the position of the stylus mark 32 is the touch position that can be currently operated by the stylus.

[0184] Again illustratively, in combination with the above Fig. 10A After detecting the operation of drawing “-” from left to right by the stylus, the electronic device may move the stylus mark 32 to the right to the location of APP2, to indicate that the mark of APP2 can be operated by the stylus at present. Fig. 10B shown.

[0185] It should be noted that Fig. 10B The arrow in the middle indicates the direction of movement of the stylus marker.

[0186] Specifically, the electronic device moves the stylus mark in the first interface accordingly according to the input track of the stylus (such as the strokes drawn), thereby realizing the movement operation of the stylus mark. For example, the movement operation of the stylus mark is realized by transmitting the data of the stylus movement coordinates to the electronic device.

[0187] In some embodiments of the present application, the above-mentioned operation information includes an input trajectory, and the electronic device can obtain a continuous or discontinuous input trajectory of the stylus on the first plane. Further, in the case where the input trajectory includes at least two segments of input trajectory, the electronic device can use the end position of the first segment of the input trajectory as the starting position of the second segment of the input trajectory, so that the stylus marker continues to move with the current position as the starting position.

[0188] For example, when the user lifts the stylus during drawing and puts it down again to continue moving it on the plane, the electronic device can continue to move the stylus cursor by coordinates from the last end position of the movement, thereby facilitating the coordinate movement operation of the electronic device screen.

[0189] In an embodiment of the present application, the electronic device can display the stylus logo in the first interface based on the operation information of the stylus on the first plane, and synchronously update the display position of the stylus logo according to the operation information. By intuitively displaying the stylus logo in the interface, the user can easily perceive the current touch interface position.

[0190] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application are not limited to this.

[0191] In the control method provided in the embodiment of the present application, the execution subject may be a control device. In the embodiment of the present application, the control device provided in the embodiment of the present application is described by taking the control method executed by the control device as an example.

[0192] Fig.11 A schematic diagram of the structure of the control device provided in the embodiment of the present application is shown in FIG. Fig.11 As shown, the control device 600 may include: an acquisition module 601 and a processing module 602, wherein: the acquisition module 601 is used to acquire operation information of the stylus on the first plane when displaying the first interface, and the first plane is a plane other than the screen of the electronic device; the processing module 602 is used to perform corresponding control operations on the target object in the first interface according to the operation information acquired by the acquisition module 601, wherein the operation information includes: the input trajectory of the stylus on the first plane, the angle between the stylus and the first plane, and the pressing parameters of the tip of the stylus.

[0193] In some embodiments of the present application, the above-mentioned processing module is specifically used to perform corresponding control operations on the target object in the above-mentioned first interface according to the input trajectory of the above-mentioned stylus on the above-mentioned first plane; wherein the above-mentioned target object includes at least one of the following: target application, target page, target window; the above-mentioned control operation includes at least one of the following: selecting the above-mentioned target object, updating the display position of the above-mentioned target object, and updating the size of the above-mentioned target object.

[0194] In some embodiments of the present application, the processing module is specifically used to: determine the control instruction corresponding to the input trajectory according to whether the input trajectory of the stylus on the first plane matches the preset trajectory; and select the target object in the first interface according to the control instruction.

[0195] In some embodiments of the present application, the processing module is specifically used to: determine a target area in the first interface according to an input trajectory of the stylus; and select at least one target object in the target area.

[0196] In some embodiments of the present application, the processing module is specifically used to: display first content in the identification display area of ​​the first interface according to the input trajectory of the stylus; select a target object in the first interface according to the first content; wherein the first content is text or graphics.

[0197] In some embodiments of the present application, the processing module is specifically used to: based on the first content, filter out at least one first object that matches the first content in all applications of the first interface; based on the second content in the identified display area, select a target object that matches the second content from the at least one first object; wherein the second content is text or graphics.

[0198] In some embodiments of the present application, the above-mentioned operation information includes: the angle between the above-mentioned stylus and the above-mentioned first plane; the above-mentioned processing module is specifically used to: select the target object at the target position in the above-mentioned first interface according to the angle between the above-mentioned stylus and the above-mentioned first plane.

[0199] In some embodiments of the present application, the above-mentioned operation information includes: the pressing parameters of the pen tip of the above-mentioned stylus; the above-mentioned processing module is specifically used to: perform corresponding control operations on the target application in the above-mentioned first interface according to the pressing parameters of the pen tip of the above-mentioned stylus; wherein the above-mentioned control operation includes at least one of the following: starting the above-mentioned target application, displaying the function menu of the above-mentioned target application.

[0200] In some embodiments of the present application, the above-mentioned device also includes: a display module; the above-mentioned display module is used to obtain operation information of the stylus on the first plane when displaying the first interface, and then display a stylus logo in the above-mentioned first interface according to the operation information of the above-mentioned stylus on the first plane, and the above-mentioned stylus logo is used to indicate the touch position of the above-mentioned stylus on the screen; the above-mentioned display module is also used to calculate and update the display position of the above-mentioned stylus logo in the above-mentioned first interface in real time according to the movement parameters of the above-mentioned stylus in the above-mentioned first plane.

[0201] The control device provided in the embodiment of the present application obtains the operation information of the stylus on the first plane when displaying the first interface, and the first plane is a plane other than the screen of the electronic device; according to the above operation information, the corresponding control operation is performed on the target object in the first interface. Through this method, the control device can obtain the operation information of the stylus on the plane other than the screen, and perform the corresponding control operation according to the operation information, so that the touch operation is no longer limited to the screen of the electronic device, but can be extended to any plane (i.e., the first plane), so that the user can control the electronic device with the stylus in a larger space range without having to keep the arm suspended in the air at all times or move frequently to touch the screen, thereby improving the flexibility and convenience of the operation.

[0202] The control device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0203] The control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0204] The control device provided in the embodiment of the present application can implement each process implemented in the above-mentioned control method embodiment, and will not be described again here to avoid repetition.

[0205] Alternatively, if Fig.12 As shown, an embodiment of the present application also provides an electronic device 700, including a processor 701 and a memory 702, wherein the memory 702 stores programs or instructions that can be executed on the processor 701, and when the program or instructions are executed by the processor 701, the various steps of the above-mentioned control method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0206] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0207] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0208] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0209] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0210] Among them, the above-mentioned processor 110 is used to obtain operation information of the stylus on the first plane when displaying the first interface, and the above-mentioned first plane is a plane other than the screen of the electronic device; the above-mentioned processor 110 is used to perform corresponding control operations on the target object in the above-mentioned first interface according to the operation information obtained by the above-mentioned processor 110, wherein the above-mentioned operation information includes: the input trajectory of the above-mentioned stylus on the above-mentioned first plane, the angle between the above-mentioned stylus and the above-mentioned first plane, and the pressing parameters of the tip of the above-mentioned stylus.

[0211] In some embodiments of the present application, the processor 110 is specifically used to perform corresponding control operations on the target object in the first interface according to the input trajectory of the stylus on the first plane; wherein the target object includes at least one of the following: target application, target page, target window; the control operation includes at least one of the following: selecting the target object, updating the display position of the target object, and updating the size of the target object.

[0212] In some embodiments of the present application, the processor 110 is specifically used to: determine a control instruction corresponding to the input trajectory according to whether the input trajectory of the stylus on the first plane matches a preset trajectory; and select a target object in the first interface according to the control instruction.

[0213] In some embodiments of the present application, the processor 110 is specifically used to: determine a target area in the first interface according to an input trajectory of the stylus; and select at least one target object in the target area.

[0214] In some embodiments of the present application, the processor 110 is specifically used to: display first content in the identification display area of ​​the first interface according to the input trajectory of the stylus; select a target object in the first interface according to the first content; wherein the first content is text or graphics.

[0215] In some embodiments of the present application, the processor 110 is specifically used to: filter out at least one first object matching the first content in all applications of the first interface according to the first content; select a target object matching the second content from the at least one first object according to the second content in the identified display area; wherein the second content is text or graphics.

[0216] In some embodiments of the present application, the above-mentioned operation information includes: the angle between the above-mentioned stylus pen and the above-mentioned first plane; the above-mentioned processor 110 is specifically used to: select the target object at the target position in the above-mentioned first interface according to the angle between the above-mentioned stylus pen and the above-mentioned first plane.

[0217] In some embodiments of the present application, the above-mentioned operation information includes: the pressing parameters of the pen tip of the above-mentioned stylus; the above-mentioned processor 110 is specifically used to: perform corresponding control operations on the target application in the above-mentioned first interface according to the pressing parameters of the pen tip of the above-mentioned stylus; wherein the above-mentioned control operation includes at least one of the following: starting the above-mentioned target application, displaying the function menu of the above-mentioned target application.

[0218] In some embodiments of the present application, the display unit 106 is used to display a stylus logo in the first interface after obtaining operation information of the stylus on the first plane according to the operation information of the stylus on the first plane when displaying the first interface, and the stylus logo is used to indicate the touch position of the stylus on the screen; the display unit 106 is also used to calculate and update the display position of the stylus logo in the first interface in real time according to the movement parameters of the stylus in the first plane.

[0219] The electronic device provided in the embodiment of the present application obtains the operation information of the stylus on the first plane when displaying the first interface, and the first plane is a plane other than the screen of the electronic device; according to the above operation information, the corresponding control operation is performed on the target object in the first interface. Through this method, the electronic device can obtain the operation information of the stylus on the plane other than the screen, and perform the corresponding control operation according to the operation information, so that the touch operation is no longer limited to the screen of the electronic device, but can be extended to any plane (i.e., the first plane), so that the user can control the electronic device with the stylus in a larger space range without having to keep the arm suspended in the air at all times or move frequently to touch the screen, thereby improving the flexibility and convenience of the operation.

[0220] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0221] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0222] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0223] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned control method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0224] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0225] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0226] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0227] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned control method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0228] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0229] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0230] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A control method, applied to an electronic device, characterized in that: The method comprises: When the first interface is displayed, obtaining operation information of the stylus on a first plane, where the first plane is a plane other than the screen of the electronic device; According to the operation information, a corresponding control operation is performed on the target object in the first interface, wherein the operation information includes: an input trajectory of the stylus pen on the first plane, an angle between the stylus pen and the first plane, and a pressing parameter of the tip of the stylus pen.

2. The method according to claim 1, characterized in that The performing a corresponding control operation on the target object in the first interface according to the operation information includes: Performing a corresponding control operation on a target object in the first interface according to an input track of the stylus on the first plane; The target object includes at least one of the following: a target application, a target page, and a target window; and the control operation includes at least one of the following: selecting the target object, updating the display position of the target object, and updating the size of the target object.

3. The method according to claim 2, characterized in that The performing a corresponding control operation on a target object in the first interface according to the input track of the stylus pen on the first plane includes: Determining a control instruction corresponding to the input trajectory according to whether the input trajectory of the stylus on the first plane matches a preset trajectory; According to the control instruction, a target object in the first interface is selected.

4. The method according to claim 2, characterized in that: The performing a corresponding control operation on a target object in the first interface according to the input track of the stylus pen includes: Determining a target area in the first interface according to an input track of the stylus; At least one target object in the target area is selected.

5. The method according to claim 2, characterized in that: The performing a corresponding control operation on a target object in the first interface according to the input track of the stylus pen includes: Displaying first content in the identification display area of ​​the first interface according to the input track of the stylus pen; Selecting a target object in the first interface according to the first content; The first content is text or graphics.

6. A control device, characterized in that: The device comprises: an acquisition module and a processing module, wherein: The acquisition module is used to acquire operation information of the stylus on a first plane when the first interface is displayed, where the first plane is a plane other than the screen of the electronic device; The processing module is used to perform corresponding control operations on the target object in the first interface according to the operation information obtained by the acquisition module, wherein the operation information includes: an input trajectory of the stylus pen on the first plane, an angle between the stylus pen and the first plane, and a pressing parameter of the tip of the stylus pen.

7. The device according to claim 6, characterized in that The processing module is specifically configured to perform a corresponding control operation on a target object in the first interface according to an input track of the stylus pen on the first plane; The target object includes at least one of the following: a target application, a target page, and a target window; and the control operation includes at least one of the following: selecting the target object, updating the display position of the target object, and updating the size of the target object.

8. The device according to claim 7, characterized in that The processing module is specifically used for: Determining a control instruction corresponding to the input trajectory according to whether the input trajectory of the stylus on the first plane matches a preset trajectory; According to the control instruction, a target object in the first interface is selected.

9. The device according to claim 7, characterized in that The processing module is specifically used for: Determining a target area in the first interface according to an input track of the stylus; At least one target object in the target area is selected.

10. The device according to claim 7, characterized in that The processing module is specifically used for: Displaying first content in the identification display area of ​​the first interface according to the input track of the stylus pen; Selecting a target object in the first interface according to the first content; The first content is text or graphics.

Images