Control method

Abstract

The invention discloses a control method. The method comprises the following steps: receiving a first touch signal sent by a touch pen; the first touch signal is generated based on a first touch action of an operation body on the stylus; determining an application type of an application program running in a foreground of the electronic equipment; based on the application type of the application program, determining a control strategy corresponding to the first touch signal; and responding to the first touch signal based on the control strategy.

Description

Technical Field

[0001] The present application relates to the field of control technology, and in particular to a control method. Background Art

[0002] Currently, multiple applications are installed in electronic devices. Since each application has different functions and is developed in different ways, the control method of each application is also different. Therefore, users often need to interact with the corresponding application through different control methods, which reduces the convenience of users controlling different applications. Summary of the invention

[0003] In view of this, an embodiment of the present application provides at least one control method.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides a control method, the method comprising:

[0006] Receiving a first touch signal sent by a stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus;

[0007] Determine the application type of the application program running in the foreground of the electronic device;

[0008] Determining a control strategy corresponding to the first touch signal based on an application type of the application program;

[0009] Respond to the first touch signal based on the control strategy.

[0010] In a second aspect, an embodiment of the present application provides a control device, the control device comprising:

[0011] A receiving unit, configured to receive a first touch signal sent by a stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus;

[0012] A type determination unit, configured to determine an application type of an application program running in the foreground of the electronic device;

[0013] a strategy determining unit, configured to determine a control strategy corresponding to the first touch signal based on an application type of the application program;

[0014] A response unit is used to respond to the first touch signal based on the control strategy.

[0015] In a third aspect, an embodiment of the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0016] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements some or all of the steps in the above method when executed by a processor.

[0017] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program or instructions, which implement some or all of the steps in the above method when executed by a processor.

[0018] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0020] Figure 1 A schematic diagram of an implementation flow of a control method provided in an embodiment of the present application;

[0021] Figure 2 A control method according to an embodiment of the present invention is provided. Figure 1 ;

[0022] Figure 3 A control method according to an embodiment of the present invention is provided. Figure 2 ;

[0023] Figure 4 A control method according to an embodiment of the present invention is provided. Figure 3 ;

[0024] Figure 5 A control method according to an embodiment of the present invention is provided. Figure 4 ;

[0025] Figure 6 A control method according to an embodiment of the present invention is provided. Figure 5 ;

[0026] Figure 7 A control method according to an embodiment of the present invention is provided. Figure 6 ;

[0027] Figure 8 A control method according to an embodiment of the present invention is provided. Figure 7 ;

[0028] Fig. 9 A schematic diagram of the structure of a control device provided in an embodiment of the present application;

[0029] Fig.10 A schematic diagram of a hardware entity of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application are further elaborated in detail below in conjunction with the drawings and embodiments. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0031] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0032] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing this application and are not intended to limit this application.

[0034] In order to solve the technical problem of inconvenient control of different applications in the related art, an embodiment of the present application provides a control method, which can be applied to electronic devices. By way of example, the electronic devices include but are not limited to smart phones, tablet computers, wearable devices, personal computers (PCs), netbooks, etc., and the present application does not impose fixed restrictions on their implementation forms.

[0035] like Figure 1 As shown, the above control method can be implemented through steps S101 to S104:

[0036] Step S101 , receiving a first touch signal sent by a stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus.

[0037] Here, the stylus is a stylus that is communicatively connected to the electronic device. Exemplarily, the stylus may include one of the following: an active capacitive stylus, a passive capacitive stylus, an electromagnetic induction stylus, and an infrared and ultrasonic positioning stylus. In some embodiments, the stylus may be communicatively connected to the electronic device via Bluetooth. The operating body may be a user who interacts with the electronic device via the stylus. The first touch action may be an action of the operating body pressing, clicking, or sliding the stylus.

[0038] In some embodiments, a button is provided on the stylus, and an operator presses the button to cause the stylus to generate a first touch signal.

[0039] In some embodiments, a touch array is provided on the stylus, and when the operator touches the touch array, the stylus can generate a first touch signal, thereby sending the first touch signal to the electronic device. The touch array can be a piezoelectric vibrator array, and when the operator touches the touch array, the piezoelectric vibrators in the touch array can collect the electrical signal generated under the action of the positive piezoelectric effect, and obtain corresponding touch information based on the electrical signal, and finally generate the first touch signal based on the touch information.

[0040] It is understandable that the first touch action of the operating body on the stylus corresponds to the first touch signal. For example, the first touch signals corresponding to a click action and a slide action are different, the first touch signals corresponding to slide actions with different slide directions are also different, and the first touch signals corresponding to slide actions with different slide distances are also different. In other words, the stylus can generate different touch signals based on different touch actions of the operating body on the stylus.

[0041] Step S102: determining the application type of the application program running in the foreground of the electronic device.

[0042] Here, the application program running in the foreground of the electronic device is an application program that can be seen and interacted with by the operator.

[0043] It can be understood that when the electronic device receives the first touch signal sent by the stylus, it means that the operator is controlling the application of the electronic device through the stylus, so the electronic device needs to first determine the application type of the application. Because when facing different types of applications, even if the first touch signal received by the electronic device is exactly the same, the control strategy corresponding to the first touch signal is different.

[0044] Exemplarily, when the application is an application that outputs audio and video data, the operator clicks the stylus once to control the audio and video data to pause; when the application is an application that outputs image data, the operator clicks the stylus once to control the application to output the next image data.

[0045] In some embodiments, the electronic device may call the attribute information of the application program and determine the application type of the application program through the attribute information.

[0046] Step S103: determining a control strategy corresponding to the first touch signal based on the application type of the application program.

[0047] In an embodiment of the present application, multiple mapping relationships among different application types, different touch signals, and different control strategies are stored in the electronic device, and the corresponding control strategy is determined from the multiple mapping relationships according to the application type of the application program and the first touch signal.

[0048] In some embodiments, after determining the application type of the application, the type of output data of the display interface of the application may also be determined, and the control strategy corresponding to the first touch signal may be determined based on the application type of the application and the type of output data.

[0049] It is understandable that, because the application type of the application cannot accurately determine the type of data output by the application, it is necessary to determine the control strategy corresponding to the first touch signal in combination with the application type of the application and the type of output data. For example, when the application is determined to be an application that outputs audio and video data based on the application type of the application, but the current display interface of the application does not output audio and video data, but there is a large amount of text information, the control strategy determined at this time should be a control strategy for editing text type.

[0050] Step S104: responding to the first touch signal based on the control strategy.

[0051] In the embodiment of the present application, after the control strategy is determined, the electronic device can use the determined control strategy to control the application running in the foreground to respond to the first touch signal.

[0052] In the embodiment of the present application, the electronic device first receives a first touch signal generated by the stylus based on the first touch action of the operating body on the stylus, then determines the application type of the application running in the foreground of the electronic device, and determines the control strategy corresponding to the first touch signal based on the application type of the application, and finally responds to the first touch signal based on the control strategy. In this way, when facing different types of applications, the operating body can control different applications through the stylus, thereby improving the convenience of controlling the application.

[0053] In some embodiments, the above control method can also be implemented through steps S201 to S203:

[0054] Step S201, when the application type represents that the display interface of the application program outputs text information, determining that the control strategy is a first control strategy corresponding to the first touch signal; the first control strategy includes one of the following: copying text and pasting text.

[0055] In an embodiment of the present application, the electronic device determines the application type of the application based on the attribute information of the application, and when the display interface of the application outputs text information, the control strategy can be determined to be a first control strategy corresponding to the first touch signal. The first control strategy includes one of the following: copying text and pasting text.

[0056] It is understandable that the display interface of the application program outputs text information, which can indicate that the information output by the display interface of the application program includes text information. That is, when the display interface of the application program outputs text information, it can be determined that the operator's intention of operating the application program through the stylus pen is to edit the text information in the application program, and therefore the control strategy can be determined to be the first control strategy of the text information editing type.

[0057] For example, the application program may be an application program such as a notepad, a memo, or a browser that outputs a large amount of text information.

[0058] Step S202, when the application type represents that the application is an application that outputs audio and video data, determine that the control strategy is a second control strategy corresponding to the first touch signal; the second control strategy is used to affect the output state of the audio and video data.

[0059] In an embodiment of the present application, when it is determined that the application is an application that outputs audio and video data, it can be determined that the operator's intention to operate the application through the stylus is to operate the audio and video data in the application. At this time, it can be determined that the control strategy corresponding to the first touch signal is the second control strategy that affects the output state type of the audio and video data.

[0060] The second control strategy is used to affect the output state of the audio and video data, which means that when the second control strategy is used to respond to the first touch signal, the output states of the audio and video data before and after the response are different. Exemplarily, the second control strategy may include at least one of the following: pause, fast forward, fast rewind, volume adjustment, play the next file, and play the previous file.

[0061] Exemplarily, the application type may be an audio and video data player.

[0062] Step S203, when the application type represents that the application is an application for displaying image data, determining that the control strategy is a third control strategy corresponding to the first touch signal; the third control strategy is used to affect the display state of the image data.

[0063] In an embodiment of the present application, when it is determined that the application is an application that outputs image data, it can be determined that the operator's intention to operate the application through the stylus is to operate the image data in the application. At this time, it can be determined that the control strategy corresponding to the first touch signal is the third control strategy that affects the output state type of the image data.

[0064] The third control strategy is used to affect the output state of the image data, which means that when the second control strategy is used to respond to the first touch signal, the output states of the image data before and after the response are different. Exemplarily, the third control strategy may include at least one of the following: zooming, enlarging, displaying the next file, and displaying the previous file.

[0065] Exemplarily, the application type may be a picture display application.

[0066] In some embodiments, when the application type is other types of applications, the type of output data in the current display interface of the application can be obtained, and the control strategy corresponding to the first touch signal can be determined based on the type of output data in the current display interface of the application.

[0067] It is understandable that when the application type is not any of the application types determined in the above steps S201 to S203, the type of output data in the current display interface of the application can be obtained. In some embodiments, if there are at least two types of output data in the current display interface of the application, it is necessary to determine the proportion of each type of output data, and determine the control strategy corresponding to the type of output data with the highest proportion as the control strategy corresponding to the first touch signal. The proportion can be the proportion of the data volume, or the proportion of the area displayed by the data to the area of ​​the current display interface.

[0068] Exemplarily, when the application type is a browser, the type of output data in the current display interface of the browser can be obtained. If the type of output data is text information, the control strategy is determined to be the first control strategy; if the type of output data includes text information and audio and video data, and the proportion of audio and video data is greater than that of text information, the control strategy is determined to be the second control strategy.

[0069] In the embodiment of the present application, by determining the application type of the application, the data type that the application may output can be determined, and then the control strategy corresponding to the data type that the application may output is determined as the first control strategy corresponding to the first touch signal. In this way, by determining the application type of the application, the operator's operation intention can be accurately determined, thereby improving the accuracy of controlling the electronic device through the stylus.

[0070] In some embodiments, the electronic device has at least a first state and a second state; the above control method can also be implemented by the following steps:

[0071] Step S301: when the electronic device is in the first state, in response to a second touch signal, output corresponding display information; the second touch signal is generated based on a second touch action of the stylus on the electronic device.

[0072] In the embodiment of the present application, step S301 may be performed before the above step S101.

[0073] Here, the first state refers to the normal use state of the electronic device. The second touch action refers to various touch actions performed by the operating body using the stylus on the display screen of the electronic device. Exemplarily, the second touch action can be a line drawing action performed by the stylus on the display screen of the electronic device.

[0074] In an embodiment of the present application, when the stylus is an active stylus, the second touch signal may be an electrical signal sent by the stylus. In some embodiments, when the stylus is a passive stylus, the second touch signal may be an electrical signal generated by the electronic device itself due to contact between the stylus and the display screen.

[0075] It is understandable that, because the electronic device is in the first state, when the operator uses the stylus pen to perform various touch actions on the display screen of the electronic device, the electronic device can output display information corresponding to the touch actions.

[0076] Exemplarily, when the second touch action is a line drawing action performed by the stylus on the display screen of the electronic device, the electronic device can control the display screen to output a line.

[0077] Step S302, in response to the input signal of the stylus, controlling the electronic device to be in the second state; in response to the third touch signal, determining the target text in the text information of the display interface; the third touch signal is generated based on the third touch action of the stylus on the electronic device.

[0078] Here, the input signal may be a signal generated by an operation performed by an operating body on the stylus. For example, the operating body may press a button on the stylus, or perform a touch action such as sliding or clicking on the stylus.

[0079] In the embodiment of the present application, the second state of the electronic device may be a copy state, and the electronic device in the copy state can determine the target text in the display interface of the application based on the third touch signal, and make the display state of the target text different from the display state of other text information. The third touch signal is generated based on a third touch action of the stylus on the electronic device, and the third touch action may be the same as or different from the second touch action.

[0080] Exemplarily, when the electronic device is in the second state, the operating body controls the stylus to draw a line on the display screen of the electronic device. At this time, because the electronic device is not in the first state, a line will not be displayed. Instead, the target text in the display interface of the application is determined, and the target text is controlled to be in a selection state to prompt the operating body that the corresponding text has been selected and the text editing action can continue.

[0081] For example, Figure 2 As shown, there is a large amount of text information in the display interface 201 . When the electronic device is in the second state, the electronic device can determine the target text 2011 in the display interface 201 in response to the third touch signal.

[0082] In some embodiments, the “determining that the control strategy is the first control strategy corresponding to the first touch signal” in the above step S201 can also be implemented by the following steps:

[0083] Step S2011, when the first touch signal is a first sub-touch signal, determining that the control strategy is a control strategy for copying text; the first sub-touch signal is generated based on a first sliding action of the operating body on the stylus; the sliding direction of the first sliding action is from the tip of the stylus to the end of the stylus.

[0084] Step S2012, when the first touch signal is a second sub-touch signal, determining that the control strategy is a control strategy for pasting text; the second sub-touch signal is generated based on a second sliding action of the operating body on the stylus; the sliding direction of the second sliding action is from the end of the stylus to the tip of the stylus.

[0085] It is understandable that the stylus can generate different touch signals due to different touch actions of the operating body on the stylus, wherein the different touch actions may refer to at least one of the following touch information being different: touch position, touch times, touch intensity, and touch track obtained based on the touch position.

[0086] In the embodiment of the present application, a touch array is provided on the surface of the stylus. When the operating body touches the stylus, the stylus can detect the touch action on the stylus through the touch array, and then determine the touch signal corresponding to the touch action.

[0087] In an embodiment of the present application, when the stylus recognizes through the touch array that the touch action of the operating body is a sliding action from the tip of the stylus to the end of the stylus, a first sub-touch signal is obtained, and the first sub-touch signal is sent to the electronic device. The electronic device can then determine a control strategy for copying text. It is understandable that the upward sliding action on the stylus can simulate the absorption action of the straw, so that when the operating body uses the stylus, it can be more intuitive and simple to complete the copying of text. Similarly, when the stylus recognizes through the touch array that the touch action of the operating body is a sliding action from the end of the stylus to the tip of the stylus, a second sub-touch signal is obtained, and the second sub-touch signal is sent to the electronic device. The electronic device can then determine a control strategy for pasting text. It is understandable that the downward sliding action on the stylus can simulate the release action of the straw, so that when the operating body uses the stylus, it can be more intuitive and simple to complete the pasting of text.

[0088] For example, Figure 3 As shown, after the electronic device determines the target text 2011 in the display interface 201 , the operating body 204 can slide on the stylus 203 from the tip of the stylus 203 to the end of the stylus 203 , and the electronic device executes the action of copying the target text 2011 .

[0089] For example, Figure 4 As shown, the operating body 204 can slide on the stylus 203 from the end of the stylus 203 to the tip of the stylus 203 , and the electronic device executes an action of pasting the target text 2011 .

[0090] In the embodiment of the present application, the operating body can copy the target text by sliding the stylus from the tip of the stylus to the end of the stylus; and paste the target text by sliding the stylus from the end of the stylus to the tip of the stylus. In this way, the upward sliding action on the stylus can simulate the suction action of the straw, and the downward sliding action on the stylus can simulate the release action of the straw, so that the operating body can copy and paste text more intuitively and simply when using the stylus.

[0091] In some embodiments, when the control strategy is a control strategy for pasting text, the above step S104 can be implemented by the following steps:

[0092] Step S401, when the text synchronization function of the stylus is turned on, pasting the first text based on the first touch signal; the first text is obtained based on the third touch signal of the stylus or based on the copy signal of the electronic device.

[0093] Here, the text synchronization function refers to a function of pasting the copied text by using a stylus pen after the text is copied by using a non-stylus pen.

[0094] In the embodiment of the present application, the text synchronization function of the stylus pen can be enabled by a setting program corresponding to the stylus pen. The text synchronization function of the stylus pen can also be enabled by a touch signal sent by the stylus pen, which is generated based on the touch action of the operating body on the stylus pen.

[0095] In the embodiment of the present application, the first touch signal is the first sub-touch signal, that is, to determine the pasted text, and at this time, it is necessary to determine the source of the first text, because the text synchronization function of the stylus pen has been turned on, so the first text can be the text copied by the third touch signal of the stylus pen, or the text copied by the copy signal of the electronic device. Among them, the copy signal of the electronic device can be generated by the operating body performing a touch action on the display screen of the electronic device, or it can be generated by the operating body controlling an input device connected to the electronic device.

[0096] Exemplarily, before the electronic device receives the first touch signal, the operator copies the first text on the display screen of the electronic device with a finger, and then the operator slides down on the stylus, and the electronic device can paste the first text.

[0097] Step S402 , when the text synchronization function of the stylus pen is turned off, pasting the second text based on the first touch signal; the second text is obtained based on the third touch signal of the stylus pen.

[0098] In the embodiment of the present application, when the text synchronization function of the stylus is turned off, the electronic device can only paste the second text obtained based on the third touch signal of the stylus in response to the first touch signal. In other words, when the text synchronization function of the stylus is turned off, even if the operator copied the text by other means at the last moment, the electronic device cannot paste the text in response to the first touch signal.

[0099] Exemplarily, at time 1 before the electronic device receives the first touch signal, the operating body copies text 1 on the display screen of the electronic device with a finger, and at time 2 before time 1, the operating body copies text 2 with a stylus. At this time, when the electronic device receives the first touch signal, the electronic device can only paste text 2 in response to the first touch signal, but cannot paste text 1.

[0100] In the embodiment of the present application, by turning on the text synchronization function of the stylus pen, it is possible to paste the first text obtained based on the third touch signal of the stylus pen or the first text obtained based on the copy signal of the electronic device based on the first touch signal; by turning off the text synchronization function of the stylus pen, it is possible to paste the first text obtained based on the third touch signal of the stylus pen based on the first touch signal. In this way, the flexibility of pasting text can be improved through the text synchronization function of the stylus pen.

[0101] In some embodiments, when the control strategy is a control strategy for copying text, the above step S104 can be implemented by the following steps:

[0102] Step S501: based on the first touch signal, copy the target text and output an interactive interface; the interactive interface includes an automatic save control.

[0103] In an embodiment of the present application, when the first touch signal is generated based on the touch action of the operating body on the stylus from the tip of the stylus to the end of the stylus, the electronic device copies the selected target text and outputs an interactive interface after the copying is successful, through which the user can be prompted that the target text has been copied successfully.

[0104] Step S502, when the automatic save control indicates that the automatic save function of the electronic device is turned on, the target text is saved in the text display interface.

[0105] The text display interface is an interface in the application that is different from the display interface, or the text display interface is an interface in other applications that are different from the application.

[0106] In the embodiment of the present application, step S502 and step S501 can be performed simultaneously. That is, if the automatic saving function of the electronic device is turned on, after the target text is successfully copied, the target text has been saved in the text display interface.

[0107] It should be noted that the above-mentioned text display interface and the clipboard for temporarily storing copied text belong to different applications. That is to say, when the automatic save function of the electronic device is turned on, the electronic device copies the target text, and the target text will be saved in the text display interface and temporarily stored in the clipboard. When the electronic device performs a paste action, the target text can be obtained from the clipboard. When the electronic device copies other text again, the target text has disappeared. Therefore, the role of the clipboard is only to temporarily store the copied text.

[0108] The text display interface in the embodiment of the present application permanently saves the copied text, which is equivalent to automatically pasting the copied target text into the text display interface. In other words, when the automatic save function of the electronic device is turned on, the electronic device can paste the text into the predetermined position without performing the pasting action.

[0109] In some embodiments, the text display interface can be pre-set. For example, the text display interface is set as a notepad application in the electronic device.

[0110] In some embodiments, the automatic save function of the electronic device can be turned on by a stylus, that is, when the operator performs a corresponding touch action on the stylus, the stylus can send an activation signal to the electronic device, and the electronic device can activate the automatic save function in response to the activation signal. In other embodiments, the automatic save function can also be activated by an automatic save control, that is, when the automatic save function of the electronic device is in an off state, the automatic save function of the electronic device is activated in response to a trigger operation on the automatic save control.

[0111] In some embodiments, the text display interface is an interface different from the display interface in the application. For example, if the application running in the foreground of the electronic device is a text-type application (such as a notepad, memo, etc.), when the target text of the display interface of the application is copied, the target text can be automatically saved on other interfaces of the application.

[0112] In some embodiments, the text display interface is an interface in another application different from the application. For example, if the application running in the foreground of the electronic device is a non-text type application (such as a browser), when the target text of the display interface of the application is copied, the target text can be automatically saved in the interface of the other application, which can be a notepad, a memo, etc.

[0113] like Figure 5As shown, after copying the target text 2011, the electronic device can output an interactive interface 2012, which includes a prompt text "Copied and automatically saved" and an automatic save control 20121, which indicates that the automatic save function of the electronic device is turned on.

[0114] In the embodiment of the present application, when the automatic save function of the electronic device is turned on, the copied target text can be automatically saved to the text display interface. In this way, the operator does not need to perform multiple paste actions, thereby improving the convenience of editing text.

[0115] In some embodiments, the above-mentioned interactive interface further includes a viewing control; the above-mentioned method can also be implemented by the following steps:

[0116] Step S601: in response to a triggering operation on the viewing control, displaying the target text through the text display interface.

[0117] In the embodiment of the present application, when the automatic saving function of the electronic device is turned on, the electronic device can automatically save the target text in the text display interface. At this time, if the operator needs to view the automatically saved text, he can click the viewing control in the interactive interface, and the electronic device can output the text display interface and display the copied target text in the text display interface.

[0118] In the embodiment of the present application, the attributes of the text display interface have at least one of the following characteristics:

[0119] The interface size of the text display interface is smaller than the interface size of the display interface;

[0120] In the case where the interface size of the text display interface is smaller than the interface size of the display interface, the text display interface is located on the surface of the display interface and at an edge position of the display interface;

[0121] The transparency of the text display interface is greater than the transparency of the display interface.

[0122] It is understandable that the display interface of the application is the main interface, so when the electronic device outputs the text display interface, the display interface cannot be blocked.

[0123] like Figure 5 As shown, the interactive interface 2012 also includes a viewing control 20122. When the viewing control 20122 is triggered, the electronic device can output a text display interface 205, and the interface size of the text display interface 205 is smaller than the size of the display interface 201, and the text display interface 205 is at the right edge of the display interface 201.

[0124] In the embodiment of the present application, after the viewing control in the interactive interface is triggered, a text display interface can be output, and the copied target text can be displayed on the text display interface. In this way, by setting the viewing control, the operator can view the copied content at any time, thereby improving the convenience of the operator in editing text.

[0125] In some embodiments, when the automatic save control indicates that the automatic save function of the electronic device is in a turned-off state, the control method may also be implemented by at least one of the following steps:

[0126] Step S701, in response to a triggering operation on the automatic saving control, enabling the automatic saving function.

[0127] like Figure 5 As shown, Figure 5 The automatic save control 20121 shown is "Auto Save Off", which means that the automatic save function of the electronic device is turned on. When the automatic save control is "Auto Save On", it means that the automatic save function of the electronic device is turned off, and the automatic save function can be turned on by triggering the automatic save control.

[0128] Step S702, in response to a triggering operation on an application corresponding to the stylus, displaying a setting page of the stylus; in response to a triggering operation on a function setting control in the setting page, enabling the automatic saving function.

[0129] In the embodiment of the present application, the automatic save function can be enabled through the settings page in the application corresponding to the stylus.

[0130] Step S703 , in response to a fourth touch signal, enabling the automatic saving function; the fourth touch signal is generated based on a third sliding action of the operating body on the stylus.

[0131] In the embodiment of the present application, in order to improve the convenience of enabling the automatic saving function, the automatic saving function of the electronic device can be enabled by a stylus. Exemplarily, the third sliding action can be two clicks.

[0132] In some embodiments, when the first touch signal is generated based on the fourth sliding action of the operating body on the stylus, the above step S104 can also be implemented by the following steps:

[0133] Step S801, based on the first touch signal, displaying a history data editing interface; the history data editing interface includes at least one history editing data sub-interface; the history editing data sub-interface is used to display the history editing data obtained by the operator performing the history editing operation in the electronic device;

[0134] In the embodiment of the present application, when the electronic device receives the first touch signal generated based on the fourth sliding action of the operating body on the stylus, the historical data editing interface can be displayed on the display interface of the application program, so that the operator can view the historical editing data obtained by performing the historical editing operation in the electronic device. For example, the fourth sliding action can be sliding up and down twice on the stylus.

[0135] In the embodiment of the present application, different historical editing data sub-interfaces include different historical editing data, wherein the historical editing data includes at least one of the following: text data, image data, and file data.

[0136] Wherein, in the case where the historical editing data is text data, the historical editing operation may be at least one of text copying, text pasting, and text inputting. That is, when the operator performs a copying operation, a pasting operation, or an input operation on the text in the electronic device, the corresponding text data can be displayed in the historical editing data sub-interface. Moreover, the source of the text data can also be displayed in the historical editing data sub-interface. For example, if the copied text belongs to program 1, the icon information of program 1 can be displayed in the historical editing data sub-interface.

[0137] In the case where the historical edited data is image data, the historical edit operation may be a screenshot operation or an image editing operation. That is, the operator performs a screenshot operation and / or an image editing operation on the image data in the electronic device, and the screenshot data and the image data on which the image editing operation has been performed can be displayed in the historical edited data sub-interface.

[0138] In the case where the historical edited data is file data, the file data may be at least one of the following: a document file, a spreadsheet file, and a presentation file. The historical convenient operation may be an open file operation, a save operation, etc. That is, after the operator operates the file data in the electronic device, the file data after the operation can be displayed in the historical edited data sub-interface.

[0139] like Figure 6 As shown, after the operating body 204 slides up and down twice on the stylus pen, a historical data editing interface 601 can be output on the display interface of the application program, and the historical data editing interface 601 includes multiple historical data editing sub-interfaces 6011. Figure 6 The text data displayed in the first history editing data sub-interface 6011 and the picture data displayed in the second history editing data sub-interface 6011.

[0140] Step S802: In response to a triggering operation on a target sub-interface in the at least one historical editing data sub-interface, inserting the historical editing data in the target sub-interface into the current display interface.

[0141] For example, Figure 6 As shown, if the target sub-interface is the first history editing data sub-interface 6011 among multiple history editing data sub-interfaces 6011, the text data in the history editing data sub-interface 6011 is inserted into the current display interface 602; if the target sub-interface is the second history editing data sub-interface 6011 among multiple history editing data sub-interfaces 6011, the image data in the history editing data sub-interface 6011 is inserted into the current display interface 602.

[0142] In some embodiments, the historical data editing interface further includes a drawing board interface; the method can also be implemented by the following steps:

[0143] Step S901, in response to a triggering operation on the artboard interface, displaying an artboard editing interface; the artboard editing interface includes an insert control.

[0144] In the embodiment of the present application, after the electronic device displays the drawing board editing interface, the electronic device outputs corresponding drawing board data on the drawing board editing interface in response to a fifth touch signal, wherein the fifth touch signal is generated based on a touch action of the stylus on the electronic device.

[0145] like Figure 7 As shown, the historical data editing interface 601 also includes a drawing board interface 6012. When the drawing board interface 6012 is triggered, the electronic device can display a drawing board editing interface 6013, which includes an insert control 60131. The operator can draw on the drawing board editing interface 6013 with a stylus to obtain drawing board data.

[0146] Step S902: In response to a trigger operation on the insert control, inserting the artboard data in the artboard editing interface into the current display interface.

[0147] like Figure 8 As shown, the artboard editing interface 6013 includes artboard data 6014 , and after the insert control 60131 is triggered, the artboard data 6014 can be inserted into the current display interface 602 .

[0148] In the embodiment of the present application, the drawing board function can be called through the historical data editing interface, thereby improving the convenience of the operator's interaction with the electronic device.

[0149] In some embodiments, the operator can use the upward sliding gesture of the stylus to absorb (copy) the selected content, and use the downward sliding gesture of the stylus to release (paste) the content to the desired location. In this way, copying and pasting are realized through a unified stylus gesture, simulating the suction and release of a straw, and the operator can more intuitively and simply complete the copying and use of content when using the pen.

[0150] In some embodiments, when the automatic save function of the electronic device is turned on, the content can be copied and directly summarized into the note by using the upward swipe gesture of the stylus. In this way, the content can be "automatically saved" by swiping the stylus upward, and can be traced back at any time when needed.

[0151] In some embodiments, when the operator uses the stylus to slide down to release content, not only can the operator insert the most recently copied content, but can also intuitively see the most recently copied graphics and text, and the most recently saved pictures / files. The operator can directly select the required content to insert, and can also insert creative content, making it easier to add content during the note-taking or content creation process.

[0152] Fig. 9 A schematic diagram of the structure of a control device provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the control device 900 includes: a receiving unit 901, a type determination unit 902, a strategy determination unit 903 and a response unit 904, wherein:

[0153] The receiving unit 901 is configured to receive a first touch signal sent by the stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus;

[0154] A type determination unit 902, configured to determine an application type of an application program running in the foreground of the electronic device;

[0155] A strategy determining unit 903, configured to determine a control strategy corresponding to the first touch signal based on an application type of the application program;

[0156] The responding unit 904 is configured to respond to the first touch signal based on the control strategy.

[0157] In some embodiments, the above-mentioned type determination unit 902 is used for at least one of the following: when the application type represents that the display interface of the application outputs text information, determining that the control strategy is a first control strategy corresponding to the first touch signal; the first control strategy includes one of the following: copying text and pasting text; when the application type represents that the application is an application that outputs audio and video data, determining that the control strategy is a second control strategy corresponding to the first touch signal; the second control strategy is used to affect the output state of the audio and video data; when the application type represents that the application is an application that displays image data, determining that the control strategy is a third control strategy corresponding to the first touch signal; the third control strategy is used to affect the display state of the image data.

[0158] In some embodiments, the electronic device has at least a first state and a second state; the response unit 904 is further used to output corresponding display information in response to a second touch signal when the electronic device is in the first state; the second touch signal is generated based on a second touch action of the stylus on the electronic device; in response to an input signal of the stylus, the electronic device is controlled to be in the second state; in response to a third touch signal, a target text is determined in the text information of the display interface; the third touch signal is generated based on a third touch action of the stylus on the electronic device.

[0159] In some embodiments, the strategy determination unit 903 is also used to determine that the control strategy is a control strategy for copying text when the first touch signal is a first sub-touch signal; the first sub-touch signal is generated based on a first sliding motion of the operating body on the stylus; the sliding direction of the first sliding motion is from the tip of the stylus to the end of the stylus; when the first touch signal is a second sub-touch signal, determine that the control strategy is a control strategy for pasting text; the second sub-touch signal is generated based on a second sliding motion of the operating body on the stylus; the sliding direction of the second sliding motion is from the end of the stylus to the tip of the stylus.

[0160] In some embodiments, when the control strategy is a control strategy for pasting text, the response unit 904 is further used to paste the first text based on the first touch signal when the text synchronization function of the stylus is turned on; the first text is obtained based on the third touch signal of the stylus, or based on the copy signal of the electronic device; when the text synchronization function of the stylus is turned off, the second text is pasted based on the first touch signal; the second text is obtained based on the third touch signal of the stylus.

[0161] In some embodiments, when the control strategy is a control strategy for copying text, the response unit 904 is further used to copy the target text based on the first touch signal and output an interactive interface; the interactive interface includes an automatic save control; when the automatic save control represents that the automatic save function of the electronic device is in an on state, the target text is saved in a text display interface; wherein the text display interface is an interface in the application that is different from the display interface, or the text display interface is an interface in other applications that are different from the application.

[0162] In some embodiments, the interactive interface also includes a viewing control; the control device 900 also includes: a display unit; the display unit is used to display the target text through the text display interface in response to a trigger operation on the viewing control; wherein the attributes of the text display interface have at least one of the following characteristics: the interface size of the text display interface is smaller than the interface size of the display interface; when the interface size of the text display interface is smaller than the interface size of the display interface, the text display interface is on the surface of the display interface and at the edge of the display interface; the transparency of the text display interface is greater than the transparency of the display interface.

[0163] In some embodiments, when the automatic save control represents that the automatic save function of the electronic device is in an off state, the response unit 904 is also used for at least one of the following: in response to a trigger operation on the automatic save control, turning on the automatic save function; in response to a trigger operation on an application corresponding to the stylus, displaying a setting page of the stylus; in response to a trigger operation on a function setting control in the setting page, turning on the automatic save function; in response to a fourth touch signal, turning on the automatic save function; the fourth touch signal is generated based on a third sliding action of the operating body on the stylus.

[0164] In some embodiments, when the first touch signal is generated based on the fourth sliding action of the operating body on the stylus, the response unit 904 is also used to display a historical data editing interface based on the first touch signal; the historical data editing interface includes at least one historical editing data sub-interface; the historical editing data sub-interface is used to display the historical editing data obtained by the operating body performing a historical editing operation in the electronic device; the historical editing data includes at least one of the following: text data, picture data, and file data; in response to a trigger operation on a target sub-interface in the at least one historical editing data sub-interface, the historical editing data in the target sub-interface is inserted into the current display interface.

[0165] In some embodiments, the historical data editing interface also includes a canvas interface; the response unit 904 is also used to display the canvas editing interface in response to a trigger operation on the canvas interface; the canvas editing interface includes an insert control; in response to a trigger operation on the insert control, the canvas data in the canvas editing interface is inserted into the current display interface.

[0166] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided in the embodiment of the present application can be used to execute the method described in the above method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0167] It should be noted that in the embodiment of the present application, if the above-mentioned data processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software, and firmware.

[0168] An embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0169] The embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium can be transient or non-transient.

[0170] An embodiment of the present application provides a computer program, including a computer-readable code. When the computer-readable code is run in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0171] The embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented specifically by hardware, software or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK) and the like.

[0172] It should be noted here that the description of the various embodiments above tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. The description of the above device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the embodiments of the device, storage medium, computer program and computer program product of this application, please refer to the description of the method embodiment of this application for understanding.

[0173] Fig.10 is a schematic diagram of a hardware entity of an electronic device in an embodiment of the present application, such as Fig.10 As shown, the hardware entity of the electronic device 1000 includes: a processor 1001, a communication interface 1002 and a memory 1003, wherein:

[0174] The processor 1001 generally controls the overall operation of the electronic device 1000 , and the overall operation may be to implement the control method provided in the embodiment of the present application.

[0175] The communication interface 1002 enables the computer device to communicate with other terminals or servers through a network.

[0176] The memory 1003 is configured to store instructions and applications executable by the processor 1001, and can also cache data to be processed or processed by the processor 1001 and each module in the electronic device 1000 (for example, image data, audio data, voice communication data, and video communication data), which can be implemented by flash memory (FLASH) or random access memory (Random Access Memory, RAM). Data transmission can be performed between the processor 1001, the communication interface 1002, and the memory 1003 through the bus 1004.

[0177] An embodiment of the present application provides a computer storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the control method of any of the above embodiments.

[0178] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0179] The processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that the electronic device that implements the functions of the processor may also be other, and the embodiments of the present application are not specifically limited.

[0180] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disk, or a compact disc read-only memory (CD-ROM) and the like; it can also be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0181] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial number of each step / process mentioned above does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0182] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0183] The above are only implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. A control method, applied to an electronic device, comprising: receiving a first touch signal sent by the stylus; The first touch signal is generated based on a first touch action of an operating body on the stylus; Determine the application type of the application program running in the foreground of the electronic device; Determining a control strategy corresponding to the first touch signal based on an application type of the application program; Respond to the first touch signal based on the control strategy.

2. The method according to claim 1, wherein determining the control strategy corresponding to the first touch signal based on the application type of the application comprises at least one of the following: In a case where the application type represents that a display interface of the application program outputs text information, determining that the control strategy is a first control strategy corresponding to the first touch signal; The first control strategy includes one of the following: copying text and pasting text; In a case where the application type represents that the application is an application that outputs audio and video data, determining that the control strategy is a second control strategy corresponding to the first touch signal; The second control strategy is used to affect the output state of the audio and video data; In a case where the application type represents that the application is an application for displaying image data, determining that the control strategy is a third control strategy corresponding to the first touch signal; The third control strategy is used to influence the display state of the image data.

3. The method according to claim 2, wherein the electronic device has at least a first state and a second state; the method further comprises: When the electronic device is in the first state, in response to a second touch signal, outputting corresponding display information; The second touch signal is generated based on a second touch action of the stylus on the electronic device; In response to the input signal of the stylus, the electronic device is controlled to be in the second state; in response to the third touch signal, the target text is determined in the text information of the display interface; the third touch signal is generated based on the third touch action of the stylus on the electronic device.

4. The method according to claim 3, wherein determining the control strategy as a first control strategy corresponding to the first touch signal comprises: In a case where the first touch signal is a first sub-touch signal, determining that the control strategy is a control strategy for copying text; The first sub-touch signal is generated based on a first sliding action of the operating body on the stylus; the sliding direction of the first sliding action is from the tip of the stylus to the end of the stylus; In the case where the first touch signal is a second sub-touch signal, the control strategy is determined to be a control strategy for pasting text; the second sub-touch signal is generated based on a second sliding action of the operating body on the stylus; and the sliding direction of the second sliding action is from the end of the stylus to the tip of the stylus.

5. The method according to claim 4, wherein when the control strategy is a control strategy for pasting text, responding to the first touch signal based on the control strategy comprises: When a text synchronization function of the stylus is turned on, pasting a first text based on the first touch signal; The first text is obtained based on a third touch signal of the stylus pen, or based on a copy signal of the electronic device; When the text synchronization function of the stylus is turned off, the second text is pasted based on the first touch signal; and the second text is obtained based on the third touch signal of the stylus.

6. The method according to claim 4, wherein when the control strategy is a control strategy for copying text, responding to the first touch signal based on the control strategy comprises: Based on the first touch signal, copy the target text and output an interactive interface; The interactive interface includes an automatic save control; When the automatic save control indicates that the automatic save function of the electronic device is turned on, saving the target text to the text display interface; The text display interface is an interface in the application that is different from the display interface, or the text display interface is an interface in other applications that are different from the application.

7. The method according to claim 6, wherein the interactive interface further comprises a viewing control; the method further comprises: In response to a trigger operation on the viewing control, displaying the target text through the text display interface; The attributes of the text display interface have at least one of the following characteristics: The interface size of the text display interface is smaller than the interface size of the display interface; In the case where the interface size of the text display interface is smaller than the interface size of the display interface, the text display interface is located on the surface of the display interface and at an edge position of the display interface; The transparency of the text display interface is greater than the transparency of the display interface.

8. The method according to claim 6, wherein, when the automatic save control indicates that the automatic save function of the electronic device is in a closed state, the method further comprises at least one of the following: In response to a triggering operation on the automatic saving control, enabling the automatic saving function; In response to a trigger operation on an application corresponding to the stylus, displaying a setting page of the stylus; in response to a trigger operation on a function setting control in the setting page, enabling the automatic saving function; In response to a fourth touch signal, the automatic saving function is enabled; the fourth touch signal is generated based on a third sliding action of the operating body on the stylus.

9. The method according to any one of claims 1 to 6, wherein when the first touch signal is generated based on a fourth sliding action of the operating body on the stylus, responding to the first touch signal based on the control strategy comprises: Based on the first touch signal, displaying a historical data editing interface; The historical data editing interface includes at least one historical data editing sub-interface; The historical editing data sub-interface is used to display the historical editing data obtained by the operator performing the historical editing operation in the electronic device; the historical editing data includes at least one of the following: text data, image data and file data; In response to a triggering operation on a target sub-interface in the at least one historical editing data sub-interface, the historical editing data in the target sub-interface is inserted into the current display interface.

10. The method according to claim 9, wherein the historical data editing interface further comprises a drawing board interface; the method further comprises: In response to a triggering operation on the artboard interface, displaying an artboard editing interface; The drawing board editing interface includes an insert control; In response to a trigger operation on the insert control, the artboard data in the artboard editing interface is inserted into the current display interface.

Images