Control method

By receiving stylus signals and determining the application type to respond to touch actions, the problem of inconsistent control methods for different applications is solved, achieving convenient and accurate unified control.

CN119356591BActive Publication Date: 2025-11-25LENOVO (BEIJING) LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411389802.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-30
Publication Date
2025-11-25
Estimated Expiration
2044-09-30

AI Technical Summary

Technical Problem

Users need to interact with different applications through different control methods, resulting in poor control convenience.

Method used

By receiving touch signals sent by the stylus, the type of application running in the foreground of the electronic device is determined, and a corresponding control strategy is determined based on that type to respond to the touch signals.

Benefits of technology

It improves the ease of operating different applications, enables unified control via stylus, and enhances the accuracy and intuitiveness of control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119356591B_ABST
    Figure CN119356591B_ABST
Patent Text Reader

Abstract

The application discloses a control method, which comprises the following steps: receiving a first touch signal sent by a touch pen; the first touch signal is generated based on a first touch action of an operating body on the touch pen; determining an application type of an application program running in the foreground of the electronic device; determining a control strategy corresponding to the first touch signal based on the application type of the application program; and responding to the first touch signal based on the control strategy.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of control, in particular to a control method. BACKGROUND

[0002] At present, multiple application programs are installed in electronic devices. Since the functions of each application program are different, and the development methods of each application program are also different, the control methods of each application program are also different. Therefore, users often need to interact with corresponding application programs through different control methods, which reduces the convenience of users in controlling different application programs. SUMMARY

[0003] Therefore, the embodiments of the present application at least provide a control method.

[0004] The technical scheme of the embodiments of the present application is implemented as follows:

[0005] In a first aspect, the embodiments of the present application provide a control method, which comprises the following steps:

[0006] receiving a first touch signal sent by a stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus;

[0007] determining an application type of an application program running in the foreground of the electronic device;

[0008] determining a control strategy corresponding to the first touch signal based on the application type of the application program;

[0009] responding to the first touch signal based on the control strategy.

[0010] In a second aspect, the embodiments of the present application provide a control device, which comprises:

[0011] a receiving unit, configured to receive a first touch signal sent by a stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus;

[0012] a type determining unit, configured to determine an application type of an application program running in the foreground of the electronic device;

[0013] a strategy determining unit, configured to determine a control strategy corresponding to the first touch signal based on the application type of the application program;

[0014] a responding unit, configured to respond to the first touch signal based on the control strategy.

[0015] In a third aspect, an electronic device is provided, which includes a memory and a processor. The memory stores a computer program capable of running on the processor. The processor implements some or all steps of the above method when executing the program.

[0016] In a fourth aspect, a computer readable storage medium is provided, which stores a computer program. The computer program is executed by a processor to implement some or all steps of the above method.

[0017] In a fifth aspect, a computer program product is provided, which includes a computer program or instructions. The computer program or instructions are executed by a processor to implement some or all steps of the above method.

[0018] It should be understood that the general description above and the detailed description below are only exemplary and explanatory, rather than limiting the technical solutions of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0019] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the technical solutions of the present application.

[0020] Figure 1 An implementation flowchart of a control method provided by an embodiment of the present application is shown in the figure.

[0021] Figure 2 A scenario diagram of a control method provided by an embodiment of the present application is shown in the figure. Figure One ;

[0022] Figure 3 A scenario diagram of a control method provided by an embodiment of the present application is shown in the figure. Figure Two ;

[0023] Figure 4 A scenario diagram of a control method provided by an embodiment of the present application is shown in the figure. Figure Three ;

[0024] Figure 5 A scenario diagram of a control method provided by an embodiment of the present application is shown in the figure. Figure Four ;

[0025] Figure 6 A scenario diagram of a control method provided by an embodiment of the present application is shown in the figure. Figure Five ;

[0026] Figure 7 A scenario diagram of a control method provided by an embodiment of the present application is shown in the figure. Figure Six ;

[0027] Figure 8 A scenario diagram of a control method provided by an embodiment of the present application is shown in the figure.Figure Seven ;

[0028] Figure 9 A schematic diagram of a control device according to an embodiment of the present application is provided.

[0029] Figure 10 A schematic diagram of a hardware entity of an electronic device according to an embodiment of the present application is provided. DETAILED DESCRIPTION

[0030] In order to make the purposes, technical solutions and advantages of the present application clearer, the technical solutions of the present application are further described in detail below in combination with the drawings and embodiments, and the described embodiments should not be regarded as limiting the present application, and all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0031] In the following description, "some embodiments" are described, which describe a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0032] The terms "first / second / third" involved are only to distinguish similar objects, and do not represent a specific order of the objects, and it can be understood that "first / second / third" can interchange the specific order or sequence as allowed, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs. The terms used herein are only for the purpose of describing the present application and are not intended to limit the present application.

[0034] In order to solve the technical problem of inconvenient control of different application programs in the related art, the embodiments of the present application provide a control method, which can be applied to an electronic device, exemplarily, the electronic device includes but is not limited to a smart phone, a tablet computer, a wearable device, a personal computer (PC), a netbook, etc., and the implementation form of the present application is not fixedly limited.

[0035] As shown in Figure 1 The above control method can be implemented by steps S101 to S104:

[0036] Step S101, receiving a first touch signal sent by a stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus.

[0037] Here, the stylus is a stylus in communication connection with the electronic device. Exemplarily, the stylus can include one of the following: an active capacitive stylus, a passive capacitive stylus, an electromagnetic induction stylus, and an infrared and ultrasonic positioning stylus. In some embodiments, the stylus can be in communication connection with the electronic device through Bluetooth. The operator can be a user who interacts with the electronic device through the stylus. The first touch action can be at least one of pressing, clicking, and sliding the stylus by the operator.

[0038] In some embodiments, the stylus is provided with a button, and the operator presses the button to cause the stylus to generate the first touch signal.

[0039] In some embodiments, the stylus is provided with a touch array, and the stylus can generate the first touch signal when the operator touches the touch array, and then send the first touch signal to the electronic device. The touch array can be a piezoelectric vibrator array. When the operator touches the touch array, the piezoelectric vibrator in the touch array can collect an electrical signal generated under the action of the positive piezoelectric effect, obtain corresponding touch information based on the electrical signal, and finally generate the first touch signal based on the touch information.

[0040] It can be understood that the first touch action of the operator on the stylus corresponds to the first touch signal. For example, the first touch signal corresponding to the click action is different from the first touch signal corresponding to the sliding action, the first touch signal corresponding to the sliding action with different sliding directions is different, and the first touch signal corresponding to the sliding action with different sliding distances is also different. That is, the stylus can generate different touch signals based on different touch actions of the operator on the stylus.

[0041] Step S102, determining the application type of the application program running in the foreground of the electronic device.

[0042] Here, the application program running in the foreground of the electronic device is an application program that can be seen and interacted with by the operator.

[0043] It can be understood that when the electronic device receives the first touch signal sent by the stylus, it means that the operator is controlling the application program of the electronic device through the stylus. Therefore, the electronic device needs to determine the application type of the application program first, because different types of application programs have different control strategies corresponding to the same first touch signal received by the electronic device.

[0044] Exemplarily, when the application program is an application program outputting audio and video data, the operator clicking the stylus once can control the audio and video data to pause. When the application program is an application program outputting image data, the operator clicking the stylus once can control the application program to output the next image data.

[0045] In some embodiments, the electronic device can invoke attribute information of the application program, and determine the application type of the application program based on the attribute information.

[0046] In step S103, a control strategy corresponding to the first touch signal is determined based on the application type of the application program.

[0047] In the embodiments of the present application, the electronic device stores a plurality of mapping relationships among different application types, different touch signals and different control strategies, and the corresponding control strategy is determined among the plurality of mapping relationships based on the application type of the application program and the first touch signal.

[0048] In some embodiments, after determining the application type of the application program, the type of output data of the display interface of the application program can also be determined, and the control strategy corresponding to the first touch signal is determined based on the application type of the application program and the type of output data.

[0049] It can be understood that, because the application type of the application program cannot accurately determine the type of data output by the application program, the control strategy corresponding to the first touch signal needs to be determined based on the application type of the application program and the type of output data. For example, when the application type of the application program is determined to be an application program outputting audio and video data based on the application type of the application program, but there is no audio and video data output in the current display interface of the application program, and there is a large amount of text information, the control strategy determined at this time should be an editing text type control strategy.

[0050] In step S104, the first touch signal is responded based on the control strategy.

[0051] In the embodiments of the present application, after determining the control strategy, the electronic device can control the application program running in the foreground by using the determined control strategy, so as to respond to the first touch signal.

[0052] In the embodiments of the present application, the electronic device first receives the first touch signal generated based on the first touch action of the operating body on the stylus sent by the stylus, then determines the application type of the application program running in the foreground of the electronic device, and determines the control strategy corresponding to the first touch signal based on the application type of the application program, and finally responds to the first touch signal based on the control strategy. In this way, in the face of different types of application programs, the operating body can control different application programs through the stylus, thereby improving the convenience of controlling the application program.

[0053] In some embodiments, the above control method can also be implemented by steps S201 to S203:

[0054] In step S201, in a case where the application type characterizes that the display interface of the application program outputs text information, the control strategy is determined as a first control strategy corresponding to the first touch signal; the first control strategy includes one of the following: copying text and pasting text.

[0055] In the embodiments of the present application, in a case where the application type characterizes that the display interface of the application program outputs text information, the control strategy can be determined as a first control strategy corresponding to the first touch signal. The first control strategy includes one of the following: copying text and pasting text.

[0056] It can be understood that the display interface of the application program outputs text information can mean that the information output by the display interface of the application program includes text information. That is, when the display interface of the application program outputs text information, it can be determined that the operation intention of the operator to the application program through the stylus is to edit the text information in the application program, and therefore the control strategy can be determined as a first control strategy of the type of editing text information.

[0057] Exemplarily, the application program can be a notepad, a memo, a browser that outputs a large amount of text information, and the like.

[0058] In step S202, in a case where the application type characterizes that the application program is an application program that outputs audio and video data, the control strategy is determined as a second control strategy corresponding to the first touch signal; the second control strategy is used to affect the output state of the audio and video data.

[0059] In the embodiments of the present application, in a case where the application program is determined as an application program that outputs audio and video data, it can be determined that the operation intention of the operator to the application program through the stylus is to operate the audio and video data in the application program, and at this time the control strategy corresponding to the first touch signal can be determined as a second control strategy of the type of affecting the output state of the audio and video data.

[0060] The second control strategy for affecting the output state of the audio and video data means that the output states corresponding to the audio and video data before and after responding to the first touch signal are different when the second control strategy is used to respond to the first touch signal. Exemplarily, the second control strategy can include at least one of the following: pausing playing, fast forwarding, fast rewinding, volume adjusting, playing the next file, and playing the previous file.

[0061] Exemplarily, the application type can be an audio and video data player.

[0062] Step S203, in a case where the application type characterizes the application program as an application program for displaying image data, determining the control strategy as a third control strategy corresponding to the first touch signal; the third control strategy is used to affect the display state of the image data.

[0063] In the embodiments of the present application, in a case where the application program is determined to be an application program for outputting image data, it can be determined that the operation intention of the operator to the application program through the stylus is to operate the image data in the application program, and at this time, it can be determined that the control strategy corresponding to the first touch signal is a third control strategy for affecting the output state type of the image data.

[0064] The third control strategy is used to affect the output state of the image data, which means that the output states of the image data before and after responding to the first touch signal are different when the second control strategy is used to respond to the first touch signal. For example, the third control strategy can include at least one of the following: zooming in, zooming out, displaying the next file, and displaying the previous file.

[0065] For example, the application type can be a picture display application.

[0066] In some embodiments, in a case where the application type is an application program of another type, the type of output data in the current display interface of the application program can be obtained, and the control strategy corresponding to the first touch signal is determined based on the type of output data in the current display interface of the application program.

[0067] It can be understood that, when the application type is not any of the application types determined in steps S201 to S203, the type of output data in the current display interface of the application program can be obtained. In some embodiments, if there are at least two types of output data in the current display interface of the application program, the proportion of each type of output data needs to be determined, and the control strategy corresponding to the type of output data with the highest proportion is determined as the control strategy corresponding to the first touch signal. The proportion can be the proportion of data quantity, or the proportion of data display area to the current display interface area.

[0068] For example, when the application type is a browser, the type of output data in the current display interface of the browser can be obtained, if the type of output data is text information, the control strategy is determined as the first control strategy; if the type of output data includes text information and audio and video data, and the proportion of audio and video data is greater than that of text information, the control strategy is determined as the second control strategy.

[0069] In the embodiments of the present application, the application type of the application program is determined, the data type that the application program can output is determined, and then the control strategy corresponding to the data type that the application program can output is determined as the first control strategy corresponding to the first touch signal. In this way, the operation intention of the operator can be accurately determined by determining the application type of the application program, thereby improving the accuracy of controlling the electronic device by the stylus.

[0070] In some embodiments, the electronic device has at least a first state and a second state; and the control method can be implemented by the following steps:

[0071] In step S301, in the case that the electronic device is in the first state, display information corresponding to a second touch signal is output in response to the second touch signal; the second touch signal is generated based on a second touch action of the stylus on the electronic device.

[0072] In the embodiments of the present application, step S301 can be performed before step S101.

[0073] Here, the first state refers to the normal use state of the electronic device. The second touch action refers to various touch actions performed by the operator using the stylus on the display screen of the electronic device. Exemplarily, the second touch action can be a line drawing action performed by the stylus on the display screen of the electronic device.

[0074] In the embodiments of the present application, in the case that the stylus is an active stylus, the second touch signal can be an electrical signal sent by the stylus. In some embodiments, in the case that the stylus is a passive stylus, the second touch signal can be an electrical signal generated by the electronic device itself due to the contact between the stylus and the display screen.

[0075] It can be understood that, because the electronic device is in the first state, when the operator performs various touch actions on the display screen of the electronic device using the stylus, the electronic device can output display information corresponding to the touch action.

[0076] Exemplarily, in the case that the second touch action is a line drawing action performed by the stylus on the display screen of the electronic device, the electronic device can control the display screen to output a line.

[0077] In step S302, the electronic device is controlled to be in the second state in response to an input signal of the stylus; and a target text is determined in the text information of the display interface in response to a third touch signal; the third touch signal is generated based on a third touch action of the stylus on the electronic device.

[0078] Here, the input signal can be a signal generated by the operator performing operations on the stylus. For example, the operator can press a button on the stylus, or perform touch actions such as sliding or clicking on the stylus.

[0079] In this embodiment, the second state of the electronic device can be a copy state. In this copy state, the electronic device can determine the target text in the application's display interface based on a third touch signal, and make the display state of the target text different from the display state of other text information. The third touch signal is generated based on a third touch action of a stylus on the electronic device. This third touch action can be the same as or different from the second touch action described above.

[0080] For example, when the electronic device is in the second state, the operator controls the stylus to draw a line on the screen of the electronic device. At this time, since the electronic device is not in the first state, a line will not be displayed. Instead, the target text in the display interface of the application is determined and the target text is controlled to be in the selection state to prompt the operator that the corresponding text has been selected and the text editing action can continue.

[0081] For example, such as Figure 2 As shown, the display interface 201 contains a large amount of text information. When the electronic device is in the second state, the electronic device can respond to the third touch signal to determine the target text 2011 in the display interface 201.

[0082] In some embodiments, the step S201 above, "determining that the control strategy is a first control strategy corresponding to the first touch signal," can also be achieved through the following steps:

[0083] Step S2011: When the first touch signal is a first sub-touch signal, determine that the control strategy is a control strategy for copying text; the first sub-touch signal is generated based on the first sliding action of the operating body on the stylus; the sliding direction of the first sliding action is from the tip of the stylus to the end of the stylus.

[0084] Step S2012: When the first touch signal is the second sub-touch signal, determine that the control strategy is a control strategy for pasting text; the second sub-touch signal is generated based on the second sliding action of the operating body on the stylus; the sliding direction of the second sliding action is from the end of the stylus to the tip of the stylus.

[0085] It is understandable that different touch actions performed by the user on the stylus will result in different touch signals generated by the stylus. These differences in touch actions can refer to at least one of the following touch information being different: touch location, number of touches, touch intensity, and touch trajectory based on the touch location.

[0086] In this embodiment of the application, a touch array is provided on the surface of the stylus. When the operator touches the stylus, the stylus can detect the touch action on the stylus through the touch array, and then determine the touch signal corresponding to the touch action.

[0087] In this embodiment, when the stylus detects a sliding motion from the tip to the end of the stylus via the touch array, a first sub-touch signal is obtained and sent to the electronic device. The electronic device can then determine a control strategy for copying text. It is understood that an upward sliding motion on the stylus can simulate the absorption action of a straw, allowing the user to copy text more intuitively and easily. Similarly, when the stylus detects a sliding motion from the end to the tip of the stylus via the touch array, a second sub-touch signal is obtained and sent to the electronic device. The electronic device can then determine a control strategy for pasting text. It is understood that a downward sliding motion on the stylus can simulate the release action of a straw, allowing the user to paste text more intuitively and easily.

[0088] For example, such as Figure 3 As shown, after the electronic device selects the target text 2011 in the display interface 201, the operating body 204 can perform a sliding motion on the stylus 203 from the tip of the stylus 203 to the end of the stylus 203, at which time the electronic device performs the action of copying the target text 2011.

[0089] For example, such as Figure 4 As shown, the operating body 204 can slide on the stylus 203 from the end of the stylus 203 to the tip of the stylus 203, at which time the electronic device performs the action of pasting target text 2011.

[0090] In this embodiment, the operator can copy target text by sliding from the tip to the end of the stylus; and paste target text by sliding from the end to the tip of the stylus. Thus, the upward sliding motion on the stylus simulates the absorption action of an eyedropper, and the downward sliding motion simulates the release action of an eyedropper, enabling the operator to copy and paste text more intuitively and easily when using the stylus.

[0091] In some embodiments, in the case that the control policy is a control policy for pasting text, the above step S104 can be implemented by the following steps:

[0092] Step S401, in the case that the text synchronization function of the stylus is turned on, pasting first text based on the first touch signal; the first text is obtained based on a third touch signal of the stylus or a copy signal of the electronic device.

[0093] Here, the text synchronization function refers to the function that after copying text by a non-stylus, the copied text can be pasted by the stylus.

[0094] In the embodiments of the present application, the way to turn on the text synchronization function of the stylus can be through a setting program corresponding to the stylus. The text synchronization function of the stylus can also be turned on through a touch signal sent by the stylus, which is generated based on the touch action of the operator on the stylus.

[0095] In the embodiments of the present application, the first touch signal is a first sub-touch signal, that is, to determine the pasted text, at this time, the source of the first text needs to be determined. Since the text synchronization function of the stylus has been turned on, the first text can be text copied through the third touch signal of the stylus, or text copied through the copy signal of the electronic device. The copy signal of the electronic device can be generated by the operator performing a touch action on the display screen of the electronic device, or can be generated by the operator controlling the input device connected to the electronic device.

[0096] Exemplarily, before the electronic device receives the first touch signal, the operator copies the first text on the display screen of the electronic device by a finger, and then performs a downward sliding action on the stylus. The electronic device can paste the first text.

[0097] Step S402, in the case that the text synchronization function of the stylus is turned off, pasting second text based on the first touch signal; the second text is obtained based on a third touch signal of the stylus.

[0098] In the embodiments of the present application, when the text synchronization function of the stylus is turned off, the electronic device can only paste the second text obtained based on the third touch signal of the stylus in response to the first touch signal. That is, when the text synchronization function of the stylus is turned off, even if the operator copies text by other means at the last moment, the electronic device cannot paste the text in response to the first touch signal.

[0099] Exemplarily, at time 1 before the electronic device receives the first touch control signal, the operation body copies text 1 on the display screen of the electronic device by a finger, at time 2 before time 1, the operation body copies text 2 by a stylus, at this time when the electronic device receives the first touch control signal, the electronic device can only paste text 2 in response to the first touch control signal, and cannot paste text 1.

[0100] In the embodiments of the present application, by turning on the text synchronization function of the stylus, the first text obtained based on the third touch control signal of the stylus or the first text obtained based on the copy signal of the electronic device can be pasted based on the first touch control signal; by turning off the text synchronization function of the stylus, the first text obtained based on the third touch control signal of the stylus can be pasted based on the first touch control signal. In this way, the flexibility of pasting text can be improved by the text synchronization function of the stylus.

[0101] In some embodiments, in the case that the control strategy is the control strategy for copying text, the above step S104 can be implemented by the following steps:

[0102] Step S501, based on the first touch control signal, copying the target text and outputting an interactive interface; the interactive interface includes an automatic save control.

[0103] In the embodiments of the present application, when the first touch control signal is generated based on the touch action of the operation body on the stylus from the tip of the stylus to the end of the stylus, the electronic device copies the target text that has been selected and outputs an interactive interface after the copying is successful, which can prompt the user that the target text has been copied successfully.

[0104] Step S502, in the case that the automatic save function of the electronic device is in an open state, saving the target text to a text display interface.

[0105] The text display interface is an interface in the application program different from the display interface, or the text display interface is an interface in another application program different from the application program.

[0106] In the embodiments of the present application, step S502 and step S501 can be performed synchronously. That is, if the automatic save function of the electronic device is in an open state, after the target text is copied successfully, the target text has been saved to the text display interface.

[0107] It should be noted that the above text display interface and the clipboard for temporarily storing the copied text belong to different applications. That is, when the automatic saving function of the electronic device is in the enabled state, the electronic device copies the target text, which is saved in the text display interface and temporarily stored in the clipboard. When the electronic device performs a paste action, the target text can be obtained from the clipboard. When the electronic device copies other text again, the target text has disappeared. Therefore, the role of the clipboard is only to temporarily store the copied text.

[0108] The text display interface in the embodiments of the present application permanently saves the copied text, which is equivalent to automatically pasting the copied target text into the text display interface. That is, when the automatic saving function of the electronic device is in the enabled state, the electronic device does not need to perform a paste action to paste the text to the predetermined position.

[0109] In some embodiments, the text display interface can be pre-set. For example, the text display interface is set as a notepad application in the electronic device.

[0110] In some embodiments, the automatic saving function of the electronic device can be enabled by a stylus, that is, when the operation body performs a corresponding touch action on the stylus, the stylus can send an enabling signal to the electronic device, and the electronic device can enable the automatic saving function in response to the enabling signal. In other embodiments, the automatic saving function can also be enabled by an automatic saving control, that is, in the case that the automatic saving function of the electronic device is in the disabled state, the automatic saving function of the electronic device is enabled in response to a trigger operation on the automatic saving control.

[0111] In some embodiments, the text display interface is an interface different from the display interface in the application. For example, if the application running in the foreground of the electronic device is a text type application (such as a notepad, a memo, etc.), when the target text in the display interface of the application is copied, the target text can be automatically saved in other interfaces of the application.

[0112] In some embodiments, the text display interface is an interface in other applications different from the application. For example, if the application running in the foreground of the electronic device is a non-text type application (such as a browser), when the target text in the display interface of the application is copied, the target text can be automatically saved in the interface in other applications, which can be a notepad, a memo, etc.

[0113] As Figure 5As shown, after copying the target text 2011, the electronic device can output an interactive interface 2012, which includes the prompt text "Copied and automatically saved" and an automatic save control 20121, which indicates that the automatic save function of the electronic device is enabled.

[0114] In this embodiment, when the electronic device's auto-save function is enabled, the copied target text can be automatically saved to the text display interface. This eliminates the need for the operator to perform multiple paste operations, thus improving the convenience of text editing.

[0115] In some embodiments, the above-described interactive interface further includes a viewing control; the above method can also be implemented through the following steps:

[0116] Step S601: In response to a trigger operation on the viewing control, the target text is displayed through the text display interface.

[0117] In this embodiment, when the automatic save function of the electronic device is enabled, the electronic device can automatically save the target text in the text display interface. At this time, if the operator needs to view the automatically saved text, they can click the view control in the interactive interface, and the electronic device can output the text display interface and display the copied target text in the text display interface.

[0118] In this embodiment of the application, the attributes of the text display interface have at least one of the following characteristics:

[0119] The size of the text display interface is smaller than the size of the display interface;

[0120] When the size of the text display interface is smaller than the size of the display interface, the text display interface is located on the surface of the display interface and at the edge of the display interface.

[0121] The transparency of the text display interface is greater than the transparency of the display interface.

[0122] It is understandable that the application's display interface is the main interface, so when an electronic device outputs text to the display interface, the display interface should not be obscured.

[0123] like Figure 5 As shown, the interactive interface 2012 also includes a viewing control 20122. When the viewing control 20122 is triggered, the electronic device can output a text display interface 205. The size of the text display interface 205 is smaller than the size of the display interface 201, and the text display interface 205 is located at the right edge of the display interface 201.

[0124] In the embodiments of the present application, after triggering the viewing control in the interaction interface, a text display interface can be output, and the copied target text is displayed on the text display interface. In this way, by setting the viewing control, the operator can view the copied content at any time, thereby improving the convenience of the operator in editing the text.

[0125] In some embodiments, in the case that the automatic saving function of the electronic device is in the closed state, the above control method can be further implemented by at least one of the following steps:

[0126] In step S701, the automatic saving function is started in response to the triggering operation on the automatic saving control.

[0127] As shown in Figure 5 Figure 5 The automatic saving control 20121 shown is "Close automatic saving", which means that the automatic saving function of the electronic device is in the open state. When the automatic saving control is "Open automatic saving", it means that the automatic saving function of the electronic device is in the closed state, and at this time, the automatic saving function can be started by triggering the automatic saving control.

[0128] In step S702, in response to the triggering operation on the application corresponding to the stylus, a setting page of the stylus is displayed; and in response to the triggering operation on the function setting control in the setting page, the automatic saving function is started.

[0129] In the embodiments of the present application, the automatic saving function can be started through the setting page in the application corresponding to the stylus.

[0130] In step S703, the automatic saving function is started in response to the fourth touch signal, and the fourth touch signal is generated based on the third sliding action of the operator on the stylus.

[0131] In the embodiments of the present application, in order to improve the convenience of starting the automatic saving function, the automatic saving function of the electronic device can be started through the stylus. For example, the above-mentioned third sliding action can be clicking 2 times.

[0132] In some embodiments, in the case that the first touch signal is generated based on the fourth sliding action of the operator on the stylus, step S104 can be further implemented by the following steps:

[0133] In step S801, the historical data editing interface is displayed based on the first touch signal; the historical data editing interface includes at least one historical editing data sub-interface; the historical editing data sub-interface is used to display the historical editing data obtained by the operator in the electronic device by historical editing operation; ​

[0134] In this embodiment, when the electronic device receives a first touch signal generated based on a fourth sliding action of the operator on the stylus, a history data editing interface can be displayed on the application's display screen, allowing the operator to view the history editing data obtained from their own historical editing operations on the electronic device. For example, the fourth sliding action can be sliding the stylus up and down twice.

[0135] In this embodiment, different historical editing data sub-interfaces include different historical editing data. The historical editing data includes at least one of the following: text data, image data, and file data.

[0136] In the case where the historical editing data is text data, the historical editing operation can be at least one of the following: text copying, text pasting, or text input. That is, when the operator performs a copying, pasting, or text input operation on the electronic device, the corresponding text data can be displayed in the historical editing data sub-interface. Furthermore, the source of the text data can also be displayed in the historical editing data sub-interface; for example, if the copied text belongs to program 1, the icon information of program 1 can be displayed in the historical editing data sub-interface.

[0137] When the historical editing data is image data, the historical editing operations can be screenshot operations or image editing operations. That is to say, when the operator performs a screenshot operation and / or edits image data on the electronic device, the screenshot data and the image data that has been edited can be displayed in the historical editing data sub-interface.

[0138] When the historical editing data is file data, this file data can be at least one of the following: document file, spreadsheet file, and presentation file. Historical convenient operations can include opening a file, saving a file, etc. In other words, after an operation is performed on file data on an electronic device, the updated file data can be displayed in the historical editing data sub-interface.

[0139] like Figure 6 As shown, after the operator 204 slides up and down twice on the stylus, a history data editing interface 601 can be output on the application's display screen. This history data editing interface 601 includes multiple history data editing sub-interfaces 6011. Figure 6 The first history editing data sub-interface 6011 displays text data, and the second history editing data sub-interface 6011 displays image data.

[0140] Step S802: In response to a trigger operation on a target sub-interface in the at least one historical editing data sub-interface, the historical editing data in the target sub-interface is inserted into the current display interface.

[0141] As shown in Figure 6 , if the target sub-interface is the first historical editing data sub-interface 6011 in the plurality of historical editing data sub-interfaces 6011, the text data in the historical editing data sub-interface 6011 is inserted into the current display interface 602; if the target sub-interface is the second historical editing data sub-interface 6011 in the plurality of historical editing data sub-interfaces 6011, the picture data in the historical editing data sub-interface 6011 is inserted into the current display interface 602.

[0142] In some embodiments, the historical data editing interface further includes a drawing board interface; and the method can be implemented by the following steps:

[0143] In step S901, in response to a triggering operation on the drawing board interface, a drawing board editing interface is displayed; the drawing board editing interface includes an insertion control.

[0144] In the embodiments of the present application, after the electronic device displays the drawing board editing interface, the electronic device outputs corresponding drawing board data on the drawing board editing interface in response to a fifth touch signal. The fifth touch signal is generated based on the touch action of the stylus on the electronic device.

[0145] As shown in Figure 7 , the historical data editing interface 601 further includes a drawing board interface 6012. When the drawing board interface 6012 is triggered, the electronic device can display a drawing board editing interface 6013, which includes an insertion control 60131. The operator can draw on the drawing board editing interface 6013 by using the stylus to obtain drawing board data.

[0146] In step S902, in response to a triggering operation on the insertion control, the drawing board data in the drawing board editing interface is inserted into the current display interface.

[0147] As shown in Figure 8 , the drawing board editing interface 6013 includes drawing board data 6014. After the insertion control 60131 is triggered, the drawing board data 6014 can be inserted into the current display interface 602.

[0148] In the embodiments of the present application, the drawing board function can be called through the historical data editing interface, thereby improving the convenience of the operator interacting with the electronic device.

[0149] In some embodiments, the operator can use the up sliding gesture of the stylus to absorb (copy) the selected content, and use the down sliding gesture of the stylus to release (paste) the content to the desired position. In this way, the copying and pasting are implemented through a unified stylus gesture, simulating the sucking and releasing of a straw, so that the operator can more intuitively and simply complete the copying and pasting of content when using the stylus.

[0150] In some embodiments, when the automatic save function of the electronic device is turned on, the content is copied using the up sliding gesture of the stylus, and is directly summarized to the note. In this way, the "automatic save" can be realized through the up sliding gesture of the stylus, and the operator can always backtrack when needed.

[0151] In some embodiments, when the operator releases the content using the down sliding gesture of the stylus, not only the content of the last copying can be inserted, but also the recently copied images and texts, the recently saved pictures / files can be intuitively seen, the desired content can be directly selected for insertion, and the created content can be inserted, so that the adding of content in the process of making notes or content is more simple.

[0152] Figure 9 A control device provided in an embodiment of the present application has a component structure as shown in the schematic diagram of the component structure of the control device Figure 9 As shown in the schematic diagram of the component structure of the control device, the control device 900 includes a receiving unit 901, a type determining unit 902, a policy determining unit 903, and a responding unit 904, wherein:

[0153] The receiving unit 901 is configured to receive a first touch signal sent by a stylus; the first touch signal is generated based on a first touch action of an operating body on the stylus;

[0154] The type determining unit 902 is configured to determine an application type of an application program running in the foreground of the electronic device;

[0155] The policy determining unit 903 is configured to determine a control policy corresponding to the first touch signal based on the application type of the application program;

[0156] The responding unit 904 is configured to respond to the first touch signal based on the control policy.

[0157] In some embodiments, the type determination unit 902 is configured to determine the control strategy as a first control strategy corresponding to the first touch signal in a case that the application type represents that the application program outputs text information of a display interface, the first control strategy comprising one of copying text and pasting text; determine the control strategy as a second control strategy corresponding to the first touch signal in a case that the application type represents that the application program is an application program outputting audio and video data, the second control strategy being used to affect an output state of the audio and video data; determine the control strategy as a third control strategy corresponding to the first touch signal in a case that the application type represents that the application program is an application program displaying image data, the third control strategy being used to affect a display state of the image data.

[0158] In some embodiments, the electronic device has at least a first state and a second state, and the response unit 904 is further configured to output corresponding display information in response to a second touch signal in a case that the electronic device is in the first state, the second touch signal being generated based on a second touch action of the stylus on the electronic device, control the electronic device to be in the second state in response to an input signal of the stylus, and determine target text in the text information of the display interface in response to a third touch signal, the third touch signal being generated based on a third touch action of the stylus on the electronic device.

[0159] In some embodiments, the strategy determination unit 903 is further configured to determine the control strategy as a control strategy for copying text in a case that the first touch signal is a first sub-touch signal, the first sub-touch signal being generated based on a first sliding action of an operating body on the stylus, the sliding direction of the first sliding action being from a tip of the stylus to an end of the stylus, and determine the control strategy as a control strategy for pasting text in a case that the first touch signal is a second sub-touch signal, the second sub-touch signal being generated based on a second sliding action of the operating body on the stylus, the sliding direction of the second sliding action being from the end of the stylus to the tip of the stylus.

[0160] In some embodiments, in a case that the control strategy is the control strategy for pasting text, the response unit 904 is further configured to paste first text based on the first touch signal in a case that a text synchronization function of the stylus is turned on, the first text being obtained based on a third touch signal of the stylus or a copy signal of the electronic device, and paste second text based on the first touch signal in a case that the text synchronization function of the stylus is turned off, the second text being obtained based on a third touch signal of the stylus.

[0161] In some embodiments, in a case where the control policy is a control policy for copying text, the response unit 904 is further configured to, based on the first touch signal, copy the target text, and output an interaction interface; the interaction interface comprises an automatic save control; in a case where the automatic save control represents that an automatic save function of the electronic device is in an open state, save the target text into a text display interface; the text display interface is an interface in the application program different from the display interface, or the text display interface is an interface in another application program different from the application program.

[0162] In some embodiments, the interaction interface further comprises a view control; the control apparatus 900 further comprises a display unit; the display unit is configured to, in response to a triggering operation on the view control, display the target text through the text display interface; wherein the text display interface has at least one of the following characteristics: the interface size of the text display interface is smaller than the interface size of the display interface; in a case where the interface size of the text display interface is smaller than the interface size of the display interface, the text display interface is on the surface of the display interface and at the edge position of the display interface; the transparency of the text display interface is greater than the transparency of the display interface.

[0163] In some embodiments, in a case where the automatic save control represents that the automatic save function of the electronic device is in a closed state, the response unit 904 is further configured to at least one of: in response to a triggering operation on the automatic save control, open the automatic save function; in response to a triggering operation on the application program corresponding to the stylus, display a setting page of the stylus; in response to a triggering operation on a function setting control in the setting page, open the automatic save function; in response to a fourth touch signal, open the automatic save function; the fourth touch signal is generated based on a third sliding action of an operating body on the stylus.

[0164] In some embodiments, in a case where the first touch signal is generated based on a fourth sliding action of an operating body on the stylus, the response unit 904 is further configured to, based on the first touch signal, display a historical data editing interface; the historical data editing interface comprises at least one historical editing data sub-interface; the historical editing data sub-interface is configured to display historical editing data obtained by the operating body performing historical editing operations in the electronic device; the historical editing data comprises at least one of: text data, picture data, and file data; in response to a triggering operation on a target sub-interface in the at least one historical editing data sub-interface, insert the historical editing data in the target sub-interface into a current display interface.

[0165] In some embodiments, the historical data editing interface further comprises a palette interface; the response unit 904 is further configured to, in response to a triggering operation on the palette interface, display a palette editing interface; the palette editing interface comprises an insertion control; and in response to a triggering operation on the insertion control, insert palette data in the palette editing interface into the current display interface.

[0166] The above-described device embodiments are similar to the above-described method embodiments, and have similar beneficial effects. In some embodiments, the device provided by the embodiments of the present application has functions or includes modules that can be used to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application.

[0167] It should be noted that, in the embodiments of the present application, if the above-mentioned data processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods of the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk, and various media that can store program codes. Thus, the embodiments of the present application are not limited to any particular hardware, software or firmware, or any combination of hardware, software and firmware.

[0168] The embodiments of the present application provide a computer device, including a memory and a processor, the memory stores a computer program capable of running on the processor, and the processor implements part or all of the steps of the above method when executing the program.

[0169] The embodiments of the present application provide a computer-readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement part or all of the steps of the above method. The computer-readable storage medium can be transitory or non-transitory.

[0170] The embodiments of the present application provide a computer program, which includes computer-readable code, and when the computer-readable code is running in a computer device, a processor in the computer device executes part or all of the steps of the above method.

[0171] The embodiment of the present application provides a computer program product, the computer program product comprises a non-transitory computer-readable storage medium storing a computer program, and the computer program is read and executed by a computer to implement part or all of the steps in the above method. The computer program product can be specifically implemented by means of hardware, software or combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in some other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (Software Development Kit, SDK) and the like.

[0172] It should be noted that the above description of the various embodiments tends to emphasize the differences between the various embodiments, and the same or similar parts can be referred to each other. The above description of the device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the device, storage medium, computer program and computer program product embodiments of the present application, please refer to the description of the method embodiments of the present application.

[0173] Figure 10 A hardware entity of an electronic device in the embodiment of the present application is shown in FIG. 1, which comprises a processor 1001, a communication interface 1002 and a memory 1003. Figure 10 The hardware entity of the electronic device 1000 comprises a processor 1001, a communication interface 1002 and a memory 1003, wherein:

[0174] The processor 1001 generally controls the overall operation of the electronic device 1000, and the overall operation can be the control method provided by the embodiment of the present application.

[0175] The communication interface 1002 can enable the computer device to communicate with other terminals or servers through a network.

[0176] The memory 1003 is configured to store instructions and applications executable by the processor 1001, and can also cache data to be processed by the processor 1001 and modules in the electronic device 1000 (for example, image data, audio data, voice communication data and video communication data) that have been processed or have been processed, which can be realized by FLASH or RAM. The processor 1001, the communication interface 1002 and the memory 1003 can transmit data through the bus 1004.

[0177] The embodiment of the present application provides a computer storage medium, and the computer storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of the control method of any one of the above embodiments.

[0178] It should be noted that the above description of the storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of the present application, please refer to the description of the method embodiments for understanding.

[0179] The processor can be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, or a microprocessor. It can be understood that the electronic device for implementing the functions of the processor can also be other devices, and the embodiments of the present application are not limited specifically.

[0180] The computer storage medium / memory can be a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Ferromagnetic Random Access Memory (FRAM), a Flash Memory, a magnetic surface memory, an optical disc, a Compact Disc Read-Only Memory (CD-ROM), or the like. It can also be various terminals including one or any combination of the above memories, such as a mobile phone, a computer, a tablet device, a personal digital assistant, and the like.

[0181] It should be understood that the term "one embodiment" or "an embodiment" as used herein means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. Thus, the appearances of the phrase "in one embodiment" or "in an embodiment" in various places throughout the specification are not necessarily referring to the same embodiment. Furthermore, the particular features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the application, the order of the steps / processes can be changed without altering the essence of the application described. The sequence of the steps / processes should be determined by their functions and the inherent logic, and should not constitute any limitation on the implementation of the embodiments of the application. The sequence of the embodiments of the application is only for the purpose of description, and does not represent the advantages or disadvantages of the embodiments.

[0182] It should be noted that, as used in this document, the terms "includes," "including," "has," "having," "contains," "containing," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to only those elements, but can include other elements not expressly listed or inherent to such process, method, article, or apparatus.

[0183] The above merely describes the embodiments of the application, but the protection scope of the application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the application, which should be covered within the protection scope of the application.

Claims

1. A control method applied to an electronic device, the method comprising: receiving a first touch signal sent by a stylus; the first touch signal being generated based on a first touch action of an operating body on the stylus; determining an application type of an application program running in a foreground of the electronic device; determining a control strategy corresponding to the first touch signal based on the application type of the application program; and responding to the first touch signal based on the control strategy; wherein the determining the control strategy corresponding to the first touch signal based on the application type of the application program comprises: in a case where the application type represents that a display interface of the application program outputs text information and the first touch signal is a first sub-touch signal, determining the control strategy as a control strategy for copying text; the first sub-touch signal being generated based on a first sliding action of the operating body on the stylus; a sliding direction of the first sliding action being from a tip of the stylus to an end of the stylus; and in a case where the application type represents that the display interface of the application program outputs text information and the first touch signal is a second sub-touch signal, determining the control strategy as a control strategy for pasting text; the second sub-touch signal being generated based on a second sliding action of the operating body on the stylus; a sliding direction of the second sliding action being from the end of the stylus to the tip of the stylus. 2.The method of claim 1, wherein the determining the control strategy corresponding to the first touch signal based on the application type of the application program further comprises at least one of: the second control strategy being used to affect an output state of the audio / video data; in a case where the application type represents that the application program is an application program for displaying image data, determining the control strategy as a third control strategy corresponding to the first touch signal; and the third control strategy being used to affect a display state of the image data. 3.The method of claim 2, wherein the electronic device has at least a first state and a second state; and the method further comprises: in a case where the electronic device is in the first state, outputting corresponding display information in response to a second touch signal; the second touch signal being generated based on a second touch action of the stylus on the electronic device; in response to an input signal of the stylus, controlling the electronic device to be in the second state; and in response to a third touch signal, determining target text in the text information of the display interface; the third touch signal being generated based on a third touch action of the stylus on the electronic device. 4.The method of claim 1, wherein in a case where the control strategy is the control strategy for pasting text, the responding to the first touch signal based on the control strategy comprises: in a case where a text synchronization function of the stylus is turned on, pasting a first text based on the first touch signal; the first text being obtained based on a third touch signal of the stylus or a copy signal of the electronic device. ​ ​ ​ ​ ​ ​ In a case where the application type characterizes the application program as an application program outputting audio and video data, the control strategy is determined as a second control strategy corresponding to the first touch signal. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ In a case that the text synchronization function of the stylus is turned off, based on the first touch signal, a second text is pasted; the second text is obtained based on a third touch signal of the stylus.

5. The method of claim 1, in a case that the control strategy is a control strategy for copying a text, the responding to the first touch signal based on the control strategy comprises: copying a target text based on the first touch signal, and outputting an interactive interface; the interactive interface comprises an automatic saving control; in a case that the automatic saving control represents that an automatic saving function of the electronic device is in an on state, the target text is saved into a text display interface; wherein the text display interface is an interface in the application program different from the display interface, or the text display interface is an interface in another application program different from the application program.

6. The method of claim 5, the interactive interface further comprises a viewing control; the method further comprises: in response to a triggering operation on the viewing control, displaying the target text through the text display interface; wherein the text display interface has at least one of the following characteristics: the interface size of the text display interface is smaller than the interface size of the display interface; in a case that the interface size of the text display interface is smaller than the interface size of the display interface, the text display interface is on the surface of the display interface and at the edge position of the display interface; the transparency of the text display interface is greater than the transparency of the display interface.

7. The method of claim 5, in a case that the automatic saving control represents that the automatic saving function of the electronic device is in an off state, the method further comprises at least one of the following: in response to a triggering operation on the automatic saving control, the automatic saving function is turned on; in response to a triggering operation on the application program corresponding to the stylus, a setting page of the stylus is displayed; in response to a triggering operation on a function setting control in the setting page, the automatic saving function is turned on; in response to a fourth touch signal, the automatic saving function is turned on; the fourth touch signal is generated based on a third sliding action of an operation body on the stylus.

8. The method of any one of claims 1 to 7, in a case that the first touch signal is generated based on a fourth sliding action of an operation body on the stylus, the responding to the first touch signal based on the control strategy comprises: based on the first touch signal, a historical data editing interface is displayed; the historical data editing interface comprises at least one historical editing data sub-interface; the historical editing data sub-interface is used to display historical editing data obtained by the operation body performing a historical editing operation in the electronic device; the historical editing data comprises at least one of the following: text data, picture data, and file data; in response to a triggering operation on a target sub-interface in the at least one historical editing data sub-interface, the historical editing data in the target sub-interface is inserted into a current display interface.

9. The method of claim 8, the history data editing interface further comprises a palette interface; the method further comprises: in response to a triggering operation on the palette interface, displaying a palette editing interface; the palette editing interface comprises an insert control; in response to a triggering operation on the insert control, inserting palette data in the palette editing interface into the current display interface.

Citation Information

Patent Citations

  • Stylus, touch electronic device and control method

    CN105183191A

  • Touch pen, control method and device of electronic equipment and electronic equipment

    CN112558790A