Interaction method, terminal and readable storage medium based on touch pen
By obtaining and correcting the operation trajectory of the touch pen on the display screen, ensuring that the terminal response matches the user's intention, solving the problem of the terminal's misjudgment of the operation intention, and improving the recognition rate and user experience.
Patent Information
- Application Number
- CN201911289845.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-12-13
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2039-12-13
AI Technical Summary
The terminal is prone to misjudging the user's operating intentions during human-computer interaction, resulting in an incorrect response.
By obtaining the target operation track triggered by the touch pen on the display, we judge whether the preset trigger conditions are met, and correct the operation track according to the similarity to ensure that the response operation matches the user's intention.
It improves the recognition rate of the terminal for the target operation track, reduces error responses, and improves the user experience and terminal security.
Smart Images

Figure CN111007974B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of interactive communication technology, and in particular to an interactive method based on a touch pen, a terminal and a readable storage medium. Background Art
[0002] With the development of screen hardware technology, people can use display technology to draw the target operation track corresponding to the pen gesture on the terminal, which can solve the complicated operation problems in the past and greatly facilitate users. For example, the corresponding target operation track can be drawn on the display screen of a mobile phone to control the functions of the mobile phone accordingly.
[0003] However, some terminal products have a low recognition rate for target operation trajectories, and are prone to making wrong judgments, which in turn causes the terminal products to make wrong responses. Summary of the invention
[0004] The main purpose of the present invention is to provide an interactive method, terminal and readable storage medium based on a touch pen, aiming to solve the technical problem that during the human-computer interaction process, the machine easily misjudges the user's operating intention and makes an erroneous response.
[0005] To achieve the above-mentioned purpose, an embodiment of the present invention provides an interactive method based on a touch pen, which is applied to a terminal, including: obtaining a target operation trajectory triggered by the touch pen on a display screen; judging whether the target operation trajectory meets a preset trigger condition based on the target operation trajectory; if the target operation trajectory meets the preset trigger condition, performing a corresponding response operation based on the target operation trajectory.
[0006] Furthermore, a communication connection is established with the searched touch pen; an identifier of the touch pen is obtained and it is determined whether the identifier of the touch pen exists in a preset permission list; if the identifier of the touch pen exists in the preset permission list, an input window of the target operation trajectory is displayed on the display screen; the step of obtaining the target operation trajectory triggered by the touch pen on the display screen includes: obtaining the target operation trajectory sensed by the touch pen in the input window on the display screen.
[0007] Furthermore, the step of obtaining a target operation trajectory triggered by the touch pen on the display screen includes:
[0008] If it is detected that the touch pen triggers an operation track on the display screen, judging whether the operation track is a valid input according to the current usage scenario or status information of the display screen;
[0009] If the operation trajectory is a valid input, the operation trajectory is determined as the target operation trajectory.
[0010] Furthermore, the current usage scenario includes a game scenario, a video scenario or a driving scenario; or, the status information includes a screen-off status.
[0011] Furthermore, a first motion trajectory triggered by the point where the touch pen contacts the display screen is obtained, and a second motion trajectory triggered by a preset point of the touch pen is simultaneously obtained; based on the first motion trajectory and the second motion trajectory, it is determined whether the first motion trajectory and the second motion trajectory are similar; if similar, the first motion trajectory is used as the target operation trajectory.
[0012] Furthermore, if they are not similar, the first motion trajectory is corrected based on the second motion trajectory so that the similarity between the corrected first motion trajectory and the second motion trajectory is greater than or equal to a preset value; and the corrected first motion trajectory is used as the target operation trajectory.
[0013] Furthermore, if the target operation trajectory meets a preset trigger condition, the specific steps of performing a corresponding operation according to the target operation trajectory include:
[0014] Calculating the similarity between the target operation trajectory and each preset target operation trajectory;
[0015] Comparing the highest similarity with a preset similarity threshold;
[0016] If the highest similarity is greater than or equal to the preset similarity threshold, executing the control instruction corresponding to the highest similarity to be determined as the target control instruction matching the target operation trajectory;
[0017] Perform corresponding response operations according to the target control instruction.
[0018] Furthermore, if the highest similarity is less than the preset similarity threshold, a prompt message is output to prompt the target operation trajectory to be re-entered; if the prompt message is retrieved and output a preset number of times within a preset time length, the target operation trajectory collected by the display screen is shielded.
[0019] The present invention also provides a terminal, which includes: a memory, a processor, and an interactive program stored in the memory and capable of running on the processor, wherein the interactive program implements the steps of the above-mentioned interactive method when executed by the processor.
[0020] The present invention also provides a readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned interaction method are implemented.
[0021] The present invention obtains the target operation track triggered by the touch pen on the display screen through the terminal, and judges whether the target operation track meets the preset trigger condition according to the target operation track. If the target operation track meets the preset trigger condition, the corresponding response operation is performed according to the target operation track. If the target operation track does not meet the preset trigger condition, the target operation track collected by the display screen is shielded. In this way, according to the one-to-one correspondence between the target operation track and the response operation of the terminal, a matching relationship between the user intention and the target operation track is established, so that the terminal can judge the user intention through the target operation track. If the target operation track does not meet the preset trigger condition, the target operation track collected by the display screen is shielded, reducing the interference of the user to the terminal under the wrong operation, and can exclude the target operation track that does not meet the preset trigger condition, and exclude the target operation track that cannot represent the user's intention, thereby improving the terminal's recognition rate of the target operation track, and thus improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0024] Figure 1 It is a schematic diagram of the structure of a terminal running on hardware involved in an embodiment of the present invention;
[0025] Figure 2 It is a flow chart of an embodiment of an interactive method based on a touch pen of the present invention;
[0026] Figure 3 is a schematic diagram of a scene of a display state of a target operation track on a display screen provided by an embodiment of the present invention;
[0027] Figure 4 It is a flowchart of an implementation method before step S10 of a touch pen-based interaction method of the present invention;
[0028] Figure 5 is a schematic diagram of a scenario of wireless communication between a touch pen and a display screen provided by an embodiment of the present invention;
[0029] Figure 6 It is a flow chart of an implementation of an interactive method S30 based on a touch pen according to the present invention.
[0030] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0031] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0032] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present invention, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.
[0033] like Figure 1 As shown, Figure 1 It is a schematic diagram of the structure of a terminal running on hardware involved in an embodiment of the present invention.
[0034] The terminal of the embodiment of the present invention can be a PC, or it can be a smart phone, a tablet computer, an e-book reader, an MP3 (Moving Picture Experts Group Audio Layer III) player, an MP4 (Moving Picture Experts Group Audio Layer IV) player, a portable computer, or other portable terminal devices with display function.
[0035] like Figure 1 As shown, the terminal may include: a processor 1001, such as a CPU, a network interface 1002, a sensor 1003, a user interface 1004, and a memory 1005. The user interface 1004 may include a display screen and other input units. The network interface 1002 may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001. Those skilled in the art will understand that Figure 1 The terminal structure shown in the figure does not constitute a limitation on the terminal, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0036] The user interface 1004 displays information input by the user or information provided to the user. Specifically, it can be used to receive input digital or character information and generate signals for input with the touch pen. Specifically, the input unit may include a touch panel and other input devices. A touch panel, also known as a touch screen, can collect touch operations performed by a user on or near it (for example, operations performed by a user using a finger, a stylus, or any other suitable object or accessory on or near the touch panel, and drive a corresponding connection device according to a pre-set program. A touch panel may include two parts: a touch detection device and a touch controller. The touch detection device detects the touch direction of the user, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact point coordinates, and then sends it to the processor, and can receive and execute commands sent by the processor. In addition, a variety of types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch panel. In addition to the touch panel, the user input unit may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.
[0037] like Figure 1 As shown, the memory 1005 as a readable storage medium may include an operating system and an interactive program.
[0038] exist Figure 1 In the terminal shown, the network interface 1002 is mainly used to connect with the touch pen, and wireless communication or wired communication can be performed with the touch pen; the user interface 1004 is mainly used to interactively communicate with the touch pen; and the processor 1001 can be used to call the interactive program stored in the memory 1005 and perform the following operations:
[0039] Obtain the target operation trajectory triggered by the touch pen on the display screen;
[0040] According to the target operation trajectory, determining whether the target operation trajectory meets a preset trigger condition;
[0041] If the target operation trajectory meets the preset trigger condition, a corresponding response operation is performed according to the target operation trajectory.
[0042] Further, establishing a communication connection with the searched touch pen;
[0043] Obtaining an identifier of the touch pen and determining whether the identifier of the touch pen exists in a preset permission list;
[0044] If the identification of the touch pen exists in the preset permission list, an input window of the target operation track is displayed on the display screen.
[0045] Furthermore, the target operation track sensed by the touch pen in the input window on the display screen is obtained.
[0046] Further, a first motion trajectory triggered by a point where the touch pen contacts the display screen is obtained, and a second motion trajectory triggered by a preset point of the touch pen is simultaneously obtained;
[0047] According to the first motion trajectory and the second motion trajectory, determining whether the first motion trajectory is similar to the second motion trajectory;
[0048] If they are similar, the first motion trajectory is used as the target operation trajectory.
[0049] Further, the processor 1001 may call the interactive program stored in the memory 1005, and further perform the following operations:
[0050] If not, taking the second motion trajectory as a reference, correcting the first motion trajectory so that the similarity between the corrected first motion trajectory and the second motion trajectory is greater than or equal to a preset value;
[0051] The corrected first motion trajectory is used as the target operation trajectory.
[0052] Further, calculating the similarity between the target operation trajectory and each preset target operation trajectory respectively;
[0053] Comparing the highest similarity with a preset similarity threshold;
[0054] If the highest similarity is greater than or equal to the preset similarity threshold, executing the control instruction corresponding to the highest similarity to be determined as the target control instruction matching the target operation trajectory;
[0055] Perform corresponding response operations according to the target control instruction.
[0056] Further, the processor 1001 may call the interactive program stored in the memory 1005, and further perform the following operations:
[0057] If the highest similarity is less than the preset similarity threshold, outputting prompt information prompting the target operation trajectory to be re-entered;
[0058] If the preset number of prompt messages are retrieved and output within the preset time, the target operation track collected by the display screen is shielded.
[0059] Reference Figure 2 , Figure 2 1 is a flow chart of an embodiment of an interactive method based on a touch pen of the present invention, wherein the interactive method based on a touch pen comprises:
[0060] Step S10, obtaining a target operation track triggered by the touch pen on the display screen.
[0061] The terminal can obtain the target operation trajectory triggered by the touch pen on the display screen in real time or at a fixed time. For example, the terminal can be a mobile phone, and the user can input the corresponding target operation trajectory on the display screen of the mobile phone through the touch pen, and the mobile phone can receive the target operation trajectory input by the user at any position on the display screen. Among them, the terminal includes a display screen, such as a capacitive screen, an electromagnetic screen, a pressure-sensitive resistive display screen, an infrared display screen, and a surface acoustic wave display screen, etc., and the display screen is used for a touch pen and other related objects to touch the touch object, and record the target operation trajectory formed by the touched part, and display and record the target operation trajectory. For example, the touch pen can be a capacitive pen, corresponding to the capacitive screen of the terminal. When the capacitive screen senses an object with a charge, the terminal collects the target operation trajectory. The touch pen can also be other pens, which can correspond to the pressure-sensitive resistive display screen of the terminal, and record the target operation trajectory by detecting the change in voltage.
[0062] In some embodiments, the user can set the operation of starting the trigger target operation track on the terminal interface according to their own habits. For example, the user may have to take the subway from 7 to 8 o'clock, and the crowd is crowded. To avoid letting the terminal be in real time to detect the trigger target operation track all the time, the user can choose not to start the operation of triggering the target operation track at 7 or 8 o'clock in the morning. In this way, the trigger target operation track can be set to start according to the user's habit, and the user's misoperation can be avoided, thereby improving the user experience.
[0063] Optionally, the specific step of obtaining a target operation trajectory triggered by the touch pen on the display screen includes:
[0064] Get the target operation trajectory sensed by the touch pen input window on the display screen.
[0065] Step S20: judging whether the target operation trajectory satisfies a preset trigger condition according to the target operation trajectory.
[0066] The terminal determines whether the target operation trajectory meets the preset trigger condition according to the target operation trajectory. The preset trigger condition here can be a preset trigger condition set by the terminal's internal program or the user according to their own needs. Only the target operation trajectory that meets the preset trigger condition can enter the corresponding application. In addition, the preset trigger condition includes but is not limited to the following situations: it can be any pattern, text or number, etc.
[0067] In some embodiments, the preset trigger condition may also include the terminal being associated with other devices, and by inputting any preset pattern, text or number in the terminal, the device associated with the terminal may be triggered to enter the corresponding operation. The device associated with the terminal may be a wireless headset, a watch, a bracelet and other devices. For example, the user sets the wireless headset associated with the terminal to be turned on and off in advance on the terminal setting interface according to his own needs. The target operation track input by the user needs to match the preset operation track "L" in order to enable the headset to enter the power-on and power-off operations.
[0068] Step S30: If the target operation trajectory meets the preset trigger condition, a corresponding response operation is performed according to the target operation trajectory.
[0069] If the target operation trajectory meets the preset trigger condition, the corresponding response operation is performed according to the target operation trajectory. After the terminal determines that the target operation trajectory meets the preset trigger condition, it performs the corresponding response operation according to the target operation trajectory. For example, the user adds the corresponding target operation trajectory of the phone function as "L" on the terminal's setting interface according to his own needs, and the target operation trajectory input by the user on the terminal's display screen with a touch pen is "L". When the terminal determines that the target operation trajectory meets the preset trigger condition, it enters the corresponding phone function according to the target operation trajectory.
[0070] To assist in understanding the technical solution of this embodiment, please refer to Figure 3 ,exist Figure 3 On the left, the target operation trajectory state of the user input on the display screen through the touch pen is displayed. Figure 3 On the right side, the target operation trajectory corresponds to the operation status display of the terminal corresponding to the response.
[0071] For example, the user can set the target operation trajectory in the "Weather" function of the mobile phone to a pattern that meets the aforementioned preset trigger conditions. If the preset trigger condition is "L", the target operation trajectory entered by the user on the display screen of the mobile phone with the touch pen should be "L", then the target operation trajectory "L" enters the page corresponding to the "Weather" function of the mobile phone.
[0072] In this embodiment, the terminal obtains the target operation track triggered by the touch pen on the display screen, and judges whether the target operation track meets the preset trigger condition according to the target operation track. If the target operation track meets the preset trigger condition, the corresponding response operation is performed according to the target operation track. In this way, the function or application on the terminal has a one-to-one correspondence with the target operation track, and a matching relationship between the user intention and the target operation track is established, so that the terminal can judge the user intention through the target operation track, and exclude the target operation track that does not meet the preset trigger condition and excludes the target operation track that cannot represent the user intention. When the target operation track input by the user through the touch pen enters the corresponding application, the probability of being triggered by mistake can be reduced, and the interference of the user to the terminal under the wrong operation can be reduced, thereby improving the user experience.
[0073] Furthermore, if Figure 4 This is a flow chart of an implementation of a touch pen-based interaction method before step S10 of the present application, including:
[0074] Step S11, establishing a communication connection with the searched touch pen;
[0075] The terminal establishes a communication connection with the searched touch pen. Among them, the terminal can send a wireless detection signal through the wireless communication module to search for a touch pen with a unique identifier, and has a one-to-one correspondence with the terminal. The terminal can also be connected to the touch pen by wire and perform wired communication. The terminal has a radio module that can send and receive radio signals, and the radio signal can match the radio signal sent and received by the touch pen. The detection signal can detect the radio signal sent by the touch pen, and the terminal wireless communication module determines the identification of the touch pen based on the detected radio signal. After the terminal wireless communication module establishes a communication connection with the touch pen, it can receive the information sent by the touch pen, and then obtain the identification of the touch pen.
[0076] To assist in understanding the technical solution of this embodiment, please refer to Figure 5 , Figure 5 The terminal communicates wirelessly with the touch pen.
[0077] Step S12, obtaining the identification of the touch pen and determining whether the identification of the touch pen exists in the preset permission list;
[0078] The terminal obtains the identification of the touch pen and determines whether the identification of the touch pen exists in the preset permission list. The touch pen has a unique identification, and the terminal can directly add the identification of the touch pen to the preset permission list, or can wirelessly connect with the touch pen with the unique identification, and the terminal allows the touch pen with the unique identification to enter the preset permission list, and saves the identification of the touch pen in the preset permission list.
[0079] Specifically, according to the obtained stylus identification, combined with the preset permission list stored in the memory, it is determined whether there is permission information of the stylus in the preset permission list, wherein the preset permission list records the identification information of the stylus, etc. The terminal can directly determine whether there is the identification of the stylus in the preset permission list. If the identification of the stylus does not exist in the preset permission list, it means that the stylus has not obtained the authorization authority of the terminal, and then no response is given to the target operation track input by the stylus on the display screen. At the same time, a reminder signal is sent to the user on the display screen of the terminal, and the authorization authority must be obtained first before the terminal can identify the target operation track input by the stylus on the display screen. The user is guided to apply for the operation authority to be obtained according to the process steps in the terminal, and enter the corresponding terminal function interface. If the user of the stylus wants to enter the operation interface of the terminal for illegal purposes, or other stylus accidentally triggers the terminal, it cannot pass normally without obtaining the authority, and it will not be in the preset permission list of the terminal. Thereby, the normal use of the terminal and the security of the user's use of the terminal are also guaranteed.
[0080] Step 13: If the identification of the touch pen exists in the preset permission list, an input window of the target operation track is displayed on the display screen.
[0081] If the identification of the touch pen exists in the preset permission list, the input window of the target operation track is displayed on the display screen. According to the obtained identification of the touch pen, the terminal combines the preset permission list stored in the memory to determine whether there is permission information of the touch pen in the preset permission list, wherein the preset permission list records the identification of the touch pen. If the identification of the touch pen exists in the preset permission list, it means that the touch pen has obtained the authorization permission of the terminal, then the input window of the target operation track is pinned to the top, and the user can enter the corresponding target operation track on the display screen to enter the corresponding function or application of the mobile phone.
[0082] This embodiment establishes a communication connection with the searched touch pen, obtains the identification of the touch pen and determines whether the identification of the touch pen exists in the preset permission list. If the identification of the touch pen exists in the preset permission list, the input window of the target operation trajectory is displayed. In this way, the terminal can make a corresponding response to the touch pen with operation permission, establish a one-to-one correspondence between the identification of the touch pen and the terminal, prevent other users from using other touch pens to input the target operation trajectory to the display screen of the terminal, so that the terminal can determine whether it is operated by the user himself through the touch pen with permission, and exclude other touch pens without permission, which can improve the security of the terminal and reduce the probability of other touch pens triggering the terminal by mistake, thereby improving the user experience.
[0083] Furthermore, in step S10 of the first embodiment, the step of obtaining the target operation trajectory triggered by the touch pen on the display screen includes:
[0084] Step S101, if it is detected that the touch pen triggers an operation track on the display screen, then judging whether the operation track is a valid input according to the current usage scenario or state information of the display screen;
[0085] Step S102: if the operation trajectory is a valid input, the operation trajectory is determined as a target operation trajectory.
[0086] If the terminal detects that the touch pen triggers an operation trajectory on the display screen, it determines whether the operation trajectory is a valid input based on the current usage scenario or status information of the display screen. If the operation trajectory is a valid input, the operation trajectory is determined as the target operation trajectory. Among them, the current usage scenario includes a game scenario, a video scenario or a driving scenario, and the status information includes the screen-off status. For example, the terminal detects that the current usage scenario is a game scenario, and an important WeChat push has been received, but the game cannot be launched. At this time, we can enter the operation trajectory corresponding to WeChat on the display screen, and determine that the operation trajectory is a valid input based on the current usage scenario of the display screen as a game scenario.
[0087] In addition, if the current state information of the display screen is detected as the off-screen state, and the touch pen is detected to trigger an operation track on the display screen, the operation track is determined to be a valid input. For example, in the off-screen state, if the target operation track input by the user on the display screen of the terminal with the touch pen is "L", the operation track is determined to be a valid input.
[0088] Furthermore, the step S10 includes:
[0089] Step A, obtaining a first motion trajectory triggered by a point where the touch pen contacts the display screen, and simultaneously obtaining a second motion trajectory triggered by a preset point of the touch pen;
[0090] The terminal obtains the first motion trajectory triggered by the point where the touch pen contacts the display screen, and simultaneously obtains the second motion trajectory triggered by the preset point of the touch pen. The terminal obtains the starting point where the touch pen contacts the display screen as point A, and the target operation trajectory triggered by point A is the first motion trajectory. At the same time, a preset interval is set at a preset distance from point A on the touch pen, and the vertical preset distance from point A on the touch pen is point B, and the motion trajectory formed in the air through point B is the second motion trajectory. The preset interval can be 0.3-2 cm.
[0091] Step B, judging whether the first motion trajectory is similar to the second motion trajectory according to the first motion trajectory and the second motion trajectory;
[0092] The terminal determines whether the first motion trajectory is similar to the second motion trajectory according to the first motion trajectory and the second motion trajectory. The terminal determines the first motion trajectory and the second motion trajectory according to the rectangular area where the acquired second motion trajectory covers the first motion trajectory.
[0093] Specifically, by dividing the display screen with two parallel horizontal lines and vertical lines at equal intervals, the two horizontal lines and vertical lines constitute an operation rectangular area, and when the user inputs the target operation trajectory through the touch pen, the target operation trajectory can be any graphic or character, and the boundary point of the touch pen passes through the horizontal lines and vertical lines, and forms at least one intersection, that is, a series of coordinate points in the plane rectangular coordinate system, and two parallel horizontal lines and vertical lines pass through the boundary points of the target operation trajectory to form a rectangular area. That is, the area size of the rectangular area of the two target operation trajectories is determined.
[0094] Optionally, after the step of determining whether the first motion trajectory and the second motion trajectory are similar according to the first motion trajectory and the second motion trajectory, the method further includes:
[0095] If not, the first motion trajectory is corrected with the second motion trajectory as a reference, so that the similarity between the corrected first motion trajectory and the second motion trajectory is greater than or equal to a preset value;
[0096] The corrected first motion trajectory is used as the target operation trajectory.
[0097] If they are not similar, the first motion trajectory is corrected based on the second motion trajectory so that the similarity between the corrected first motion trajectory and the second motion trajectory is greater than or equal to a preset value. If the first motion trajectory obtained by the terminal covers a rectangular area of the second motion trajectory of less than or equal to 80%, the first motion trajectory is judged to be not similar to the second motion trajectory.
[0098] For example, the user inputs a target operation trajectory of "L" on the display screen through a touch pen. The terminal may only obtain a target operation trajectory of "I", i.e., the first motion trajectory, because the user does not use enough pressure when inputting the target operation trajectory with the touch pen. However, the terminal can also obtain a complete motion trajectory "L" formed by the touch pen in the air, i.e., the second motion trajectory. The first motion trajectory is corrected with the second motion trajectory as a reference, so that the similarity between the corrected first motion trajectory and the second motion trajectory is greater than or equal to the preset value of 80%, and the corrected first motion trajectory is used as the target operation trajectory. Then, based on the target operation trajectory, it is determined whether the target operation trajectory meets the preset trigger condition. If the target operation trajectory meets the preset trigger condition, the corresponding response operation is performed according to the target operation trajectory.
[0099] Step C: if similar, taking the first motion trajectory as the target operation trajectory.
[0100] If the first motion trajectory is similar to the second motion trajectory, the first motion trajectory is used as the target operation trajectory. If the area of the rectangular area of the first motion trajectory covered by the acquired second motion trajectory is greater than or equal to 80%, the terminal determines that the first motion trajectory is similar to the second motion trajectory. According to the target operation trajectory, it is determined whether the target operation trajectory meets the preset trigger condition. If the target operation trajectory meets the preset trigger condition, a corresponding response operation is performed according to the target operation trajectory.
[0101] In this embodiment, the terminal obtains the first motion trajectory triggered by the point where the touch pen contacts the display screen, and simultaneously obtains the second motion trajectory triggered by the preset point of the touch pen, and determines whether the first motion trajectory is similar to the second motion trajectory according to the first motion trajectory and the second motion trajectory. If they are similar, the first motion trajectory is used as the target operation trajectory. In this way, the first motion trajectory can be corrected by the second motion trajectory, and then it is determined whether the corrected first motion trajectory meets the preset trigger condition, thereby improving the recognition rate of the terminal and avoiding the terminal from making corresponding response operations.
[0102] Furthermore, if Figure 6 1 is a flow chart of an embodiment of an interactive method S30 based on a touch pen according to the present invention, wherein step S30 comprises:
[0103] Step S31, calculating the similarity between the target operation trajectory and each preset target operation trajectory;
[0104] The terminal calculates the similarity between the target operation trajectory and each preset target operation trajectory. Among them, the user can set a different preset target operation trajectory for all functions of the terminal. When the user enters the target operation trajectory, the terminal will calculate the similarity between the target operation trajectory entered by the user and each preset target operation trajectory, and enter the corresponding terminal function. In this way, different functions of the terminal are set to different preset target operation trajectories, which can improve the security of the terminal.
[0105] In some embodiments, the similarity between the target operation track and the two preset target operation tracks can also be calculated. For example, the user can set a function with a high frequency of use in the terminal, and it corresponds to the first preset target operation track. The user can also set a function with a low frequency of use in the terminal, which corresponds to the second preset target operation track. When the target operation track input by the user corresponds to the first preset track, the terminal calls at least one corresponding function with a high frequency of use, and displays it on the terminal page for the user to select. Similarly, when the target operation track input by the user corresponds to the second preset track, the terminal calls at least one corresponding function with a high frequency of use, and displays it on the terminal page for the user to select. Among them, the user can add functions to the high frequency of use and the low frequency of use respectively, or the terminal can detect the functions that the user often opens, and calculate the number of times it is opened. If the number of times it is opened is high, the frequency of use is high, and if the number of times it is opened is low. In this way, the amount of calculation of the terminal can be reduced, and the user does not need to remember the preset target operation track of each function, thereby improving the user experience.
[0106] Specifically, by dividing a plurality of horizontal lines and vertical lines at equal intervals on the display screen, a plurality of horizontal lines and vertical lines constitute an operation area, and the user inputs the target operation trajectory through the touch pen. The target operation trajectory can be any graphic or character, and the sliding trajectory of the touch pen will pass through the intersection formed by the horizontal lines and the vertical lines, that is, a series of coordinate points in the plane rectangular coordinate system. Connect the adjacent coordinate points with lines to obtain the target operation trajectory, find the minimum value X1 and the maximum value X2 of the horizontal coordinate among the coordinate points of the target operation trajectory, the minimum value Y1 and the maximum value Y2 in the vertical coordinate, and the area formed by the four coordinate points (X1, Y1), (X2, Y1) (X1, Y2), (X2, Y2) is the area of the target operation trajectory. Among them, the preset target operation trajectory is to use the area formed by the above four points as the area of the target operation trajectory, and the preset target operation trajectory area is stored in the memory. Similarly, the target operation trajectory input by the user on the display screen, the terminal will record the coordinates of each point of the target operation trajectory, and find out that the area formed by the four coordinate points among the coordinate points of the above target operation trajectory is the area of the target operation trajectory input by the user.
[0107] The target operation trajectory is rotated with the geometric center of the target operation trajectory area as the origin. The coordinate points of the target operation trajectory are re-recorded after each rotation of 1°, and the rectangular area formed by the above coordinate points is found as the new target operation trajectory area. The above steps are repeated until the rotation angle reaches 360°. The angle whose length-width ratio of all target operation trajectory areas corresponding to the selection angles of 1° to 360° is closest to the length-width ratio of the preset target operation trajectory area. At this time, there will be two target operation trajectory areas corresponding to the selection angles with length-width ratios closest to the length-width ratio of the preset target operation trajectory.
[0108] According to the length and width of the preset target operation track area actually input, the preset target operation track area corresponding to the two rotation angles is scaled along the X direction and the Y direction respectively to be consistent with the length and width of the preset target operation track area. With the minimum value X1 of the horizontal coordinate and the minimum value Y1 of the vertical coordinate among the coordinate points as the origin, the element and target operation track areas corresponding to the two angles are scaled along the X direction and the Y direction respectively to be consistent with the length and width of the preset target operation track area.
[0109] The scaling ratio of the target operation track actually input is compared with the preset target operation track. According to the length and width of the target operation track actually input, the length and width ratio of the target operation track is scaled to be consistent with the length and width of the preset target operation track.
[0110] Step S32, determining the control instruction corresponding to the highest similarity as the target control instruction matching the target operation trajectory;
[0111] The terminal determines the control instruction corresponding to the highest similarity as the target control instruction matching the target operation trajectory. After calculating the similarity between the target operation trajectory and each preset target operation trajectory, the terminal determines the control instruction corresponding to the highest similarity as the target control instruction matching the target operation trajectory.
[0112] Step S33, performing corresponding response operations according to the target control instruction.
[0113] The terminal performs a corresponding response operation according to the target control instruction. For example, after the mobile phone determines that the target control instruction matches the target operation trajectory, the mobile phone enters the corresponding function according to the target control instruction.
[0114] Furthermore, after step S32, the method further includes:
[0115] Compare the highest similarity with a preset similarity threshold;
[0116] If the highest similarity is greater than or equal to the preset similarity threshold, the control instruction corresponding to the highest similarity is executed and determined as the target control instruction matching the target operation trajectory.
[0117] The terminal compares the highest similarity with the preset similarity threshold. If the highest similarity is greater than or equal to the preset similarity threshold, the control instruction corresponding to the highest similarity is executed and determined as the control instruction that matches the target operation trajectory. Specifically, if the highest similarity is greater than or equal to the preset similarity threshold, the control instruction corresponding to the highest similarity is determined as the target control instruction that matches the target operation trajectory. If the similarity between the target operation trajectory input by the user and the preset target operation trajectory reaches more than 80%, the target control instruction that matches it is determined according to the target operation trajectory, and the corresponding response operation is performed according to the target control instruction.
[0118] Optionally, after the step of comparing the highest similarity with a preset similarity threshold, the method further includes:
[0119] If the highest similarity is less than the preset similarity threshold, a prompt message is outputted to prompt the target operation trajectory to be re-entered;
[0120] If the preset number of prompt messages are retrieved and output within the preset time, the target operation track collected by the display screen is shielded.
[0121] If the highest similarity is less than the preset similarity threshold, the user is prompted to re-enter the target operation trajectory; if the preset number of prompt messages are retrieved and output within the preset time, the target operation trajectory collected by the display screen is shielded. Among them, if the similarity between the target operation trajectory entered by the user and the preset target operation trajectory is less than 80%, the user can be prompted to re-enter the target operation trajectory by voice or light flashing; if the terminal retrieves and outputs prompt messages 3 times within a period of time, the target operation trajectory collected by the display screen is shielded.
[0122] In addition, an embodiment of the present invention further provides a readable storage medium (i.e., a computer readable memory), on which an interactive program is stored. When the interactive program is executed by a processor, the following operations are implemented:
[0123] Get the target operation track triggered by the touch pen on the display screen;
[0124] According to the target operation trajectory, determining whether the target operation trajectory meets a preset trigger condition;
[0125] If the target operation trajectory meets the preset trigger condition, a corresponding response operation is performed according to the target operation trajectory.
[0126] Furthermore, the target operation track sensed by the touch pen in the input window on the display screen is obtained.
[0127] Further, when it is detected that the touch pen triggers an operation track on the display screen, it is determined whether the operation track is a valid input according to the current usage scenario or state information of the display screen;
[0128] If the operation trajectory is a valid input, the operation trajectory is determined as the target operation trajectory.
[0129] Further, a first motion trajectory triggered by a point where the touch pen contacts the display screen is obtained, and a second motion trajectory triggered by a preset point of the touch pen is simultaneously obtained;
[0130] According to the first motion trajectory and the second motion trajectory, determining whether the first motion trajectory is similar to the second motion trajectory;
[0131] If they are similar, the first motion trajectory is used as the target operation trajectory.
[0132] Furthermore, when the interactive program is executed by the processor, the following operations are also implemented:
[0133] If not, taking the second motion trajectory as a reference, correcting the first motion trajectory so that the similarity between the corrected first motion trajectory and the second motion trajectory is greater than or equal to a preset value;
[0134] The corrected first motion trajectory is used as the target operation trajectory.
[0135] Further, establishing a communication connection with the searched touch pen;
[0136] Obtaining an identifier of the touch pen and determining whether the identifier of the touch pen exists in a preset permission list;
[0137] If the identification of the touch pen exists in the preset permission list, an input window of the target operation track is displayed on the display screen.
[0138] Further, calculating the similarity between the target operation trajectory and each preset target operation trajectory respectively;
[0139] Comparing the highest similarity with a preset similarity threshold;
[0140] If the highest similarity is greater than or equal to the preset similarity threshold, executing the control instruction corresponding to the highest similarity to be determined as the target control instruction matching the target operation trajectory;
[0141] Perform corresponding response operations according to the target control instruction.
[0142] Furthermore, when the interactive program is executed by the processor, the following operations are also implemented:
[0143] If the highest similarity is less than the preset similarity threshold, outputting prompt information prompting the target operation trajectory to be re-entered;
[0144] If the preset number of prompt messages are retrieved and output within the preset time, the target operation track collected by the display screen is shielded.
[0145] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.
[0146] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.
[0147] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0148] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are only illustrative and not restrictive. Under the enlightenment of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the purpose of the present invention and the claims, which all fall within the protection of the present invention.
Claims
1. A touch pen-based interaction method, applied to a terminal, characterized in that: include: Get the target operation track triggered by the touch pen on the display screen; According to the target operation trajectory, determining whether the target operation trajectory meets a preset trigger condition; If the target operation trajectory meets the preset trigger condition, a corresponding response operation is performed according to the target operation trajectory; The step of obtaining the target operation trajectory triggered by the touch pen on the display screen includes: Acquire a first motion trajectory triggered by a point where the touch pen contacts the display screen, and simultaneously acquire a second motion trajectory triggered by a preset point on the touch pen, where the preset point refers to a point on the touch pen that is a preset distance away from the point where the touch pen contacts the display screen; According to the first motion trajectory and the second motion trajectory, determining whether the first motion trajectory is similar to the second motion trajectory; If they are similar, taking the first motion trajectory as the target operation trajectory; If not, taking the second motion trajectory as a reference, correcting the first motion trajectory so that the similarity between the corrected first motion trajectory and the second motion trajectory is greater than or equal to a preset value; Using the corrected first motion trajectory as the target operation trajectory; Wherein, the step of determining whether the first motion trajectory is similar to the second motion trajectory comprises: Obtaining rectangular areas corresponding to the first motion trajectory and the second motion trajectory respectively; If it is detected that the ratio of the rectangular area corresponding to the first motion trajectory covering the rectangular area of the second motion trajectory is greater than a preset value, it is determined that the first motion trajectory is similar to the second motion trajectory.
2. The touch pen-based interaction method according to claim 1, characterized in that: Before the step of obtaining the target operation track triggered by the touch pen on the display screen, the method includes: Establishing a communication connection with the searched touch pen; Obtaining an identifier of the touch pen and determining whether the identifier of the touch pen exists in a preset permission list; If the identification of the touch pen exists in the preset permission list, an input window of the target operation track is displayed on the display screen; The step of obtaining the target operation track triggered by the touch pen on the display screen includes: The target operation track sensed by the touch pen in the input window on the display screen is obtained.
3. The touch pen-based interaction method according to claim 1, characterized in that: The step of obtaining the target operation trajectory triggered by the touch pen on the display screen includes: If it is detected that the touch pen triggers an operation track on the display screen, judging whether the operation track is a valid input according to the current usage scenario or status information of the display screen; If the operation trajectory is a valid input, the operation trajectory is determined as the target operation trajectory.
4. The touch pen-based interaction method according to claim 3, characterized in that: The current usage scenario includes a game scenario, a video scenario, or a driving scenario; or, the status information includes a screen-off status.
5. The touch pen-based interaction method according to claim 1, characterized in that: If the target operation trajectory meets the preset trigger condition, the specific steps of performing a corresponding operation according to the target operation trajectory include: Calculating the similarity between the target operation trajectory and each preset target operation trajectory; Comparing the highest similarity among the similarities with a preset similarity threshold; If the highest similarity is greater than or equal to the preset similarity threshold, the control instruction corresponding to the highest similarity is executed and determined as the target control instruction matching the target operation trajectory; Perform corresponding response operations according to the target control instruction.
6. The touch pen-based interaction method according to claim 5, characterized in that: After the step of comparing the highest similarity among the similarities with a preset similarity threshold, the method further comprises: If the highest similarity is less than the preset similarity threshold, outputting prompt information prompting the target operation trajectory to be re-entered; If the preset number of prompt messages are retrieved and output within the preset time, the target operation track collected by the display screen is shielded.
7. A terminal, characterized in that: The terminal comprises: a memory, a processor, and an interactive program stored in the memory and executable on the processor, wherein the interactive program implements the steps of the interactive method according to any one of claims 1 to 6 when executed by the processor.
8. A readable storage medium, characterized in that: The readable storage medium stores an interactive program, and when the interactive program is executed by a processor, the steps of the interactive method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Method for inputting control command by touch induction keyboard and mobile terminal
CN101334705A
Touch screen coordinate calibration device
CN102541321A
Method and device for quickly viewing information
CN104020958A
Starting method and system for application program
CN104951343A
Operation control method and device for target object
CN107678652A
