Touch operation recognition method and device, electronic device, and storage medium

Abstract

The application relates to a touch operation recognition method and device, electronic equipment, a storage medium and a computer program product. The method comprises the following steps: in response to a touch operation on a touch screen, collecting touch sensing quantities and position information of sensing points of at least one frame of sensing signals; determining at least two to-be-confirmed touch points from the sensing points according to a first preset touch sensing quantity and the touch sensing quantities; if there is a sensing point smaller than a second preset touch sensing quantity on a travel route of the at least two to-be-confirmed touch points, determining that the touch operation is a non-pressing operation; and the second preset touch sensing quantity is greater than the first preset touch sensing quantity. According to the method, the touch mode of the touch operation can be recognized according to the continuity of the touch between the two to-be-confirmed touch points, and the accuracy of the touch operation recognition is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of touch control, and in particular to a touch operation recognition method and device, electronic equipment, computer storage medium and computer program product. BACKGROUND

[0002] With the development of science and technology, touch screen recognition has become one of the interaction methods of various electronic devices, and users can operate the touch screen of an electronic device with their fingers to control the electronic device, which is very convenient and fast. Therefore, it is very important to recognize the operation on the touch screen of an electronic device.

[0003] When an electronic device is in use, it is easy to produce a conflict phenomenon between a large finger pressing and fast line drawing, and it is easy to produce a misoperation. In the prior art, a touch sensing amount average value method is used to recognize a touch operation, which results in low accuracy of recognizing the touch operation. SUMMARY

[0004] Therefore, it is necessary to provide a touch operation recognition method, device, electronic equipment, computer readable storage medium and computer program product capable of improving the accuracy of recognizing a touch operation.

[0005] In a first aspect, the present application provides a touch operation recognition method. The method comprises:

[0006] In response to a touch operation on a touch screen, collecting touch sensing amounts and position information of sensing points of at least one frame of sensing signals;

[0007] According to a first preset touch sensing amount and the touch sensing amounts, determining at least two to-be-confirmed touch points from the sensing points; if there is a sensing point smaller than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points, determining that the touch operation is a non-pressing operation; wherein the second preset touch sensing amount is greater than the first preset touch sensing amount.

[0008] In one of the embodiments, before the step of determining that the touch operation is a non-pressing operation if there is a sensing point smaller than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points, the method further comprises:

[0009] According to a relative direction between any two to-be-confirmed touch points of the at least two to-be-confirmed touch points;

[0010] According to the relative direction between any two to-be-confirmed touch points, determining a travel route from one to-be-confirmed touch point to another to-be-confirmed touch point.

[0011] In one of the embodiments, the determining of the travel route between the two to-be-confirmed touch points according to the relative direction between the two to-be-confirmed touch points comprises:

[0012] taking one of the two to-be-confirmed touch points as a starting point and the other to-be-confirmed touch point as an ending point;

[0013] starting from the starting point and taking the starting point as a current travel point, taking the touch sensing point adjacent to the current travel point in the relative direction and having the maximum touch sensing value as a next travel point on the travel route, and updating the next travel point as the current travel point until the ending point is reached, thereby obtaining the travel route between the two to-be-confirmed touch points.

[0014] In one of the embodiments, the non-pressing operation comprises a non-drawing operation, and the determining of the touch operation as the non-pressing operation according to the travel route of the at least two to-be-confirmed touch points comprises:

[0015] the determining of the at least two to-be-confirmed touch points as not needing to be merged according to the travel route of the at least two to-be-confirmed touch points in the current frame of the at least one frame of sensing signals and the touch sensing value of the sensing point being less than the second preset touch sensing value;

[0016] detecting whether the at least two to-be-confirmed touch points in the continuous multiple frames of sensing signals need to be merged, and determining the touch operation as the non-drawing operation if it is determined that the at least two to-be-confirmed touch points in the continuous multiple frames of sensing signals do not need to be merged.

[0017] In one of the embodiments, the non-pressing operation comprises a drawing operation, and the method further comprises:

[0018] the determining of the touch operation as the drawing operation if it is determined that the at least two to-be-confirmed touch points in the continuous multiple frames of sensing signals need to be merged in one frame of sensing signals.

[0019] In one of the embodiments, the method further comprises:

[0020] the determining of the touch operation as the pressing operation according to the travel route of the at least two to-be-confirmed touch points and the absence of the sensing point having a touch sensing value less than the second preset touch sensing value.

[0021] In a second aspect, the application further provides a touch operation recognition device. The device comprises:

[0022] a collection module configured to collect touch sensing values and position information of sensing points in at least one frame of sensing signals in response to a touch operation on a touch screen;

[0023] determining at least two to-be-confirmed touch points from the sensing points according to the first preset touch sensing amount and the touch sensing amounts of the sensing points;

[0024] determining that the touch operation is a non-pressing operation if there is a sensing point smaller than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points, wherein the second preset touch sensing amount is greater than the first preset touch sensing amount.

[0025] In a third aspect, the present application provides an electronic device. The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0026] collecting touch sensing amounts and position information of sensing points of at least one frame of sensing signals in response to a touch operation on the touch screen;

[0027] determining at least two to-be-confirmed touch points from the sensing points according to the first preset touch sensing amount and the touch sensing amounts of the sensing points;

[0028] determining that the touch operation is a non-pressing operation if there is a sensing point smaller than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points, wherein the second preset touch sensing amount is greater than the first preset touch sensing amount.

[0029] In a fourth aspect, the present application provides a computer readable storage medium. The computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the following steps:

[0030] collecting touch sensing amounts and position information of sensing points of at least one frame of sensing signals in response to a touch operation on the touch screen;

[0031] determining at least two to-be-confirmed touch points from the sensing points according to the first preset touch sensing amount and the touch sensing amounts of the sensing points;

[0032] determining that the touch operation is a non-pressing operation if there is a sensing point smaller than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points, wherein the second preset touch sensing amount is greater than the first preset touch sensing amount.

[0033] In a fifth aspect, the present application provides a computer program product. The computer program product comprises a computer program, and the computer program is executed by a processor to implement the following steps:

[0034] In response to the touch operation on the touch screen, touch sensing amounts and position information of sensing points in at least one frame of sensing signals are collected;

[0035] According to the first preset touch sensing amount and the touch sensing amounts, at least two to-be-confirmed touch points are determined from the sensing points;

[0036] If there is a sensing point less than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points, the touch operation is determined as a non-pressing operation; the second preset touch sensing amount is greater than the first preset touch sensing amount.

[0037] The touch operation recognition method, device, electronic equipment, storage medium and computer program product, by responding to the touch operation on the touch screen, collecting touch sensing amounts and position information of sensing points in at least one frame of sensing signals, determining at least two to-be-confirmed touch points from the sensing points according to the first preset touch sensing amount and the touch sensing amounts, and determining the touch operation as a non-pressing operation if there is a sensing point less than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points. According to the at least two to-be-confirmed touch points matched with the at least one frame of sensing signals, if there is a sensing point less than a second preset touch sensing amount on a travel route, it indicates that there is a sensing point with small sensing amount between the at least two to-be-confirmed touch points, and the two to-be-confirmed touch points are discontinuous and independent. The method identifies the touch operation mode according to the continuity of the touch operation between the two to-be-confirmed touch points, and improves the accuracy of touch operation recognition. BRIEF DESCRIPTION OF DRAWINGS

[0038] Figure 1 A flowchart of a touch operation recognition method in an embodiment;

[0039] Figure 2 A flowchart of a method for determining a travel route of a to-be-confirmed touch point in an embodiment;

[0040] Figure 3 A schematic diagram of a direction between to-be-confirmed touch points in an embodiment;

[0041] Figure 4 A schematic diagram of a touch sensing amount of a sensing point in an embodiment;

[0042] Figure 5 A schematic diagram of a touch sensing amount of a sensing point in another embodiment;

[0043] Figure 6 A flowchart of a touch operation recognition method in another embodiment;

[0044] Figure 7aA diagram of touch sensing amounts of sensing points of a first frame of sensing signals in an embodiment;

[0045] Figure 7b A diagram of touch sensing amounts of sensing points of a second frame of sensing signals in an embodiment;

[0046] Figure 8 A structure block diagram of a touch operation recognition device in an embodiment;

[0047] Figure 9 An internal structure diagram of an electronic device in an embodiment. DETAILED DESCRIPTION

[0048] In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application.

[0049] It can be understood that "first" and "second" in the present application are only used to distinguish different objects and are not specifically limited. For example, "first preset touch sensing amount" and "second preset touch sensing amount" are used to distinguish different preset touch sensing amounts. "First preset touch sensing amount" can also be written as "second preset touch sensing amount", and "second preset touch sensing amount" can also be written as "first preset touch sensing amount".

[0050] In an embodiment, as shown in Figure 1 A touch operation recognition method is provided, and the embodiment is exemplified by the method applied to a terminal. It can be understood that the method can also be applied to a server, and can also be applied to a system including a terminal and a server and realized through interaction of the terminal and the server. In the embodiment, the method includes the following steps.

[0051] In step 102, in response to a touch operation on a touch screen, touch sensing amounts and position information of sensing points of at least one frame of sensing signals are collected.

[0052] The touch operation includes a pressing operation and a non-pressing operation. The pressing operation can be a finger pressing operation (for example, a large finger pressing operation). The non-pressing operation includes a line drawing operation and a non-line drawing operation. The non-line drawing operation includes a single finger touch operation, a two-finger touch operation or a multi-finger touch operation. Further, for different terminals, different types of touch operations are used to realize different functions. For example, the terminal is an electronic device. In an image viewing scenario, a two-finger touch operation can be used to zoom in or out for viewing an image. In a game scenario, a line drawing operation can be used to split a game object. The position information includes position coordinates (x-axis coordinates and y-axis coordinates) of the sensing points.

[0053] The terminal has a sensing amount reference value on the sensing point of the touch screen, and each sensing point has a maximum touch sensing amount. The touch sensing amount of each sensing point in the present example can be the difference between the actual touch sensing amount of each sensing point and the sensing amount reference value. The touch sensing amount of each sensing point has a sensing amount duration. The acquisition frequency of the terminal is predetermined, and multiple frames of sensing signals can be acquired within the sensing amount duration of the touch sensing amount of each sensing point.

[0054] Specifically, the terminal scans the touch sensing amount of each sensing point on the touch screen in response to the touch operation on the touch screen, determines the acquisition area according to the touch sensing amount of each sensing point on the touch screen, and acquires the touch sensing amount and position information of each sensing point matched in each frame of sensing signal in at least one frame of sensing signal in the acquisition area. Wherein, the determination of the acquisition area can be determined according to the touch sensing amount of the sensing point in a certain area being greater than the touch sensing amount of the surrounding sensing points. The position information is the relative position information between the sensing points.

[0055] Step 104, determining at least two to-be-confirmed touch points from the sensing points according to the first preset touch sensing amount and the touch sensing amount.

[0056] Wherein, the first preset touch sensing amount is a first coefficient times of the maximum touch sensing amount of the sensing point, and the first coefficient is a percentage, which can be 30% or 40%. The to-be-confirmed touch point can be two or more, and the present example is described with two to-be-confirmed touch points.

[0057] Specifically, in response to the touch operation on the touch screen, the touch sensing amount and position information of each sensing point of the current frame of sensing signal are acquired, and the sensing points with touch sensing amount greater than the first preset touch sensing amount are determined from the sensing points according to the first preset touch sensing amount and the touch sensing amount, obtaining two to-be-confirmed touch points. When there are two to-be-confirmed touch points or multiple to-be-confirmed touch points, these to-be-confirmed touch points need to be confirmed, whether these to-be-confirmed touch points can be merged or need to be split, and the touch type of the touch operation is further determined. If the to-be-confirmed touch point is one, the to-be-confirmed touch point is the touch point, and the corresponding touch operation is the fast line drawing operation, and the touch operation does not need to be identified.

[0058] Step 106, if there is a sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points, determining that the touch operation is a non-pressing operation.

[0059] The second preset touch sensing amount is greater than the first preset touch sensing amount, and the second preset touch sensing amount is a second coefficient times of the maximum touch sensing amount of the sensing point. The second coefficient is a percentage, and the second coefficient can be but is not limited to 50%. The travel route is determined according to the two to-be-confirmed touch points, that is, the relative direction between the two to-be-confirmed touch points is determined, and the travel route between one of the two to-be-confirmed touch points and the other to-be-confirmed touch point is determined according to the relative direction between the two to-be-confirmed touch points. The following is a method for determining the travel route of the to-be-confirmed touch point, as shown in Figure 2 The method comprises the following steps:

[0060] Step 202, determining the relative direction between any two to-be-confirmed touch points in the at least two to-be-confirmed touch points.

[0061] The relative direction is determined according to the position information of the two to-be-confirmed touch points, that is, the azimuth angle between the two to-be-confirmed touch points is calculated according to the position information. The azimuth angle between two points can be calculated according to the position coordinates, which can be determined by the prior art, and will not be described here. For example, as shown in Figure 3 The to-be-confirmed touch point A and the to-be-confirmed touch point B, according to the position coordinates of the to-be-confirmed touch point A and the to-be-confirmed touch point B, the azimuth angle of the to-be-confirmed touch point B relative to the to-be-confirmed touch point A can be determined.

[0062] Further, when determining the relative direction between the to-be-confirmed touch points, the reference point can be determined according to the touch sensing amount of the to-be-confirmed touch point. The to-be-confirmed touch point with the maximum or minimum touch sensing amount can be taken as the reference point, and the other to-be-confirmed touch point is equivalent to the direction of the reference point.

[0063] Specifically, determining any two to-be-confirmed touch points in the at least two to-be-confirmed touch points can obtain at least one group of two to-be-confirmed touch points, and the relative direction between any two to-be-confirmed touch points is determined.

[0064] Step 204, taking one of the two to-be-confirmed touch points as a starting point and the other to-be-confirmed touch point as an ending point.

[0065] The starting point and the ending point on the travel route are determined according to the touch sensing amount of the to-be-confirmed touch point. The to-be-confirmed touch point with the minimum touch sensing amount can be confirmed as the starting point, and the to-be-confirmed touch point with the maximum touch sensing amount can be confirmed as the ending point. The to-be-confirmed touch point with the minimum touch sensing amount can also be confirmed as the ending point, and the to-be-confirmed touch point with the maximum touch sensing amount can be confirmed as the starting point. In this embodiment, the to-be-confirmed touch point with the minimum touch sensing amount is taken as the starting point, and the to-be-confirmed touch point with the maximum touch sensing amount is taken as the ending point.

[0066] Step 206: Starting from the starting point, take the starting point as the current travel point, and take the sensor point with the largest touch sensing amount adjacent to the current travel point in the opposite direction as the next travel point on the travel route.

[0067] Step 208: Update the next line of travel point to the current line of travel point until the destination is reached, and obtain the travel route between any two touch points to be confirmed.

[0068] Specifically, the starting point is determined by identifying the touch point with the lowest touch sensitivity, and the ending point is determined by identifying the touch point with the highest touch sensitivity. Starting from the starting point, the starting point is used as the current travel point on the path. The next travel point on the path is the adjacent touch point with the highest touch sensitivity in the opposite direction. The current travel point is updated based on the next travel point until the ending point is reached, thus obtaining the travel path between any two touch points to be confirmed. The touch sensitivity of each touch point is greater than, equal to, or less than a second preset touch sensitivity.

[0069] For example, such as Figure 4 The diagram shows the touch sensing values ​​of each sensing point in a frame of sensing signal in one embodiment. The sensing signal includes multiple sensing points and two touch points to be confirmed. The touch sensing value of touch point 1 to be confirmed is 895, and the touch sensing value of touch point 2 to be confirmed is 930. Touch point 1 to be confirmed is the starting point, and touch point 2 to be confirmed is the ending point. Touch point 2 to be confirmed is located northeast of touch point 1 to be confirmed. Taking the starting point as the current travel point on the travel path, sensing points with touch sensing values ​​of 832 and 870 adjacent to touch point 1 to be confirmed are obtained in the opposite direction. The sensing point with touch sensing value of 870 is taken as the next travel point. The current travel point is updated according to the next travel point, and sensing points with touch sensing values ​​of 816, 789, 838, and 887 are obtained until touch point 2 to be confirmed is reached, thus obtaining the travel path.

[0070] In the above method for determining the travel path, the relative direction between any two touch points to be confirmed is determined. One of the touch points to be confirmed is taken as the starting point, and the other as the ending point. Starting from the starting point, the current travel point is designated. The touch point with the highest touch sensitivity adjacent to the current travel point in the relative direction is taken as the next travel point on the travel path. The next travel point is then updated to the current travel point, and this process continues until the ending point is reached, thus obtaining the travel path between any two touch points to be confirmed. By filtering the touch sensitivity of the touch points in the relative direction, the next travel point is determined, and the accuracy of the travel path is improved by combining the directional characteristics of touch operations.

[0071] Specifically, by determining the relative direction between any two of the two to-be-confirmed touch points, taking one of the any two to-be-confirmed touch points as a starting point and the other as an ending point, starting from the starting point and taking the starting point as a current travel point, taking the touch sensing point adjacent to the current travel point in the relative direction and having the largest touch sensing value as a next travel point on a travel route, and updating the next travel point as the current travel point until the ending point is reached, a travel route between the any two to-be-confirmed touch points is obtained. If there is a touch sensing point on the travel route that is less than the second preset touch sensing value, it indicates that the two to-be-confirmed touch points are two discontinuous points and need to be split, and the touch operation is determined to be a non-pressing operation.

[0072] For example, Figure 4 In the example shown in FIG. 6, the touch sensing value of the to-be-confirmed touch point 1 is 895, the touch sensing value of the to-be-confirmed touch point 2 is 930, the to-be-confirmed touch point 1 is the starting point, the to-be-confirmed touch point 2 is the ending point, the to-be-confirmed touch point 2 is in the northeast direction of the to-be-confirmed touch point 1, the starting point is taken as the current travel point on the travel route, and the touch sensing points adjacent to the to-be-confirmed touch point 1 in the relative direction and having the touch sensing values of 832 and 870 are obtained. The touch sensing point having the touch sensing value of 870 is taken as the next travel point, the next travel point is updated as the current travel point, touch sensing points having the touch sensing values of 816, 789, 838 and 887 are obtained, and the travel route is obtained until the to-be-confirmed touch point 2 is reached. There is no touch sensing point on the travel route that is less than the second preset touch sensing value, the to-be-confirmed touch point 2 having the touch sensing value of 930 is determined to be the touch point, and the touch operation is determined to be a large finger or large palm pressing touch operation.

[0073] As Figure 5 shown in FIG. 6, it is a schematic diagram of touch sensing values of sensing points in a frame of sensing signals in an embodiment, the sensing signals include a plurality of sensing points and two to-be-confirmed touch points, the touch sensing value of the to-be-confirmed touch point 1 is 1129, the touch sensing value of the to-be-confirmed touch point 2 is 1289, the to-be-confirmed touch point 1 is the starting point, the to-be-confirmed touch point 2 is the ending point, the to-be-confirmed touch point 2 is in the northeast direction of the to-be-confirmed touch point 1, the starting point is taken as the current travel point on the travel route, the touch sensing points adjacent to the to-be-confirmed touch point 1 in the relative direction and having the touch sensing values of 941 and 871 are obtained, the touch sensing point having the touch sensing value of 941 is taken as the next travel point, the next travel point is updated as the current travel point, a touch sensing point having the touch sensing value of 214 is obtained, the touch sensing point having the touch sensing value of 214 is less than the second preset touch sensing value, that is, there is a touch sensing point on the travel route that is less than the second preset touch sensing value, the to-be-confirmed touch point 2 cannot be reached, the to-be-confirmed touch point 1 and the to-be-confirmed touch point 2 need to be split to obtain two different touch points, and the touch operation is determined to be a two-finger operation.

[0074] In the method for recognizing the touch operation, in response to the touch operation on the touch screen, the touch sensing amount and position information of each sensing point in at least one frame of sensing signal are collected; at least two to-be-confirmed touch points are determined from the sensing points according to the first preset touch sensing amount and each touch sensing amount; and if there is a sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points, the touch operation is determined as a non-pressing operation. The fact that there is a sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points, which are matched with each other in the at least one frame of sensing signal, indicates that there is a sensing point with small sensing amount between the at least two to-be-confirmed touch points, and thus the two to-be-confirmed touch points are discontinuous and are two independent touch points. The method for recognizing the touch operation according to the continuity of the touch operation between the two to-be-confirmed touch points improves the accuracy of the touch operation recognition.

[0075] In another embodiment, as shown in Figure 6 a method for recognizing a touch operation is provided. The method is applied to a terminal in this embodiment, and it can be understood that the method can also be applied to a server, and can also be applied to a system including a terminal and a server and implemented through the interaction of the terminal and the server. The method includes the following steps:

[0076] In step 602, in response to the touch operation on the touch screen, the touch sensing amount and position information of each sensing point in at least one frame of sensing signal are collected.

[0077] Specifically, in response to the touch operation on the touch screen, the terminal collects the touch sensing amount and position information of each sensing point in at least one frame of sensing signal, that is, the touch sensing amount and position information of each sensing point matched with each frame of sensing signal are continuously collected. In the process of recognizing the touch operation, one frame of sensing signal is taken as a unit for processing. For example, in response to the touch operation on the touch screen, the terminal collects the touch sensing amount and position information of each sensing point in 5 frames of sensing signal. In this embodiment, the continuous collection of multiple frames of sensing signal is taken as an example for illustration.

[0078] In step 604, at least two to-be-confirmed touch points are determined from the sensing points according to the first preset touch sensing amount and each touch sensing amount.

[0079] In this embodiment, two to-be-confirmed touch points are taken as an example for illustration, and when there are more than three to-be-confirmed touch points, at least one group of two to-be-confirmed touch points is obtained by taking any two to-be-confirmed touch points as a group. The method for recognizing the touch operation is the same.

[0080] Step 606, judging whether there is a sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points. If yes, step 608 is executed; otherwise, step 618 is executed.

[0081] Specifically, by determining the relative direction between any two of the two to-be-confirmed touch points in the current frame (the current frame can be the first frame in the continuous multiple frames), taking one of the two to-be-confirmed touch points as a starting point and the other to-be-confirmed touch point as an ending point, starting from the starting point, taking the starting point as a current travel point, taking the sensing point adjacent to the current travel point in the relative direction and having the maximum touch sensing amount as a next travel point on the travel route, and updating the next travel point as the current travel point until the ending point is reached, the travel route between any two of the two to-be-confirmed touch points is obtained, and it is judged whether there is a sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points.

[0082] Step 608, if there is a sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points according to the current frame sensing signal of the at least one frame sensing signal, it is determined that the at least two to-be-confirmed touch points do not need to be merged.

[0083] Specifically, according to the sensing point less than the second preset touch sensing amount on the travel route of the two to-be-confirmed touch points in the current frame sensing signal of the at least one frame sensing signal, an identification result that the two to-be-confirmed touch points do not need to be merged is obtained, the identification result is counted, and the identification results of the continuous multiple frame sensing signals are verified. It can be understood that, in a normal case, the results of the to-be-confirmed touch points needing to be merged or split in the continuous multiple frame sensing signals are the same, in order to improve the identification accuracy of the touch operation, whether the identification results of the to-be-confirmed touch points in the continuous multiple frame sensing signals are the same is detected on the basis of the identification result of the current frame sensing signal. According to the sensing point less than the second preset touch sensing amount on the travel route of the two to-be-confirmed touch points, it is determined that the two to-be-confirmed touch points do not need to be merged, that is, it is determined that the touch operation can be a two-finger touch operation, in order to ensure the accuracy of the touch operation identification, the touch sensing amounts of the sensing points in the continuous multiple frame sensing signals are continuously acquired for identification. Further, the touch sensing amounts of different touch operations last for different durations, that is, the frame numbers of the continuous sensing signals collected are different. For example, the touch sensing amount of the sensing signal of the fast line drawing lasts for 3 frames at most.

[0084] Step 610, judging whether the at least two to-be-confirmed touch points matched with the continuous multiple frame sensing signals respectively need to be merged. If yes, step 612 is executed; otherwise, step 616 is executed.

[0085] Step 612: If it is determined that at least two touch points to be confirmed that match each of the multiple consecutive frames of sensing signals do not need to be merged, the touch operation is determined to be a non-scribing operation.

[0086] Non-swiping operations include two-finger touch operations and multi-finger touch operations.

[0087] Specifically, if it is determined that at least two touch points to be confirmed that match in each of multiple consecutive frames of sensing signals do not need to be merged, the touch operation is determined to be a non-swiping operation. Further, if it is determined that two touch points to be confirmed that match in each of multiple consecutive frames of sensing signals do not need to be merged, the touch operation is determined to be a two-finger touch operation; if it is determined that three touch points to be confirmed that match in each of multiple consecutive frames of sensing signals do not need to be merged, the touch operation is determined to be a three-finger touch operation.

[0088] Step 614: If it is determined that among the at least two touch points to be confirmed that match each of the multiple consecutive frames of sensing signals, at least one frame of sensing signals has at least two touch points to be confirmed that need to be merged, the touch operation is determined to be a line drawing operation.

[0089] Specifically, if there is a sensing point less than the second preset touch sensing amount on the travel path of the two touch points to be confirmed in the current frame sensing signal, it is determined that at least two touch points to be confirmed do not need to be merged. If there are two touch points to be confirmed in one frame of sensing signals that need to be merged or at least two touch points to be confirmed in multiple frames of sensing signals that need to be merged, the touch operation is determined to be a line drawing operation.

[0090] Optionally, in one embodiment, if there are sensing points smaller than a second preset touch sensing value on the travel path of at least two touch points to be confirmed in the current frame sensing signal, it is determined that at least two touch points to be confirmed do not need to be merged; if only one touch point exists in the second frame sensing signal or multiple frames of sensing signals, the touch operation is determined to be a line drawing operation. For example, if the touch operation is a fast line drawing operation, the touch sensing value of each sensing point in the collected first frame sensing signal is as follows: Figure 7a As shown, the touch sensing data at each sensing point of the second frame of the sensor signal is as follows: Figure 7b As shown. According to Figure 7a The first frame of sensing signal shown, based on the first preset touch sensing amount and the touch sensing amount of each sensing point in the first frame of sensing signal, determines at least two touch points to be confirmed (touch sensing amounts of 911 and 812) from each sensing point; based on the fact that there are sensing points (touch sensing amount of 34) less than the second preset touch sensing amount on the travel path of at least two touch points to be confirmed, it is determined that the touch points to be confirmed with touch sensing amounts of 911 and 812 are discontinuous and need to be split. Figure 7bThe second frame sensing signal is shown, and according to the first preset touch sensing amount and the touch sensing amount of each sensing point of the first frame sensing signal, one to-be-confirmed touch point (touch sensing amount is 1026) is determined from each sensing point. The results of the two frame sensing signals are different, and the continuous multiple frame sensing signals need to be identified.

[0091] In step 616, if there is no sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points, it is determined that the touch operation is a pressing operation.

[0092] It can be understood that the line drawing operation generally has only one touch point. The touch sensing amount of the pressing operation (such as a large finger or a large palm pressing) is relatively uniform, and the difference between the touch sensing amounts of the sensing points is relatively uniform.

[0093] In the above-mentioned touch operation identification method, by responding to the touch operation on the touch screen, the touch sensing amount and position information of each sensing point of the continuous multiple frame sensing signals are collected; according to the first preset touch sensing amount and each touch sensing amount, at least two to-be-confirmed touch points are determined from each sensing point; if there is a sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points, it is determined that the touch operation is a non-pressing operation, and if there is no sensing point less than the second preset touch sensing amount on the travel route of the at least two to-be-confirmed touch points, it is determined that the touch operation is a pressing operation, and the touch operation is confirmed according to the continuous multiple frame sensing signals. According to the at least two to-be-confirmed touch points matched with each other in the at least one frame sensing signal, it is detected that there is a sensing point less than the second preset touch sensing amount on the travel route, which indicates that there is a sensing point with small sensing amount between the at least two to-be-confirmed touch points, and the two to-be-confirmed touch points are discontinuous and are two independent touch points. According to the continuity of the touch operation between the two to-be-confirmed touch points, the touch mode of the touch operation is identified, and the touch operation is confirmed according to the continuous multiple frame sensing signals, thereby improving the accuracy of the touch operation identification.

[0094] It should be understood that, although each step in the flowchart involved in each of the above-mentioned embodiments is displayed in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise stated herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart involved in each of the above-mentioned embodiments can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with at least part of other steps or steps or stages in other steps.

[0095] Based on the same inventive concept, the embodiments of the present application also provide a touch operation recognition device for implementing the touch operation recognition method described above. The solution provided by the device is similar to the solution described in the method, so the specific limitations in one or more touch operation recognition device embodiments provided below can refer to the limitations of the touch operation recognition method described above, which will not be described here again.

[0096] In one embodiment, as shown in Figure 8 A touch operation recognition device is provided, comprising: a collection module 802, a touch point determination module 804, and a touch point processing module 806, wherein:

[0097] The collection module 802 is configured to collect touch sensing quantities and position information of sensing points of at least one frame of sensing signals in response to a touch operation on a touch screen.

[0098] The touch point determination module 804 is configured to determine at least two to-be-confirmed touch points from the sensing points according to a first preset touch sensing quantity and the touch sensing quantities.

[0099] The touch point processing module 806 is configured to determine that the touch operation is a non-pressing operation if there is a sensing point smaller than a second preset touch sensing quantity on a travel route of the at least two to-be-confirmed touch points, wherein the second preset touch sensing quantity is greater than the first preset touch sensing quantity.

[0100] In the touch operation recognition method described above, in response to a touch operation on a touch screen, the touch sensing quantities and position information of sensing points of at least one frame of sensing signals are collected. At least two to-be-confirmed touch points are determined from the sensing points according to a first preset touch sensing quantity and the touch sensing quantities. If there is a sensing point smaller than a second preset touch sensing quantity on a travel route of the at least two to-be-confirmed touch points, it is determined that the touch operation is a non-pressing operation. By detecting that there is a sensing point smaller than the second preset touch sensing quantity on the travel route according to the at least two to-be-confirmed touch points matched with the at least one frame of sensing signals, it is indicated that there is a sensing point with small sensing quantity between the at least two to-be-confirmed touch points, and the two to-be-confirmed touch points are discontinuous and are two independent touch points. The method identifies the touch mode of the touch operation according to the continuity of the touch between the two to-be-confirmed touch points, thereby improving the accuracy of touch operation recognition.

[0101] In another embodiment, a touch operation recognition device is provided, in addition to the collection module 802, the touch point determination module 804, and the touch point processing module 806, the device further comprises a travel route determination module, wherein:

[0102] The touch point processing module 806 is further configured to determine a relative direction between any two of the at least two to-be-confirmed touch points.

[0103] The travel route determining module is configured to determine a travel route between any two of the at least two to-be-confirmed touch points according to the relative direction between the two to-be-confirmed touch points.

[0104] The travel route determining module is further configured to take one of the any two to-be-confirmed touch points as a starting point and the other to-be-confirmed touch point as an ending point.

[0105] The travel route determining module is further configured to start from the starting point, take the starting point as a current travel point, take a touch sensing point adjacent to the current travel point in the relative direction and having a maximum touch sensing value as a next travel point on the travel route, update the next travel point as the current travel point, and repeat the above operations until the ending point is reached, so as to obtain the travel route between the any two to-be-confirmed touch points.

[0106] The touch point processing module 806 is further configured to determine that the at least two to-be-confirmed touch points do not need to be merged if there is no touch sensing point less than the second preset touch sensing value on the travel route of the at least two to-be-confirmed touch points according to the current frame of sensing signals in the at least one frame of sensing signals.

[0107] The touch point processing module 806 is further configured to determine that the touch control operation is a non-drawing operation if it is determined that none of the at least two to-be-confirmed touch points corresponding to the respective continuous multiple frames of sensing signals needs to be merged.

[0108] The touch point processing module 806 is further configured to determine that the touch control operation is a drawing operation if it is determined that at least one of the at least two to-be-confirmed touch points corresponding to the at least one frame of sensing signals needs to be merged.

[0109] The touch point processing module 806 is further configured to determine that the touch control operation is a pressing operation if there is no touch sensing point less than the second preset touch sensing value on the travel route of the at least two to-be-confirmed touch points.

[0110] In one of the embodiments, in response to the touch operation on the touch screen, the touch sensing amount and position information of each sensing point of at least one frame of sensing signal are collected; at least two to-be-confirmed touch points are determined from the sensing points according to the first preset touch sensing amount and each touch sensing amount. The relative direction between any two to-be-confirmed touch points of the at least two to-be-confirmed touch points is determined, one of the any two to-be-confirmed touch points is taken as a starting point, and the other is taken as an end point; starting from the starting point and taking the starting point as a current advancing point, the sensing point adjacent to the current advancing point in the relative direction and having the maximum touch sensing amount is taken as a next advancing point on an advancing route, and the next advancing point is updated as the current advancing point until the end point is reached, and the advancing route between the any two to-be-confirmed touch points is obtained.

[0111] If there is a sensing point less than the second preset touch sensing amount on the advancing route of the at least two to-be-confirmed touch points according to the current frame of sensing signal of the at least one frame of sensing signal, it is determined that the at least two to-be-confirmed touch points do not need to be merged; whether the at least two to-be-confirmed touch points matched with each other in the continuous multiple frames of sensing signal need to be merged is detected, and if it is determined that the at least two to-be-confirmed touch points matched with each other in the continuous multiple frames of sensing signal do not need to be merged, it is determined that the touch operation is a non-drawing line operation. If it is determined that at least two to-be-confirmed touch points of at least one frame of sensing signal need to be merged from the at least two to-be-confirmed touch points matched with each other in the continuous multiple frames of sensing signal, it is determined that the touch operation is a drawing line operation.

[0112] If there is no sensing point less than the second preset touch sensing amount on the advancing route of the at least two to-be-confirmed touch points, it is determined that the touch operation is a pressing operation.

[0113] Each module in the above touch operation recognition device can be realized by software, hardware and a combination thereof in whole or in part. Each module can be embedded in or independent of the processor in the electronic device in hardware form, or can be stored in the memory in the electronic device in software form, so as to be called and executed by the processor to perform the operation corresponding to each module.

[0114] In one of the embodiments, an electronic device, which can be a terminal, has an internal structure diagram as shown in Figure 9As shown in the figure. The electronic device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium, an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The communication interface of the electronic device is used to communicate with external terminals in a wired or wireless manner. Wireless mode can be achieved through WIFI, mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by the processor to implement a touch operation recognition method. The display screen of the electronic device can be a liquid crystal display screen or an electronic ink display screen. The input device of the electronic device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad provided on the shell of the electronic device, or an external keyboard, touchpad or mouse, etc.

[0115] Those skilled in the art can understand that, Figure 9 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0116] In one embodiment, a computer device is also provided, including a memory and a processor, the memory stores a computer program, and the processor executes the computer program to implement the steps in each of the above method embodiments.

[0117] In one embodiment, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to implement the steps in each of the above method embodiments.

[0118] In one embodiment, a computer program product is provided, which includes a computer program, and the computer program is executed by a processor to implement the steps in each of the above method embodiments.

[0119] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties.

[0120] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0121] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist contradictory, it should be considered as the scope of the present application.

[0122] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are within the scope of protection of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A method for recognizing touch operations, characterized in that, The method comprises: In response to a touch operation on the touch screen, collecting touch sensing quantity and position information of each sensing point of at least one frame of sensing signal; According to a first preset touch sensing quantity and each of the touch sensing quantities, determining at least two to-be-confirmed touch points from each of the sensing points; If there is a sensing point on a travel route of the at least two to-be-confirmed touch points less than a second preset touch sensing quantity, determining that the touch operation is a non-pressing operation; wherein the second preset touch sensing quantity is greater than the first preset touch sensing quantity; Wherein, before the step of determining that the touch operation is a non-pressing operation if there is a sensing point on a travel route of the at least two to-be-confirmed touch points less than a second preset touch sensing quantity, the method further comprises: Determining a relative direction between any two to-be-confirmed touch points of the at least two to-be-confirmed touch points; According to the relative direction between any two to-be-confirmed touch points, determining a travel route from one to-be-confirmed touch point to another to-be-confirmed touch point.

2. The method of claim 1, wherein, The step of determining a travel route from one to-be-confirmed touch point to another to-be-confirmed touch point according to the relative direction between any two to-be-confirmed touch points comprises: Taking one to-be-confirmed touch point of the any two to-be-confirmed touch points as a starting point and the other to-be-confirmed touch point as an end point; Starting from the starting point, taking the starting point as a current travel point, taking a sensing point adjacent to the current travel point in the relative direction and having a maximum touch sensing quantity as a next travel point on the travel route, and updating the next travel point as the current travel point until the end point is reached, to obtain the travel route between the any two to-be-confirmed touch points.

3. The method of claim 1, wherein, The non-pressing operation comprises a non-drawing operation, and the step of determining that the touch operation is a non-pressing operation if there is a sensing point on a travel route of the at least two to-be-confirmed touch points less than a second preset touch sensing quantity comprises: If there is a sensing point on a travel route of the at least two to-be-confirmed touch points in a current frame of sensing signal of the at least one frame of sensing signal less than a second preset touch sensing quantity, determining that the at least two to-be-confirmed touch points do not need to be merged; If it is determined that none of the at least two to-be-confirmed touch points of the continuous multiple frames of sensing signal needs to be merged, determining that the touch operation is a non-drawing operation.

4. The method of claim 3, wherein, The non-pressing operation comprises a drawing operation, and the method further comprises: If it is determined that at least one of the at least two to-be-confirmed touch points of at least one frame of sensing signal needs to be merged among the at least two to-be-confirmed touch points of the continuous multiple frames of sensing signal, determining that the touch operation is a drawing operation.

5. The method of claim 1, wherein, The method further comprises: If there is no sensing point on a travel route of the at least two to-be-confirmed touch points less than the second preset touch sensing quantity, determining that the touch operation is a pressing operation.

6. A recognition device of a touch operation, characterized by, The device comprises: A collection module, configured to collect touch sensing quantity and position information of each sensing point of at least one frame of sensing signal in response to a touch operation on the touch screen; The touch point determination module is configured to determine at least two to-be-confirmed touch points from the sensing points according to the first preset touch sensing amount and the touch sensing amounts; The touch point processing module is configured to determine that the touch operation is a non-pressing operation if there is a sensing point less than a second preset touch sensing amount on a travel route of the at least two to-be-confirmed touch points, wherein the second preset touch sensing amount is greater than the first preset touch sensing amount. The touch point processing module is further configured to determine a relative direction between any two to-be-confirmed touch points of the at least two to-be-confirmed touch points. The travel route determination module is configured to determine a travel route from one to-be-confirmed touch point to another to-be-confirmed touch point according to the relative direction between the any two to-be-confirmed touch points. 7.An electronic device comprising a memory and a processor, the memory storing a computer program, wherein, The processor executes the computer program to implement the steps of the method in any one of claims 1 to 5.

8. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 5.

9. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 5.

Images