Touch operation recognition method, device, mobile terminal and storage medium
By receiving and analyzing touch operations on the mobile terminal, using the position and interval duration of the last tap operation to determine whether the current operation is a tap operation, the problem of delay in tap operation response is solved, and the user experience and system efficiency are improved.
Patent Information
- Application Number
- CN202011033279.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-27
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2041-02-28
AI Technical Summary
Touch type touch operations will affect the user's experience when using input methods or game-related applications, because these operations rely on data processing and algorithm recognition, resulting in response delays.
By receiving the current touch operation and determining whether the current touch operation is a tap operation based on the position of the last tap operation and the position of the current touch operation, and the interval duration between them. This method simplifies the judgment process and reduces computational complexity and resource usage.
It improves the response speed and accuracy of touch operations, reduces misjudgments, improves user experience, and reduces the use of terminal equipment resources.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of mobile terminals, and in particular to a touch operation recognition method, device, mobile terminal and storage medium. Background Art
[0002] With the improvement of performance and memory of mobile terminals such as mobile phones, people tend to install multiple applications on the same mobile phone. Users will set various shortcut keys according to their own habits. In addition, in order to increase the screen ratio of mobile phones, various keys are reduced, such as canceling the volume key and so on. Therefore, tapping touch operations such as knuckle tapping have emerged, which do not occupy keys and are more convenient to operate. However, tapping-type touch operations are more dependent on data processing and algorithm recognition, which will affect the response of touch operations. For example, in the scenario of using input method-related applications or game-related applications, it will affect the user experience. Summary of the invention
[0003] In order to overcome the problems existing in the related art, the present disclosure provides a touch operation recognition method, device, mobile terminal and storage medium.
[0004] According to a first aspect of an embodiment of the present disclosure, a touch operation recognition method is provided, which is applied to a mobile terminal, and the method includes:
[0005] Receive the current touch operation;
[0006] Determine that the last touch operation is a tap operation;
[0007] According to the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation, it is determined that the current touch operation is still a tap operation.
[0008] Optionally, determining that the current touch operation is still a tap operation according to the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation, includes:
[0009] Determine the displacement information of the current touch operation position relative to the last tap operation;
[0010] When the displacement information is less than or equal to the third threshold, and the interval between the current touch operation and the last tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, it is determined that the current touch operation is still a tap operation.
[0011] Optionally, the method further comprises:
[0012] When the displacement information is greater than the third threshold, and / or,
[0013] When the interval between the current touch operation and the last tap operation is less than the fourth threshold, or the interval between the current touch operation and the last tap operation is greater than the fifth threshold,
[0014] The current touch operation is determined according to vibration information and / or screen touch information of the current touch operation.
[0015] Optionally, when the last tap operation is not a tap operation, the method for identifying the touch operation includes:
[0016] Determine vibration information and / or screen touch information of the current touch operation;
[0017] A current touch operation is determined according to the vibration information and / or the screen touch information.
[0018] Optionally, determining the current touch operation according to the vibration information and / or the screen touch information includes:
[0019] When the vibration information is greater than a first threshold and the screen touch information is greater than a second threshold, it is determined that the current touch operation is a tapping operation.
[0020] Optionally, the determining the current touch operation according to the vibration information and / or the screen touch information further includes:
[0021] When the vibration information is less than or equal to a first threshold, and / or when the screen touch information is less than or equal to a second threshold, it is determined that the current touch operation is a touch operation.
[0022] Optionally, the method further comprises:
[0023] Get the configuration file;
[0024] When it is determined that the currently running application belongs to the application in the configuration file, all received touch operations are determined to be touch operations.
[0025] According to a second aspect of an embodiment of the present disclosure, a touch operation recognition device is provided, which is applied to a mobile terminal, and the device includes:
[0026] A receiving module, used for receiving the current touch operation;
[0027] A determination module, used to determine that the last touch operation is a tap operation;
[0028] The determination module is further configured to determine that the current touch operation is still a tap operation based on the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation.
[0029] Optionally, the determining module is specifically configured to:
[0030] Determine the displacement information of the current touch operation position relative to the last tap operation;
[0031] When the displacement information is less than or equal to the third threshold, and the interval between the current touch operation and the last tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, it is determined that the current touch operation is still a tap operation.
[0032] Optionally, the determining module is further used to:
[0033] When the displacement information is greater than the third threshold, and / or,
[0034] When the interval between the current touch operation and the last tap operation is less than the fourth threshold, or the interval between the current touch operation and the last tap operation is greater than the fifth threshold,
[0035] The current touch operation is determined according to vibration information and / or screen touch information of the current touch operation.
[0036] Optionally, when the last tap operation is not a tap operation, the determining module is further configured to:
[0037] Determine vibration information and / or screen touch information of the current touch operation;
[0038] A current touch operation is determined according to the vibration information and / or the screen touch information.
[0039] Optionally, the determining module is further used to:
[0040] When the vibration information is greater than a first threshold and the screen touch information is greater than a second threshold, it is determined that the current touch operation is a tapping operation.
[0041] Optionally, the determining module is further used for:
[0042] When the vibration information is less than or equal to a first threshold, and / or when the screen touch information is less than or equal to a second threshold, it is determined that the current touch operation is a touch operation.
[0043] Optionally, the device further comprises an acquisition module.
[0044] The acquisition module is used to acquire the configuration file;
[0045] The determination module is further configured to determine that all received touch operations are touch operations when it is determined that the currently running application belongs to the application in the configuration file.
[0046] According to a third aspect of an embodiment of the present disclosure, a mobile terminal is provided, the mobile terminal including a display screen, and the mobile terminal further including:
[0047] processor;
[0048] a memory for storing processor-executable instructions;
[0049] Wherein, the processor is configured to execute the touch operation recognition method as described in the first aspect.
[0050] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal can execute the touch operation recognition method as described in the first aspect.
[0051] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: in the touch operation recognition method, when the last touch operation is a tap operation, it is no longer necessary to use an algorithm to analyze and calculate the currently received touch operation. It is directly determined whether the current touch operation is a tap operation based on the position of the last tap operation and the position of the current touch operation, as well as the time interval between the two taps. The judgment method is simple, accurate, and efficient, which reduces the complexity of calculations. While effectively avoiding misjudgment, it reduces the occupancy of terminal device resources and improves the user experience.
[0052] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0054] Figure 1 The figure is a flow chart of a touch operation recognition method according to an exemplary embodiment.
[0055] Figure 2 The figure is a flow chart of a touch operation recognition method according to an exemplary embodiment.
[0056] Figure 3 The figure is a flow chart of a touch operation recognition method according to an exemplary embodiment.
[0057] Figure 4 The figure is a flow chart of a touch operation recognition method according to an exemplary embodiment.
[0058] Figure 5 is a block diagram of a touch operation recognition device according to an exemplary embodiment.
[0059] Figure 6 is a block diagram of a mobile terminal according to an exemplary embodiment. DETAILED DESCRIPTION
[0060] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.
[0061] As the performance of mobile terminals such as mobile phones improves and memory continues to increase, people tend to install multiple applications on the same mobile phone. Users will set various shortcut key methods according to their own habits. In addition, in order to increase the screen ratio of the mobile phone, various buttons are reduced, such as canceling the volume button and so on. Therefore, tapping touch operations such as knuckle tapping have emerged, which do not occupy buttons and are more convenient to operate. However, tapping-type touch operations are more dependent on data processing and algorithm recognition, which will affect the response of touch operations. For example, in the scenario of using input method-related applications or game-related applications, it will affect the user experience.
[0062] Since the pressure information corresponding to a tapping type of touch operation is different from that of a normal touch type of touch operation, the force of a tapping type of touch operation is often greater. In the related art, the touch operation is determined only by detecting the pressure information corresponding to the touch operation. That is, a strong tap is required to determine that the touch operation is a tap, and a tapping type of touch operation relies more on a heavy tap.
[0063] The present disclosure proposes a touch operation recognition method. When the last touch operation is a tap operation, it is no longer necessary to use an algorithm to analyze and calculate the currently received touch operation. Whether the current touch operation is a tap operation is determined directly based on the position of the last tap operation and the position of the current touch operation, as well as the time interval between the two taps. The judgment method is simple, accurate, and efficient, and the calculation complexity is reduced. While effectively avoiding misjudgment, it reduces the occupation of terminal device resources and improves the user experience.
[0064] In an exemplary embodiment, a touch operation recognition method is provided, which is applied to a mobile terminal. Figure 1 As shown, the method includes:
[0065] S110: Receive the current touch operation.
[0066] When a user performs a touch operation on a mobile terminal, the mobile terminal determines the vibration information and screen touch information corresponding to the touch operation through a vibration sensor and / or a touch component. The vibration information may be received alone, the screen touch information may be received alone, or both the vibration information and the screen touch information may be received simultaneously.
[0067] When the mobile terminal receives a touch operation (for example, when the user touches the touch screen or when the user taps the touch screen with his knuckles), the touch component generates a matrix space (RawData) for collecting screen signals. The touch component compares multiple frames of data from the touch screen and determines the screen touch information corresponding to the above touch operation through an algorithm. The screen touch information includes, for example, information such as the position, pressure, capacitance, current, etc. corresponding to the touch operation.
[0068] When the mobile terminal receives a touch operation (for example, when a user touches the touch screen), the touch operation will cause the mobile terminal to vibrate. Therefore, the vibration sensor can collect vibration information corresponding to the touch operation. The vibration sensor includes, for example, an acceleration sensor and a gyroscope sensor, and the vibration information includes, for example, the amplitude and frequency corresponding to the touch operation.
[0069] S120: Determine that the last touch operation is a tap operation.
[0070] Since the type of the last touch operation has been determined in the determination process when the touch operation was received last time, a determination result has been obtained, which is either a tap operation or a touch operation.
[0071] Therefore, this step in the present embodiment can directly determine whether the last time was a tapping operation by reading the last judgment result.
[0072] In addition, it should be noted that there are two methods for determining whether the last touch operation in this step is a tapping operation. One case is that the last touch operation is a tapping operation, but the previous touch operation of the last touch operation is not a tapping operation; the other case is that the last touch operation is a tapping operation, and the previous touch operation of the last touch operation is also a tapping operation. In these two cases, the methods for determining whether the last touch operation is a tapping operation are different.
[0073] If the last touch operation is a tap operation, but the previous touch operation is not a tap operation, it can also be understood as the process of first determining the tap operation, that is, when the last touch operation is not a tap operation, how to determine whether the current touch operation is a tap operation. In this case, the touch operation recognition method includes:
[0074] Determine vibration information and / or screen touch information of the current touch operation;
[0075] The current touch operation is determined according to the vibration information and / or the screen touch information.
[0076] The contents related to the vibration information and screen touch information are the same as those in step S110 and will not be repeated here.
[0077] When the last touch operation is a tapping operation, and the touch operation before the last touch operation is also a tapping operation, the method for determining whether the last touch operation is a tapping operation is equivalent to the method for determining whether the current touch operation is a tapping operation when the last touch operation is a tapping operation described in this embodiment. The determination method in this case can be determined using steps S110 to S130 in this embodiment.
[0078] S130: Determine that the current touch operation is still a tap operation based on the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation.
[0079] When the last touch operation was a tap operation, there is no need to use an algorithm to determine whether the current touch operation received is a tap operation or a touch operation. The current touch operation can be determined to be a touch operation or a tap operation based on the relative position relationship between the current touch operation and the last tap operation, and the time interval between the last tap operation and the current touch operation.
[0080] The method using this step can simply and accurately determine double tapping operations, triple tapping operations, etc. without using a tapping algorithm for identification and judgment. For example, when the last touch operation is a tapping operation, if the position of the current touch operation is within the preset range, and the duration between the current touch operation and the last tapping operation meets the preset conditions, the current touch operation is still a tapping operation, which means that the instruction applied by the user is determined to be a double tapping instruction. If the last touch operation is a tapping operation, when the displacement and time interval of the current touch operation relative to the last tapping operation meet the conditions, the current touch operation is also a tapping operation; if the displacement and time interval of the next touch operation received relative to the current touch operation still meet the preset conditions, it means that the next touch operation received is still a tapping operation, which means that the instruction applied by the user is determined to be a triple tapping instruction. Of course, it can be understood that if multiple touch operations are continuously received subsequently, and the displacement and time interval between the adjacent next touch operations relative to the last tapping operation meet the preset conditions, it can be determined as a continuous tapping instruction. The mobile terminal executes corresponding functions based on the double tap command, the triple tap command, and the continuous tap command.
[0081] In one example, when it is determined that the last touch operation is a tap operation, the position of the current touch operation and the interval time relative to the first tap operation are determined. If the position of the current touch operation is the same as the position of the last tap operation, or the offset displacement between the two positions is 1 cm. And the interval time between the current touch operation and the last tap operation is 160ms, it means that the current touch operation is also a tap operation, indicating that the two adjacent touch operations together form a double tap instruction.
[0082] In an exemplary embodiment, a touch operation recognition method is provided, which is a further improvement of the above method. Specifically, according to the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation, it is determined that the current touch operation is still a tap operation, including:
[0083] Determine the displacement information of the current touch operation position relative to the last tap operation;
[0084] When the displacement information is less than or equal to the third threshold, and the interval between the current touch operation and the last tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, determining that the current touch operation is still a tap operation;
[0085] When the displacement information is greater than a third threshold, and / or,
[0086] When the interval between the current touch operation and the last tap operation is less than the fourth threshold, or the interval between the current touch operation and the last tap operation is greater than the fifth threshold,
[0087] The current touch operation is determined according to vibration information and / or screen touch information of the current touch operation.
[0088] Among them, the third threshold value related to the displacement information, and the fourth threshold value, the fifth threshold value, etc. related to the time interval between two touch operations can all be determined according to actual conditions, and will not be described in detail in this embodiment.
[0089] For the case where the last touch operation involved in this embodiment is a tapping operation and the current touch operation is also a tapping operation, there is a difference between the time intervals of adjacent touch operations for continuous tapping touch operations and continuous touching touch operations. The time interval between two touch operations can be as fast as 50ms, while the tapping operation requires a certain amount of force. For example, when tapping with the knuckles, after the first tap, the knuckles need to be lifted and then tapped again. The time interval between the two taps can be as fast as 150ms. Therefore, the type of two adjacent touch operations can be determined by setting a duration threshold. For example, if the duration threshold is set to 140ms, the second touch operation within 140ms can be directly determined as a touch operation without the need for algorithm calculations, which reduces the waiting time and improves the user experience.
[0090] It should be noted that when the relative position relationship between the current touch operation and the last tap operation does not meet the third threshold requirement, and / or the interval between the current touch operation and the last tap operation does not meet the time threshold requirement, the current touch operation can be considered to be a new touch operation, and the tap algorithm needs to be used to determine the type of the current touch operation. When the tap algorithm is used for determination, the determination method is the same as the relevant content described in step S120, and will not be repeated here.
[0091] Specifically, during the implementation process, after the vibration information and / or screen touch information corresponding to the touch operation is determined, the touch operation is determined by processing the above vibration information and screen touch information. Among them, the touch operation includes touch operation and tapping operation, such as double tapping operation, triple tapping operation, continuous tapping operation, etc. In general, the tapping operation corresponds to a larger amplitude, and the capacitive intensity, current change intensity and voltage change intensity of the touch screen corresponding to the tapping operation are also larger. Based on this, the touch operation can be determined.
[0092] Determine the received touch operation according to the vibration information and / or the screen touch information, including:
[0093] When the vibration information is greater than a first threshold value, and the screen touch information is greater than a second threshold value, determining that the type of the received touch operation is a tapping operation;
[0094] When the vibration information is less than or equal to the first threshold, and / or when the screen touch information is less than or equal to the second threshold, it is determined that the received touch operation is a touch operation.
[0095] In this embodiment, in order to ensure the accuracy of the judgment, it is best to judge the touch operation as a tapping operation only when the vibration information and screen touch information received by the controller of the mobile terminal are both greater than the threshold. In any other case, the touch operation will be judged as a touch operation.
[0096] In one example, the mobile terminal is a mobile phone, and a touch component and a vibration sensor are disposed in the mobile phone. Compared with the touch component, the vibration sensor determines the vibration information corresponding to the touch operation more quickly.
[0097] When the user performs a touch operation on the mobile phone, the touch operation will cause the mobile phone to vibrate. The vibration sensor collects the amplitude corresponding to the touch operation and determines whether the amplitude is greater than a first threshold (the first threshold in this example is the amplitude threshold). When the amplitude is not greater than the first threshold, that is, when the amplitude is less than or equal to the first threshold, it is directly determined that the type of the touch operation is a touch operation; when the amplitude is greater than the first threshold, the next step of determination is performed.
[0098] When a user performs a touch operation on a mobile phone, the touch operation will not only cause the vibration of the mobile phone, but also cause changes in the pressure information of the touch screen of the mobile phone. Therefore, the touch component generates a matrix space (RawData) for collecting screen signals, and the touch component compares multiple frames of data of the touch screen, and determines the screen touch information corresponding to the above touch operation through an algorithm. In this example, the screen touch information is the pressure information corresponding to the touch operation, and the pressure information refers to the corresponding pressure value of the touch operation.
[0099] It is determined whether the pressure information exceeds a second threshold (the second threshold is a pressure threshold in this example). When the pressure information is greater than the second threshold, it is determined that the received touch operation is a tapping operation.
[0100] In the related technology, the types of touch operations received in the scenes where all game-related applications are running are determined to be touch, which is not a good experience. For example, games such as Three Kingdoms, Landlord, and Protect Carrot do not have high requirements for touch operations, and these games can turn on the function that can recognize tapping operations. For some games or other applications that involve high-frequency touch operations during operation, you can choose to turn off the function of recognizing tapping operations when such applications or games are running, and recognize all operations as touch operations.
[0101] This example introduces vibration information to determine the type of touch operation, and the vibration sensor determines the vibration information corresponding to the touch operation faster than the touch component. When the vibration information is less than or equal to the first threshold, the type of touch operation is directly determined to be a touch operation, without waiting for the touch component to determine the screen touch information, and without determining whether the screen touch information is greater than the second threshold. This greatly reduces the response time of the touch operation and improves the user experience.
[0102] In the touch operation recognition method, when the last touch operation is a tap operation, when judging whether the current touch operation is a tap operation or a touch operation, there is no need to use a tap algorithm for judgment, and only the relative position relationship between the two touch operations and the time interval between the two touch operations can be used to quickly and accurately judge. This not only shortens the judgment time, but also reduces the resource occupation of the terminal, thereby improving the user experience.
[0103] Based on this, reference Figure 2 As shown, in this embodiment, the method in this embodiment includes:
[0104] S210: Receive the current touch operation.
[0105] S220: Determine that the last touch operation is a tap operation.
[0106] S230: Determine displacement information of the position of the current touch operation relative to the last tap operation.
[0107] S240, determine whether the displacement information is less than or equal to the third threshold, and determine whether the interval between the current touch operation and the previous tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold; if the results of the above judgments are all "yes", go to step S250; otherwise, go to step S260.
[0108] The third threshold, the fourth threshold and the fifth threshold may be set when the mobile terminal leaves the factory, or may be set by the user himself.
[0109] It should be noted that the above-mentioned "determining whether the displacement information is less than or equal to the third threshold" and "determining whether the interval duration between the current touch operation and the previous tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold" can be performed simultaneously or separately.
[0110] If the displacement information is less than or equal to the third threshold, and the interval between the current touch operation and the last tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, when the above judgments are performed simultaneously, step S250 can be entered more quickly.
[0111] If the displacement information is greater than the third threshold, when the above judgments are performed in sequence, and when first judging whether the displacement information is less than or equal to the third threshold, step S260 can be entered more quickly.
[0112] S250: Determine that the current touch operation is still a tap operation.
[0113] When the displacement information of the position of the current touch operation relative to the position of the last tap operation is less than or equal to the third threshold, it indicates that the two adjacent touch operations of the user are associated, and the two adjacent touch operations are likely to be double tap operations, that is, the current touch operation is still a tap operation. In the above case, if the interval between the current touch operation and the last touch operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, it indicates that the current touch operation is also a tap operation, and the two consecutive tap operations are combined into a double tap operation.
[0114] S260: Determine the current touch operation according to the vibration information and / or the screen touch information of the current touch operation.
[0115] If the displacement information of the current touch operation position relative to the last tap operation position is greater than the third threshold, it means that the two adjacent touch operations of the user are not related, so the algorithm needs to be reused to determine the type of the current touch operation.
[0116] If the interval between the current touch operation and the last tap operation is less than the fourth threshold, it means that the current touch operation is probably not a tap operation, for example, it may be a continuous touch operation, so the algorithm needs to be reused to determine the touch operation received again.
[0117] If the interval between the current touch operation and the last tap touch operation is greater than the fifth threshold, it means that the interval between the current touch operation and the last tap operation is longer, which means that the two may not be related, or that the current touch operation is likely not a tap operation. Therefore, it is necessary to reuse the algorithm to determine whether the current touch operation is a tap operation or a touch operation.
[0118] It should be noted that the above method of "re-using the algorithm to determine the current touch operation" is the same as the method of determining the current touch operation when the previous touch operation is not a tap operation, and will not be repeated here.
[0119] In an exemplary embodiment, a touch operation recognition method is provided. Specifically, referring to Figure 3 As shown, the touch operation recognition method in this embodiment includes the recognition method in the above embodiment and further includes:
[0120] S310, obtaining a configuration file;
[0121] The configuration file includes at least one application. The configuration file is set in the server, and the user can modify the application in the configuration file according to their own needs. The application in the configuration file is, for example, a game-related application that requires high-frequency touch operation, or an application such as an input method.
[0122] Configuration files can also be added to the configuration file by user selection. For example, if an application has a high-frequency touch operation scenario during its use, a prompt message can be issued after the application is used to remind the user whether to store the application in the configuration file. If the user confirms that the application is to be stored in the configuration file,
[0123] Of course, the configuration file may also be stored in the mobile terminal and the server at the same time. When the mobile terminal needs to update the configuration file, it may connect to the server to update it.
[0124] S320: When it is determined that the currently running application belongs to the application in the configuration file, determine that all received touch operations are touch operations.
[0125] After obtaining the configuration file, determine whether the currently running application belongs to the application in the configuration file. If the currently running application belongs to the application in the configuration file, directly determine the touch operation as a touch operation, thereby improving the response speed to the touch operation. If the currently running application does not belong to the application in the configuration file, determine the touch operation based on the vibration information and / or the screen touch information.
[0126] When it is determined that the currently running application does not belong to the application in the configuration file, the received touch operation is determined according to the vibration information and / or the screen touch information.
[0127] For example, the configuration file includes application A, application B, and application C. If the currently running application is application A, then the types of touch operations when application A is running are directly determined to be touch operations. If the currently running application is application D, then the type of touch operation is determined based on the vibration information and screen touch information corresponding to the touch operation.
[0128] In addition, it should be noted that if it is determined that the currently running application belongs to an application in the configuration file, it means that tapping operations are not required in this type of application, or, in this type of application, tapping operations are prone to misjudgment. Therefore, when the application in the configuration file is running, the judgment algorithm for all tapping operations can be turned off so that the controller judges all operations received by the display screen as touch operations to avoid false touches, etc.
[0129] According to an exemplary embodiment, this embodiment provides a touch operation recognition method for identifying application scenarios for game recognition, so as to turn off tap operation recognition in games that require high-frequency operations, recognize all touch operations as touch operations, avoid accidental touches, and provide users with a better gaming experience.
[0130] like Figure 4 As shown, the touch operation recognition method in this embodiment includes the following steps:
[0131] S410, determining whether the started game application is stored in the configuration file, and / or whether there is a high-frequency touch game scene, if so, executing step S420; if not, executing step S430.
[0132] When a game application is stored in a configuration file, or when there is a high-frequency touch game scene in the game application, the user needs to frequently touch and click at similar or the same position. At the same time, in the application scenario, the user usually touches the screen of the mobile terminal device with great force during the game. If the tap recognition is turned on, it is very easy to cause misjudgment, thereby affecting the user's gaming experience. Therefore, when the user starts the game application stored in the configuration file, in order to improve the user's gaming experience and avoid the user's touch operation being mistakenly recognized as a tap operation during the game, the tap recognition algorithm can be directly turned off, that is, during the game, all touch operations received are considered to be touch operations, even if the user inputs a tap action, the tap action will be recognized as a touch operation.
[0133] S420: Determine that all touch operations received during the game running process are touch operations.
[0134] S430: Determine the received touch operation according to the vibration information and / or the screen touch information.
[0135] S440: When the last touch operation is a tap operation, determine that the current touch operation is still a tap operation according to the position of the current touch operation and the position of the last tap operation, and the interval between the last tap operation and the current touch operation.
[0136] Among them, step S430 and step S440 are the same as the implementation methods of each embodiment in the above embodiments, and will not be repeated here.
[0137] The present disclosure also proposes a touch operation recognition device for implementing the above-mentioned touch operation recognition method.
[0138] In an exemplary embodiment, a touch operation recognition device is provided, referring to Figure 5 As shown, the touch operation recognition device includes a receiving module 101 and a determining module 102. The device is used to implement the above method. During the implementation process:
[0139] The receiving module 101 is used to receive the current touch operation;
[0140] A determination module 102, used to determine that the last touch operation is a tap operation;
[0141] The determination module 102 is further configured to determine that the current touch operation is still a tap operation according to the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation.
[0142] In an exemplary embodiment, a touch operation recognition device is provided, referring to Figure 5 As shown, the device is an improvement of the above device. In the device, the determination module 102 is specifically used for:
[0143] When the vibration information is greater than the first threshold and the screen touch information is greater than the second threshold, it is determined that the received touch operation is a tapping operation.
[0144] In an exemplary embodiment, a touch operation recognition device is provided, referring to Figure 5 As shown, the device is an improvement of the above device. In the device, the determination module 102 is further used for:
[0145] When the vibration information is less than or equal to the first threshold, and / or when the screen touch information is less than or equal to the second threshold, it is determined that the current touch operation is a touch operation.
[0146] In an exemplary embodiment, a touch operation recognition device is provided, referring to Figure 5 As shown, the device is an improvement of the above device. In the device, the determination module 102 is further used for:
[0147] Determine the displacement information of the current touch operation position relative to the last tap operation;
[0148] When the displacement information is less than or equal to the third threshold, and the interval between the current touch operation and the last tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, it is determined that the current touch operation is still a tap operation.
[0149] In an exemplary embodiment, a touch operation recognition device is provided, referring to Figure 5 As shown, the device is an improvement of the above device. In the device, the determination module 102 is further used for:
[0150] When the displacement information is greater than a third threshold, and / or,
[0151] When the interval between the current touch operation and the last tap operation is less than the fourth threshold, or the interval between the current touch operation and the last tap operation is greater than the fifth threshold,
[0152] The current touch operation is determined according to vibration information and / or screen touch information of the current touch operation.
[0153] In an exemplary embodiment, a touch operation recognition device is provided, referring to Figure 5 As shown, the device is an improvement of the above device, and the device also includes an acquisition module 103. In the specific implementation process:
[0154] An acquisition module 103 is used to acquire a configuration file;
[0155] The determination module 102 is further configured to determine that all received touch operations are touch operations when it is determined that the currently running application belongs to the application in the configuration file.
[0156] In an exemplary embodiment, a mobile terminal is provided. For example, the mobile terminal may be a device with a touch screen, such as a mobile phone, a computer, or a tablet device.
[0157] refer to Figure 6 As shown, mobile terminal 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , a multimedia component 408 , an audio component 410 , an input / output (I / O) interface 412 , a sensor component 414 , and a communication component 416 .
[0158] The processing component 402 generally controls the overall operation of the device 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.
[0159] The memory 404 is configured to store various types of data to support operations on the device 400. Examples of such data include instructions for any application or method operating on the device 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0160] The power component 406 provides power to the various components of the device 400. The power component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 400.
[0161] The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera and / or a rear camera. When the mobile terminal 400 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0162] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), and when the device 400 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.
[0163] I / O interface 412 provides an interface between processing component 402 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0164] The sensor assembly 414 includes one or more sensors for providing various aspects of status assessment for the mobile terminal 400. For example, the sensor assembly 414 can detect the open / closed state of the mobile terminal 400, the relative positioning of components, such as the display and keypad of the mobile terminal 400, and the sensor assembly 414 can also detect the position change of the device 400 or a component of the mobile terminal 400, the presence or absence of user contact with the device 400, the orientation or acceleration / deceleration of the device 400, and the temperature change of the device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0165] The communication component 416 is configured to facilitate wired or wireless communication between the device 400 and other devices. The device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0166] In an exemplary embodiment, the mobile terminal 400 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.
[0167] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, and the instructions can be executed by the processor 420 of the device 400 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc. When the instructions in the storage medium are executed by the processor of the mobile terminal, the mobile terminal is enabled to perform the above method.
[0168] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present invention are indicated by the claims.
[0169] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A touch operation recognition method, applied to a mobile terminal, characterized in that: The method comprises: Receive the current touch operation; Determine that the last touch operation is a tap operation; Determining that the current touch operation is still a tap operation based on the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation; When the last touch operation is not a tap operation, the touch operation recognition method includes: Determine vibration information and / or screen touch information of the current touch operation; A current touch operation is determined according to the vibration information and / or the screen touch information.
2. The touch operation recognition method according to claim 1, characterized in that: The determining that the current touch operation is still a tap operation according to the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation, includes: Determine the displacement information of the current touch operation position relative to the last tap operation; When the displacement information is less than or equal to the third threshold, and the interval between the current touch operation and the last tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, it is determined that the current touch operation is still a tap operation.
3. The touch operation recognition method according to claim 2, characterized in that: The method further comprises: When the displacement information is greater than the third threshold, and / or, When the interval between the current touch operation and the last tap operation is less than the fourth threshold, or the interval between the current touch operation and the last tap operation is greater than the fifth threshold, The current touch operation is determined according to vibration information and / or screen touch information of the current touch operation.
4. The touch operation recognition method according to claim 1, characterized in that: The determining the current touch operation according to the vibration information and / or the screen touch information includes: When the vibration information is greater than a first threshold and the screen touch information is greater than a second threshold, it is determined that the current touch operation is a tapping operation.
5. The touch operation recognition method according to claim 1, characterized in that: The determining the current touch operation according to the vibration information and / or the screen touch information further includes: When the vibration information is less than or equal to a first threshold, and / or when the screen touch information is less than or equal to a second threshold, it is determined that the current touch operation is a touch operation.
6. The touch operation recognition method according to any one of claims 1 to 5, characterized in that: The method further comprises: Get the configuration file; When it is determined that the currently running application belongs to the application in the configuration file, all received touch operations are determined to be touch operations.
7. A touch operation recognition device, applied to a mobile terminal, characterized in that: The device comprises: A receiving module, used for receiving the current touch operation; A determination module, used to determine that the last touch operation is a tap operation; The determination module is further configured to determine that the current touch operation is still a tap operation based on the position of the last tap operation and the position of the current touch operation, and the interval between the current touch operation and the last tap operation; When the last touch operation is not a tap operation, the determining module is further used to: Determine vibration information and / or screen touch information of the current touch operation; A current touch operation is determined according to the vibration information and / or the screen touch information.
8. The touch operation recognition device according to claim 7, characterized in that: The determination module is specifically used for: Determine the displacement information of the current touch operation position relative to the last tap operation; When the displacement information is less than or equal to the third threshold, and the interval between the current touch operation and the last tap operation is greater than or equal to the fourth threshold and less than or equal to the fifth threshold, it is determined that the current touch operation is still a tap operation.
9. The touch operation recognition device according to claim 8, characterized in that: The determining module is further used for: When the displacement information is greater than the third threshold, and / or, When the interval between the current touch operation and the last tap operation is less than the fourth threshold, or the interval between the current touch operation and the last tap operation is greater than the fifth threshold, The current touch operation is determined according to vibration information and / or screen touch information of the current touch operation.
10. The touch operation recognition device according to claim 7, characterized in that: The determining module is further used for: When the vibration information is greater than a first threshold and the screen touch information is greater than a second threshold, it is determined that the current touch operation is a tapping operation.
11. The touch operation recognition device according to claim 7, characterized in that: The determining module is also used for: When the vibration information is less than or equal to a first threshold, and / or when the screen touch information is less than or equal to a second threshold, it is determined that the current touch operation is a touch operation.
12. The touch operation recognition device according to any one of claims 7 to 11, characterized in that: The device also includes an acquisition module, The acquisition module is used to acquire the configuration file; The determination module is further configured to determine that all received touch operations are touch operations when it is determined that the currently running application belongs to the application in the configuration file.
13. A mobile terminal, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to execute the touch operation recognition method as described in any one of claims 1 to 6.
14. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of the mobile terminal, the mobile terminal is enabled to execute the touch operation recognition method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Touch operation identification and response method and apparatus as well as game control method and apparatus
CN105302467A