Method for identifying two-finger operation, device for identifying two-finger operation and storage medium
By collecting and monitoring the capacitance values of the two-finger pressing positions on the capacitive touch screen and identifying the two-finger operation, the problem of incorrect recognition of two-finger operation is solved and the recognition accuracy is improved.
Patent Information
- Application Number
- CN202210240686.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-10
- Publication Date
- 2025-10-03
- Estimated Expiration
- 2042-03-10
AI Technical Summary
On capacitive touch screens, two-finger operation recognition is prone to errors, resulting in reduced recognition accuracy.
By collecting the capacitance value of the two-finger pressing position and monitoring the distance between them, the capacitance value is periodically collected until the set conditions are met, and the two-finger operation is recognized based on the capacitance value.
Improves the recognition accuracy of two-finger operation, avoiding the phenomenon of not recognizing two fingers due to incorrect distance judgment.
Smart Images

Figure CN114741005B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of terminal technology, and in particular to a method for identifying a two-finger operation, a device for identifying a two-finger operation, and a storage medium. Background Art
[0002] With the increasing application of capacitive touch screens and the improvement of screen multi-point recognition technology, the function of multi-finger gestures has been expanded in the application of capacitive touch screens. For example: two-finger zoom function, three-finger exit interface function, etc. In particular, the two-finger zoom function is widely used in capacitive touch screens. For example, when users view images in an album or view a map during navigation, they can zoom in and out of images or maps by pinching and spreading their fingers. When two fingers are pressed on the screen, the capacitance value at the point where the fingers are pressed is larger than the capacitance value of other non-pressed areas. Therefore, two areas with sudden changes in capacitance value are formed, and there are two maximum capacitance values in the area. However, when the user presses the screen with two fingers together, it is easy to make mistakes in recognizing the two-finger operation, resulting in a decrease in the accuracy of the screen in recognizing the user's two fingers. Summary of the Invention
[0003] In order to overcome the problems existing in the related art, the present disclosure provides a method for recognizing a two-finger operation, an apparatus for recognizing a two-finger operation, and a storage medium.
[0004] According to a first aspect of an embodiment of the present disclosure, a method for identifying a two-finger operation is provided, including:
[0005] In response to detecting a press event of a first finger and a second finger on the terminal screen, collecting a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger, and monitoring a distance between a pressing position of the first finger and a pressing position of the second finger;
[0006] When the distance between the first finger pressing position and the second finger pressing position meets a set condition, operations corresponding to the first finger and the second finger are identified based on the first capacitance value and the second capacitance value.
[0007] In one embodiment, the collecting of the first capacitance value corresponding to the first finger pressing position and the second capacitance value corresponding to the second finger pressing position includes: in the process of detecting the pressing events of the first finger and the second finger on the terminal screen, and in the process of the distance between the first finger pressing position and the second finger pressing position gradually decreasing, periodically collecting the first capacitance value corresponding to the first finger and the second capacitance value corresponding to the second finger until the distance between the first finger pressing position and the second finger pressing position meets the set conditions, so as to collect multiple first capacitance values and multiple second capacitance values.
[0008] In one embodiment, the operations corresponding to the first finger and the second finger are identified based on the first capacitance value and the second capacitance value, including: if multiple acquisitions are performed periodically, and the maximum capacitance value corresponding to the finger pressing exists in the first capacitance value acquired each time, and the maximum capacitance value corresponding to the finger pressing exists in the second capacitance value acquired each time, then it is determined that the first finger and the second finger are identified as performing a continuous two-finger operation.
[0009] In one embodiment, the identifying the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value includes: if multiple acquisitions are performed periodically, and there is a first capacitance value among the multiple acquired first capacitance values that does not include the maximum capacitance value corresponding to finger pressing, and / or there is a second capacitance value among the multiple acquired second capacitance values that does not include the maximum capacitance value corresponding to finger pressing, then it is determined that the first finger and the second finger are identified as performing a two-finger discontinuous operation.
[0010] In one embodiment, the set condition includes that the distance between the first finger pressing position and the second finger pressing position is within a set distance threshold range.
[0011] In one embodiment, the method further includes: in response to the distance between the first finger pressing position and the second finger pressing position being less than the minimum distance in the distance threshold range, and there being an overlapping area between the first finger pressing position and the second finger pressing position, determining the maximum and second maximum capacitance values within the overlapping area; determining the coordinates of the position corresponding to the maximum capacitance value as the first touch coordinates, and determining the coordinates of the position corresponding to the second maximum capacitance value as the second touch coordinates, the first touch coordinates being the touch coordinates corresponding to the first finger pressing position, and the second touch coordinates being the touch coordinates corresponding to the second finger pressing position; responding to a two-finger operation based on the first touch coordinates and the second touch coordinates, and updating the first finger pressing position and the second finger pressing position.
[0012] According to a second aspect of an embodiment of the present disclosure, there is provided an apparatus for recognizing a two-finger operation, including:
[0013] An acquisition and monitoring unit is used to, in response to detecting a pressing event of a first finger and a second finger on the terminal screen, acquire a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger, and monitor the distance between the pressing position of the first finger and the pressing position of the second finger; an identification unit is used to identify the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value when the distance between the pressing position of the first finger and the pressing position of the second finger meets a set condition.
[0014] In one embodiment, the acquisition monitoring unit periodically acquires the first capacitance value corresponding to the first finger pressing position and the second capacitance value corresponding to the second finger pressing position in the following manner: when detecting the pressing events of the first finger and the second finger on the terminal screen, and when the distance between the first finger pressing position and the second finger pressing position gradually decreases, the first capacitance value corresponding to the first finger and the second capacitance value corresponding to the second finger are periodically acquired until the distance between the first finger pressing position and the second finger pressing position meets the set conditions, so as to acquire multiple first capacitance values and multiple second capacitance values.
[0015] In one embodiment, the identification unit identifies the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value in the following manner: if multiple acquisitions are performed periodically, and the maximum capacitance value corresponding to the finger pressing exists in the first capacitance value acquired each time, and the maximum capacitance value corresponding to the finger pressing exists in the second capacitance value acquired each time, then it is determined that the first finger and the second finger are identified as performing a two-finger continuous operation.
[0016] In one embodiment, the identification unit identifies the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value in the following manner: if multiple acquisitions are performed periodically, and there is a first capacitance value among the multiple acquired first capacitance values that does not include the maximum capacitance value corresponding to finger pressing, and / or there is a second capacitance value among the multiple acquired second capacitance values that does not include the maximum capacitance value corresponding to finger pressing, then it is determined that the first finger and the second finger are performing two-finger discontinuous operations.
[0017] In one embodiment, the set condition includes that the distance between the first finger pressing position and the second finger pressing position is within a set distance threshold range.
[0018] In one embodiment, the identification unit is also used to: in response to the distance between the first finger pressing position and the second finger pressing position being less than the minimum distance in the distance threshold range, and there being an overlapping area between the first finger pressing position and the second finger pressing position, determine the maximum and second maximum capacitance values within the overlapping area; determine the coordinates of the position corresponding to the maximum capacitance value as the first touch coordinates, and determine the coordinates of the position corresponding to the second maximum capacitance value as the second touch coordinates, the first touch coordinates being the touch coordinates corresponding to the first finger pressing position, and the second touch coordinates being the touch coordinates corresponding to the second finger pressing position; respond to a two-finger operation based on the first touch coordinates and the second touch coordinates, and update the first finger pressing position and the second finger pressing position.
[0019] According to a third aspect of an embodiment of the present disclosure, a device for identifying a two-finger operation is provided, including:
[0020] processor;
[0021] a memory for storing processor-executable instructions;
[0022] The processor is configured to: execute the method described in the first aspect or any one of the embodiments of the first aspect.
[0023] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, wherein instructions are stored in the storage medium. When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the method described in the first aspect or any one of the embodiments of the first aspect.
[0024] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: detecting a user's two-finger pressing event on the terminal screen, and when it is determined that a two-finger pressing event exists on the terminal screen, collecting the capacitance value at the two-finger pressing location, and monitoring the distance between the two-finger pressing positions until the distance between the first finger pressing position and the second finger pressing position meets the set conditions, identifying the operation corresponding to the user's two fingers based on the collected capacitance value, so that when the distance between the two finger pressing positions meets the set conditions, the operation corresponding to the two fingers is identified, and there is no need to distinguish whether the operation corresponding to the user's two fingers has ended, thereby avoiding the terminal failing to recognize the two fingers and resulting in a decrease in recognition accuracy.
[0025] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0027] Figure 1 The figure is a flow chart showing a method for identifying a double-finger operation according to an exemplary embodiment.
[0028] Figure 2 A schematic diagram is shown of detecting a pressing event of a first finger and a second finger on a terminal screen when there is a critical merge risk.
[0029] Figure 3 The flowchart of collecting capacitance values corresponding to two-finger pressing positions is shown according to an exemplary embodiment.
[0030] Figure 4 The figure is a flowchart showing an operation of identifying correspondence between a first finger and a second finger according to an exemplary embodiment.
[0031] Figure 5 A schematic diagram illustrating detecting a pressing event of a first finger and a second finger on a terminal screen when there is a risk of merging is shown.
[0032] Figure 6 The figure is a flowchart showing an operation of identifying correspondence between a first finger and a second finger according to an exemplary embodiment.
[0033] Figure 7 The present invention is a block diagram of a device for recognizing a double-finger operation according to an exemplary embodiment.
[0034] Figure 8 The figure is a block diagram showing a device for recognizing a double-finger operation according to an exemplary embodiment. DETAILED DESCRIPTION
[0035] Exemplary embodiments are described in detail herein, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numerals in different drawings represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present disclosure.
[0036] The method for identifying two-finger operations provided in the present disclosure is applied to a scenario in which an application is controlled based on a two-finger pinch operation in a terminal. In the embodiment of the present disclosure, the two-finger pinch operation can also be understood as an operation of bringing two fingers together so that the distance between the two fingers gradually decreases.
[0037] The two-finger pinch operation provided by the embodiment of the present disclosure can identify the pressing positions of the two fingers on the terminal screen when the user performs the two-finger pinch operation on the terminal screen, so as to accurately identify the two-finger operation.
[0038] Figure 1 FIG. 1 is a flow chart showing a method for identifying a double-finger operation according to an exemplary embodiment. Figure 1 As shown, the method for identifying a two-finger operation is used in a terminal and includes the following steps.
[0039] In step S11, in response to detecting a pressing event of a first finger and a second finger on the terminal screen, a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger are collected, and the distance between the pressing position of the first finger and the pressing position of the second finger is monitored.
[0040] In the present disclosure, when a first finger and a second finger are detected pressing a terminal screen, the capacitance values corresponding to the two fingers are collected, the pressing positions of the first finger and the second finger are recorded, and the distance between the pressing positions of the first finger and the second finger is calculated. The finger pressing positions are determined based on the positions of the collected capacitance values. The point in the upper left corner of the screen is used as the origin of the coordinate system to record the pressing positions of the first finger and the second finger.
[0041] In the present disclosure, when the user's finger presses on the screen, since the human body is a conductor and there is an electric field, the contact between the user's finger and the screen forms a coupling capacitor, which makes the screen capacitance value increase instantly. Therefore, the pressing behavior of the user's finger on the terminal screen is converted into a change in the screen capacitance value.
[0042] In the embodiment of the present disclosure, after each equal time interval, that is, periodically according to the position of the collected capacitance value, the first pressing position corresponding to the first finger and the second pressing position corresponding to the second finger are recorded, and the distance between the pressing position of the first finger and the pressing position of the second finger is calculated.
[0043] In one example, the first finger press position recorded for the first time is set to Set the second finger press position obtained from the first record to The distance D between the first finger pressing position and the second finger pressing position calculated for the first time is Set the first finger press position obtained in the second record to Set the second finger press position obtained by the second recording to The distance D between the first finger pressing position and the second finger pressing position calculated for the second time is Until the distance between the first finger pressing position and the second finger pressing position meets the set condition, the first finger pressing position recorded for the Nth time is set as Set the second finger press position recorded for the Nth time to Then the distance D between the first finger pressing position and the second finger pressing position calculated for the Nth time is
[0044] Among them, X1, X2, Y1, and Y2 are all positive values. For example, if the values of X1, X2, Y1, and Y2 are 5, 10, 12, and 16 respectively, then
[0045] In step S12 , when the distance between the first finger pressing position and the second finger pressing position meets a set condition, operations corresponding to the first finger and the second finger are identified based on the first capacitance value and the second capacitance value.
[0046] It can be understood that the operations corresponding to the first finger and the second finger may at least include a two-finger pinch operation. In the present disclosure, the operations corresponding to the first finger and the second finger are not specifically limited.
[0047] In the embodiment of the present disclosure, setting the condition refers to setting the distance threshold range. The distance threshold range can be set to It is affected by the terminal screen resolution. If the terminal screen resolution is low, the distance between adjacent pixels is large; if the terminal screen resolution is high, the distance between adjacent pixels is small. Figure 2 Schematic diagram showing a method of detecting a pressing event of a first finger and a second finger on a terminal screen when there is a critical merge risk. Figure 2 As shown, when the distance between the first finger pressing position and the second finger pressing position is within the distance threshold range, the terminal can easily recognize the two-finger operation as a single-finger operation.
[0048] In another embodiment, the setting condition may be that the distance between the first finger pressing position and the second finger pressing position is less than or equal to a preset distance, wherein this embodiment does not limit the size of the preset distance and can be set according to specific needs.
[0049] In the present disclosure, a two-finger pressing event of a user on a terminal screen is detected. When it is determined that a two-finger pressing event exists on the terminal screen, the capacitance value at the two-finger pressing location is collected, and the distance between the two-finger pressing locations is monitored until the distance between the first finger pressing location and the second finger pressing location meets the set conditions. Based on the collected capacitance value, the operation corresponding to the user's two fingers is identified, so that when the distance between the two finger pressing locations meets the set conditions, the operation corresponding to the two fingers is identified, and there is no need to distinguish whether the operation corresponding to the user's two fingers has ended, so as to avoid the terminal failing to recognize the two fingers and resulting in a decrease in recognition accuracy.
[0050] Figure 3 FIG. 1 is a flow chart showing a method of collecting capacitance values corresponding to two-finger pressing positions according to an exemplary embodiment. Figure 3 As shown, collecting a first capacitance value corresponding to a first finger pressing position and a second capacitance value corresponding to a second finger pressing position includes the following steps.
[0051] In step S21, when a pressing event of a first finger and a second finger on the terminal screen is detected and the distance between the pressing position of the first finger and the pressing position of the second finger gradually decreases, a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger are periodically collected until the distance between the pressing position of the first finger and the pressing position of the second finger meets the set conditions, so as to collect multiple first capacitance values and multiple second capacitance values.
[0052] In one example, when the terminal screen detects a user pressing two fingers on the screen for the first time, the terminal's touch integrated circuit records the ID_1 identifier for the first finger press and the ID_2 identifier for the second finger press, and stores the coordinates of the capacitance values corresponding to the finger presses under the ID_1 and ID_2 identifiers. At this point, the terminal reports a finger press (DOWN) event, collects the first capacitance value corresponding to the first finger press position, and the second capacitance value corresponding to the second finger press position, records the coordinate positions of the two fingers on the screen, and starts a timer.
[0053] In the present disclosure, when the terminal screen detects a user's double-finger pressing event on the screen for the first time, a timer is started. The timer duration can be set according to actual needs. It is assumed that the timer duration in the embodiment of the present disclosure is 0.01s. In the process of the distance between the first finger pressing position and the second finger pressing position gradually decreasing, the timer duration is restarted every time it reaches 0.01s, and each time the timer is restarted, the first capacitance value corresponding to the first finger and the second capacitance value corresponding to the second finger are collected, and the first pressing position corresponding to the first finger and the second pressing position corresponding to the second finger are recorded until the distance between the first finger pressing position and the second finger pressing position meets the distance threshold range, and multiple first pressing positions and multiple second pressing positions are obtained, so that the change in the screen capacitance value at each moment can be collected, that is, the first capacitance value corresponding to the first finger and the second capacitance value corresponding to the second finger are periodically collected.
[0054] Figure 4 FIG. 1 is a flow chart showing an operation of identifying a correspondence between a first finger and a second finger according to an exemplary embodiment. Figure 4 As shown, based on the first capacitance value and the second capacitance value, identifying the operations corresponding to the first finger and the second finger includes the following steps.
[0055] In step S31, if multiple acquisitions are performed periodically, and the maximum capacitance value corresponding to the finger pressing exists in the first capacitance value acquired each time, and the maximum capacitance value corresponding to the finger pressing exists in the second capacitance value acquired each time, it is determined that the first finger and the second finger are recognized to perform two-finger continuous operation.
[0056] The maximum capacitance value refers to the value at which the capacitance value of the screen at the point where the finger is pressed changes the most when the user presses the finger on the terminal screen. The maximum capacitance value may also be called the peak capacitance value.
[0057] In the embodiment of the present disclosure, if the user presses the terminal screen with a single finger, the capacitance value at the finger pressing location changes, and the capacitance value collected by the terminal at the finger pressing location will have a maximum capacitance value. When multiple fingers press the screen, the terminal will collect multiple capacitance value maxima. For example, if the user presses the screen with three fingers, the terminal will collect three capacitance value maxima. The risk of merging capacitance value maxima must be excluded in the above-mentioned situation. If the user's finger does not press the terminal screen, the capacitance value at the finger pressing location will not change, and the capacitance values collected by the terminal at the finger pressing location are all 0. Therefore, when the user does not press the screen with his finger, the capacitance value collected at the pressing location does not include the maximum capacitance value.
[0058] In the embodiment of the present disclosure, when performing multiple periodic acquisitions, it is determined whether the first capacitance value collected in each of the multiple acquisitions and the second capacitance value collected in each of the multiple acquisitions have a maximum capacitance value. When the distance between the first finger pressing position and the second finger pressing position meets the distance threshold range, if the capacitance value is the maximum in the first capacitance value collected in each of the multiple acquisitions, and the capacitance value is the maximum in the second capacitance value collected in each of the multiple acquisitions, it is determined that the first finger and the second finger are performing a two-finger continuous operation, that is, in the process of collecting capacitance values, the sliding trajectory of the first finger on the terminal screen is a continuous trajectory, and the sliding trajectory of the second finger on the terminal screen is also a continuous trajectory. In other words, when the two-finger pressing areas overlap and / or there is a risk of merging the capacitance value maximums, if the capacitance value maximums corresponding to the first finger and the second finger can be collected at regular intervals, it indicates that the user is performing a two-finger continuous operation, that is, the user has not lifted at least one finger during the sliding process. For example: when the user performs a two-finger pinch operation, the terminal collects the capacitance value at the finger press point at the same regular intervals. Assume that the terminal collects capacitance values at the location of two-finger press N times in a row. The capacitance values collected at the location of two-finger press for the first time all contain the maximum capacitance value. The capacitance values collected at the location of two-finger press for the second time all contain the maximum capacitance value. Until the Nth time, the capacitance values collected at the location of two-finger press all contain the maximum capacitance value. Therefore, if the capacitance values collected at the location of two-finger press each time contain the maximum capacitance value, it means that the first and second fingers are performing continuous two-finger operation.
[0059] In the embodiment of the present disclosure, the terminal can identify that the user's two-finger operation is a continuous operation, and determine that the user is still pressing the screen with two fingers when the maximum capacitance value is in a critical merging state, thereby improving the accuracy of two-finger recognition.
[0060] In the embodiment of the present disclosure, when the terminal determines that the double-finger operation of the user is a continuous operation, the terminal will perform a subsequent operation.
[0061] In step S32, when it is determined that the distance between the first finger pressing position and the second finger pressing position is less than the minimum distance in the distance threshold range, and there is an overlapping area between the first finger pressing position and the second finger pressing position, the maximum and second maximum capacitance values are determined in the overlapping area.
[0062] In the process of determining the distance between the first finger pressing position and the second finger pressing position, the distance between the first finger pressing position and the second finger pressing position corresponding to the last acquisition in multiple acquisitions can be used as the distance between the first finger pressing position and the second finger pressing position.
[0063] In step S33 , the coordinates of the position corresponding to the maximum capacitance value are determined as first touch coordinates, and the coordinates of the position corresponding to the second maximum capacitance value are determined as second touch coordinates.
[0064] The first touch coordinates are touch coordinates corresponding to the first finger pressing position, and the second touch coordinates are touch coordinates corresponding to the second finger pressing position. The touch coordinates are used to update the first finger pressing position and the second finger pressing position.
[0065] In step S34 , the two-finger operation is responded to according to the first touch coordinates and the second touch coordinates, and the first finger pressing position and the second finger pressing position are updated.
[0066] In the embodiment of the present disclosure, when it is determined that the first finger and the second finger are performing a continuous two-finger operation, and there is a risk of two-finger merging, the position of the maximum capacitance value and the position of the second maximum capacitance value in the overlapping area are determined. The position of the maximum capacitance value and the position of the second maximum capacitance value determined in the overlapping area are used as the touch coordinates corresponding to the new first finger pressing position and the second finger pressing position, and the new touch coordinates are reported. That is, the touch coordinates stored under the ID_1 identifier are updated to the coordinates of the position corresponding to the maximum capacitance value, and the touch coordinates stored under the ID_2 identifier are updated to the coordinates of the position corresponding to the second maximum capacitance value. Since there is only one capacitance peak in the overlapping area, by determining the maximum capacitance value and the second maximum capacitance value, it is achieved that it is not interfered by external factors such as the user's finger shape, finger pressing strength, finger merging and pinching strength, and the position of the finger pressing on the screen is accurately determined.
[0067] In the embodiment of the present disclosure, when a user views a photo and needs to reduce the image, the terminal screen can determine the image reduction ratio based on the updated touch coordinates and perform the image reduction operation. Assume that when the screen detects that the user performs a two-finger press event for the first time, the pressing position of the first finger is (2,3), and the pressing position of the second finger is (8,6). After the update, the pressing position of the first finger is (4,4), and the pressing position of the second finger is (5,5). It can be seen that the distance between the two fingers is 6.7pix1 in the initial case, and the distance between the two fingers is 1.4pix1 after the update. The corresponding zoom factor is calculated, and the terminal performs the image reduction operation.
[0068] In one example, Figure 5 A schematic diagram showing a method of detecting a pressing event of a first finger and a second finger on a terminal screen when there is a risk of merging. Figure 5As shown in the figure, when a user pinches the screen with two fingers and slides them together, the capacitance change at the pressed point, as detected by the screen, is reflected in an identification box. At this point, the maximum capacitance value 1123 and the second-largest capacitance value 1072 are selected from the identification box, and the touch coordinates stored under the ID_1 identifier are updated to the coordinates corresponding to the maximum capacitance value 1123, and the touch coordinates stored under the ID_2 identifier are updated to the coordinates corresponding to the second-largest capacitance value 1072.
[0069] Figure 6 FIG. 1 is a flow chart showing an operation of identifying a correspondence between a first finger and a second finger according to an exemplary embodiment. Figure 6 As shown, based on the first capacitance value and the second capacitance value, identifying the operations corresponding to the first finger and the second finger includes the following steps.
[0070] In step S41, if multiple acquisitions are performed periodically, and there is a first capacitance value among the multiple acquired first capacitance values that does not include the maximum capacitance value corresponding to finger pressing, and / or there is a second capacitance value among the multiple acquired second capacitance values that does not include the maximum capacitance value corresponding to finger pressing, then it is determined that the first finger and the second finger are recognized to perform a two-finger discontinuous operation.
[0071] In the present disclosure, when it is determined that the distance between the first finger pressing position and the second finger pressing position meets the distance threshold range, in other words, when the areas where the capacitance value changes due to the two-finger pressing just overlap. If multiple acquisitions are performed periodically, there is a first capacitance value that does not contain the maximum capacitance value corresponding to the finger pressing among the first capacitance values acquired multiple times, and / or there is a second capacitance value that does not contain the maximum capacitance value corresponding to the finger pressing among the second capacitance values acquired multiple times, then it is determined that the first finger and the second finger are performing a two-finger discontinuous operation. It should be noted that when there is a first capacitance value that does not contain the maximum capacitance value corresponding to the finger pressing among the first capacitance values acquired multiple times, it indicates that the sliding track of the first finger on the terminal screen is discontinuous within the corresponding time length of the multiple acquisitions, and the first finger has left the terminal screen within the corresponding time length of the multiple acquisitions; when there is a second capacitance value that does not contain the maximum capacitance value corresponding to the finger pressing among the second capacitance values acquired multiple times, it indicates that the sliding track of the second finger on the terminal screen is discontinuous within the corresponding time length of the multiple acquisitions, and the second finger has left the terminal screen within the corresponding time length of the multiple acquisitions. From this, it can be seen that at this time, the first capacitance values collected at a certain time are all 0 and / or the second capacitance values collected at a certain time are all 0. Therefore, there may be a situation where the first capacitance values collected multiple times do not include the maximum capacitance value corresponding to the finger press, and / or the second capacitance values collected multiple times do not include the maximum capacitance value corresponding to the finger press.
[0072] In the embodiment of the present disclosure, when performing multiple periodic acquisitions, it is determined whether there is a maximum capacitance value in the first capacitance value collected in each of the multiple acquisitions and the second capacitance value collected in each of the multiple acquisitions. When the distance between the first finger pressing position and the second finger pressing position meets any distance value within the distance threshold range, if there is at least one capacitance value maximum value in the first capacitance value collected in each of the multiple acquisitions, or / and there is at least one capacitance value maximum value in the second capacitance value collected in each of the multiple acquisitions, it is determined that the first finger and the second finger are performing a two-finger discontinuous operation. In other words, when the two-finger pressing areas overlap and / or there is a risk of merging the capacitance value maximums, if the capacitance value maximums corresponding to the first finger and / or the second finger cannot be collected within a certain period of time, it indicates that the user is performing a two-finger discontinuous operation, that is, the user has lifted at least one finger during the sliding process. For example: when the user performs a two-finger pinch operation, the terminal collects the capacitance value at the finger press point at the same fixed interval. Assume that the terminal collects capacitance values at the location of two-finger press N times in a row. The capacitance values collected at the location of two-finger press in the first collection all contain the maximum capacitance value. The capacitance values collected at the location of two-finger press in the second collection have at least one value that does not contain the maximum capacitance value. Until the Nth collection, the capacitance values collected at the location of two-finger press all contain the maximum capacitance value. Therefore, if the capacitance values collected at the location of two-finger press each time do not contain the maximum capacitance value at least once, it indicates that the first and second fingers performed discontinuous two-finger operation.
[0073] In the embodiment of the present disclosure, if the terminal recognizes that the user's two-finger operation is a discontinuous operation, a finger lift (UP) event is reported and no further operation is performed.
[0074] In the present disclosure, when the terminal screen detects that the user presses the screen with two fingers, the terminal collects the capacitance values corresponding to the two fingers. The touch integrated circuit in the terminal records the first finger as ID_1 and the second finger as ID_2. When the terminal detects the maximum capacitance value at the pressing point, the terminal reports a DOWN event to the CPU, records the coordinate position of the finger on the screen, calculates the distance between the two fingers, and starts the timer. In the process of the two fingers approaching, the capacitance values corresponding to the two fingers after each preset timer duration are collected. When the distance between the two fingers at a certain moment reaches a preset distance threshold, it means that there is a risk of the two maximum capacitance values merging at this moment. In other words, there is an overlapping area between the first finger pressing position and the second finger pressing position. At this time, the touch integrated circuit will detect the capacitance values collected at all times before the risk occurs. If the maximum capacitance value corresponding to the finger press exists in the multiple first capacitance values and the multiple second capacitance values collected, it is determined that the user performed a two-finger continuous operation, that is, it indicates that the user did not lift at least one finger during the sliding process; if there is a first capacitance value that does not contain the maximum capacitance value corresponding to the finger press among the multiple first capacitance values collected, and / or there is a second capacitance value that does not contain the maximum capacitance value corresponding to the finger press among the multiple second capacitance values collected, it is determined that the user performed a two-finger discontinuous operation, that is, it indicates that the user lifted at least one finger during the sliding process. Since multiple first capacitance values and multiple second capacitance values are collected before the distance between the two-finger pressing positions reaches the distance threshold, the accuracy of the terminal's recognition of two fingers can be improved by identifying the two-finger pinch operation based on the multiple first capacitance values and the multiple second capacitance values. Only when the user performs a combined sliding operation with two fingers, the maximum and second maximum capacitance values are extracted in the overlapping area of the first finger pressing position and the second finger pressing position, and the position corresponding to the maximum capacitance value is updated to the touch position under the ID_1 identifier, and the position corresponding to the second maximum capacitance value is updated to the touch position under the ID_2 identifier. This ensures that the position of the finger pressing on the screen is not affected by external factors such as the user's finger shape, finger pressing strength, and finger combining and pinching strength, thereby accurately determining the position of the finger pressing on the screen.
[0075] Based on the same concept, an embodiment of the present disclosure also provides a device for recognizing a two-finger operation.
[0076] It is understandable that the device for recognizing two-finger operations provided by the embodiments of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of the various examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiments of the present disclosure.
[0077] Figure 7 FIG. 1 is a block diagram of a device for identifying a double-finger operation according to an exemplary embodiment. Figure 7 The device 100 can be provided as the terminal involved in the above embodiment, including a collection and monitoring unit 101 and an identification unit 102.
[0078] The acquisition and monitoring unit 101 is used to collect the first capacitance value corresponding to the first finger and the second capacitance value corresponding to the second finger in response to detecting the pressing events of the first finger and the second finger on the terminal screen, and monitor the distance between the pressing position of the first finger and the pressing position of the second finger; the identification unit 102 is used to identify the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value when the distance between the pressing position of the first finger and the pressing position of the second finger meets the set conditions.
[0079] In one embodiment, the acquisition monitoring unit 101 periodically acquires the first capacitance value corresponding to the first finger pressing position and the second capacitance value corresponding to the second finger pressing position in the following manner: when a pressing event of the first finger and the second finger on the terminal screen is detected, and in the process of the distance between the first finger pressing position and the second finger pressing position gradually decreasing, the first capacitance value corresponding to the first finger and the second capacitance value corresponding to the second finger are periodically acquired until the distance between the first finger pressing position and the second finger pressing position meets the set conditions, so as to acquire multiple first capacitance values and multiple second capacitance values.
[0080] In one embodiment, the identification unit 102 identifies the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value in the following manner: if multiple acquisitions are performed periodically, and the maximum capacitance value corresponding to the finger pressing exists in the first capacitance value acquired each time, and the maximum capacitance value corresponding to the finger pressing exists in the second capacitance value acquired each time, then it is determined that the first finger and the second finger are performing two-finger continuous operation.
[0081] In one embodiment, the identification unit 102 identifies the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value in the following manner: if multiple acquisitions are performed periodically, and there is a first capacitance value among the multiple acquired first capacitance values that does not include the maximum capacitance value corresponding to the finger press, and / or there is a second capacitance value among the multiple acquired second capacitance values that does not include the maximum capacitance value corresponding to the finger press, then it is determined that the first finger and the second finger are recognized as performing a two-finger discontinuous operation.
[0082] In one embodiment, the set condition includes that the distance between the first finger pressing position and the second finger pressing position is within a set distance threshold range.
[0083] In one embodiment, the identification unit 102 is also used to: in response to the distance between the first finger pressing position and the second finger pressing position being less than the minimum distance in the distance threshold range, and there being an overlapping area between the first finger pressing position and the second finger pressing position, determine the maximum and second maximum capacitance values in the overlapping area; determine the coordinates of the position corresponding to the maximum capacitance value as the first touch coordinates, and determine the coordinates of the position corresponding to the second maximum capacitance value as the second touch coordinates, the first touch coordinates being the touch coordinates corresponding to the first finger pressing position, and the second touch coordinates being the touch coordinates corresponding to the second finger pressing position; respond to the two-finger operation based on the first touch coordinates and the second touch coordinates, and update the first finger pressing position and the second finger pressing position.
[0084] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0085] Figure 8 2 is a block diagram illustrating an apparatus for application control according to an exemplary embodiment. For example, apparatus 200 may be provided as a terminal as described in the above embodiments. For example, it may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0086] Reference Figure 8 , apparatus 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .
[0087] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
[0088] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0089] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 200.
[0090] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0091] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.
[0092] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.
[0093] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200. The sensor assembly 214 can also detect changes in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and temperature changes of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0094] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0095] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.
[0096] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as the memory 204 including instructions, which can be executed by the processor 220 of the apparatus 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0097] It is further understood that although operations are described in a particular order in the drawings in the embodiments of the present disclosure, this should not be construed as requiring that the operations be performed in the particular order shown or in a serial order, or that all of the operations shown be performed to obtain the desired results. In certain circumstances, multitasking and parallel processing may be advantageous.
[0098] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein.
[0099] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.
Claims
1. A method for identifying a two-finger operation, characterized in that: Applied to terminals, including: In response to detecting a press event of a first finger and a second finger on the terminal screen, collecting a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger, and monitoring a distance between a pressing position of the first finger and a pressing position of the second finger; When the distance between the first finger pressing position and the second finger pressing position meets a set condition, identifying the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value; The collecting of a first capacitance value corresponding to the first finger pressing position and a second capacitance value corresponding to the second finger pressing position includes: When a first finger and a second finger are detected pressing the terminal screen, and as the distance between the first finger pressing position and the second finger pressing position gradually decreases, periodically collecting a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger until the distance between the first finger pressing position and the second finger pressing position meets a set condition, thereby collecting a plurality of first capacitance values and a plurality of second capacitance values; The identifying operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value includes: If multiple acquisitions are performed periodically, and the maximum capacitance value corresponding to the finger pressing is present in each of the first capacitance values acquired, and the maximum capacitance value corresponding to the finger pressing is present in each of the second capacitance values acquired, it is determined that the first finger and the second finger are recognized to be performing a continuous two-finger operation; If multiple acquisitions are performed periodically, and there is a first capacitance value among the multiple acquired first capacitance values that does not include the maximum capacitance value corresponding to finger pressing, and / or there is a second capacitance value among the multiple acquired second capacitance values that does not include the maximum capacitance value corresponding to finger pressing, then it is determined that the first finger and the second finger are recognized as performing two-finger discontinuous operation.
2. The method according to claim 1, characterized in that The set condition includes that the distance between the first finger pressing position and the second finger pressing position is within a set distance threshold range.
3. The method according to claim 2, characterized in that The method further comprises: In response to the distance between the first finger pressed position and the second finger pressed position being less than a minimum distance in the distance threshold range, and the first finger pressed position and the second finger pressed position having an overlapping area, determining a maximum capacitance value and a second maximum capacitance value in the overlapping area; Determine the coordinates of the position corresponding to the maximum capacitance value as the first touch coordinates, and determine the coordinates of the position corresponding to the second maximum capacitance value as the second touch coordinates, the first touch coordinates being the touch coordinates corresponding to the position pressed by the first finger, and the second touch coordinates being the touch coordinates corresponding to the position pressed by the second finger; The first touch coordinate and the second touch coordinate are used to respond to a two-finger operation and update the first finger pressing position and the second finger pressing position.
4. A device for identifying two-finger operation, characterized in that: Applied to terminals, including: a collection and monitoring unit, configured to, in response to detecting a pressing event of a first finger and a second finger on the terminal screen, regularly collect a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger, and monitor a distance between a pressing position of the first finger and a pressing position of the second finger; an identification unit, configured to identify operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value when a distance between the first finger pressing position and the second finger pressing position meets a set condition; The acquisition monitoring unit periodically acquires a first capacitance value corresponding to the first finger pressing position and a second capacitance value corresponding to the second finger pressing position in the following manner: When a first finger and a second finger are detected pressing the terminal screen, and as the distance between the first finger pressing position and the second finger pressing position gradually decreases, periodically collecting a first capacitance value corresponding to the first finger and a second capacitance value corresponding to the second finger until the distance between the first finger pressing position and the second finger pressing position meets a set condition, thereby collecting a plurality of first capacitance values and a plurality of second capacitance values; The recognition unit recognizes the operations corresponding to the first finger and the second finger based on the first capacitance value and the second capacitance value in the following manner: If multiple acquisitions are performed periodically, and the maximum capacitance value corresponding to the finger pressing is present in each of the first capacitance values acquired, and the maximum capacitance value corresponding to the finger pressing is present in each of the second capacitance values acquired, it is determined that the first finger and the second finger are recognized to be performing a continuous two-finger operation; If multiple acquisitions are performed periodically, and there is a first capacitance value among the multiple acquired first capacitance values that does not include the maximum capacitance value corresponding to finger pressing, and / or there is a second capacitance value among the multiple acquired second capacitance values that does not include the maximum capacitance value corresponding to finger pressing, then it is determined that the first finger and the second finger are recognized as performing two-finger discontinuous operation.
5. The device according to claim 4, characterized in that The set condition includes that the distance between the first finger pressing position and the second finger pressing position is within a set distance threshold range.
6. The device according to claim 4, characterized in that The identification unit is further configured to: In response to the distance between the first finger pressed position and the second finger pressed position being less than a minimum distance in the distance threshold range, and the first finger pressed position and the second finger pressed position having an overlapping area, determining a maximum capacitance value and a second maximum capacitance value in the overlapping area; Determine the coordinates of the position corresponding to the maximum capacitance value as the first touch coordinates, and determine the coordinates of the position corresponding to the second maximum capacitance value as the second touch coordinates, the first touch coordinates being the touch coordinates corresponding to the position pressed by the first finger, and the second touch coordinates being the touch coordinates corresponding to the position pressed by the second finger; The first touch coordinate and the second touch coordinate are used to respond to a two-finger operation and update the first finger pressing position and the second finger pressing position.
7. A device for identifying two-finger operation, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method according to any one of claims 1 to 3.
8. A computer-readable storage medium, characterized in that The storage medium stores instructions, and when the instructions in the storage medium are executed by the processor of the mobile terminal, the mobile terminal is enabled to execute the method according to any one of claims 1 to 3.
Citation Information
Patent Citations
Gesture interaction device and method
CN106572254A
Information processing method and electronic equipment
CN106997283A