Method and apparatus for determining touch points on the edge of a touch screen

Abstract

This application proposes a method and apparatus for determining edge touch points on a touchscreen, belonging to the field of touch technology. The method includes: when a touch operation enters from the target edge of the touchscreen, acquiring first position information of a measured first touch point and second position information of a predicted second touch point; determining a candidate starting touch point for the touch operation based on the first and second position information; and, in response to the candidate starting touch point overflowing the touchscreen, determining an edge touch point at the target edge of the touch operation, wherein the edge touch point is the target starting touch point of the touch operation. In the embodiments of this application, edge touch points can be determined in edge-sliding scenarios, thereby correcting the first measured touch point, ensuring that the first touch point of the touch operation is located at the edge of the touchscreen, and accurately responding to edge-sliding touch operations.

Description

Technical Field

[0001] This application relates to the field of touch technology, and in particular to a method and apparatus for determining edge touch points of a touch screen. Background Technology

[0002] When a touch operation slides in from the edge of the touchscreen, the first touch point may not be located at the edge of the touchscreen due to limitations in the touch detection algorithm or the detection sensor, resulting in an inability to accurately respond to the touch operation. Summary of the Invention

[0003] This application provides a method and apparatus for determining edge touch points of a touch screen.

[0004] The first aspect of this application provides a method for determining edge touch points of a touchscreen, including:

[0005] When a touch operation enters from the target edge of the touchscreen, the first position information of the first measured touch point and the second position information of the second touch point predicted by the Kalman filter are obtained.

[0006] Based on the first location information and the second location information, a candidate starting touch point for the touch operation is determined;

[0007] In response to the candidate starting touch point overflowing the touchscreen, an edge touch point of the touch operation is determined at the target edge, wherein the edge touch point is the target starting touch point of the touch operation.

[0008] In this embodiment, based on the measured position information of the first touch point and the predicted position information of the second touch point, a candidate starting touch point for a touch operation can be calculated. Furthermore, if the candidate starting touch point overflows the outer area of ​​the touchscreen, an edge touch point at the sliding edge is redefined as the actual target starting touch point for the touch operation. In this embodiment, the edge touch point can be determined in the edge sliding scenario, thereby correcting the first measured touch point. This ensures that the first touch point of the touch operation is located at the edge of the touchscreen, enabling accurate response to edge sliding touch operations.

[0009] A second aspect of this application provides a device for determining edge touch points of a touchscreen, comprising:

[0010] The first acquisition module is used to acquire the first position information of the first measured touch point and the second position information of the second touch point predicted by the Kalman filter when the touch operation enters from the target edge of the touch screen.

[0011] The first determining module is used to determine the candidate starting touch point of the touch operation based on the first location information and the second location information;

[0012] The second determining module is used to determine the edge touch point of the touch operation at the target edge when the candidate starting touch point overflows the touch screen, wherein the edge touch point is the target starting touch point of the touch operation.

[0013] A third aspect of this application provides an electronic device, including: a device for determining edge touch points of a touch screen as described in a second aspect of this application.

[0014] A fourth aspect of this application provides a touch chip, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the touch point determination method for the edge of a touch screen proposed in the first aspect of this application.

[0015] A fifth aspect of this application provides a non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform the method proposed in the first aspect of this application.

[0016] A sixth aspect of this application provides a computer program product including a computer program that, when executed by a processor in a communication device, implements the method proposed in the first aspect of this application.

[0017] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0018] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0019] Figure 1 A flowchart illustrating a method for determining edge touch points of a touchscreen provided in an embodiment of this application;

[0020] Figure 2 A flowchart illustrating another method for determining touch points at the edge of a touchscreen provided in an embodiment of this application;

[0021] Figure 3 An example diagram illustrating a method for determining edge touch points of a touchscreen provided in an embodiment of this application;

[0022] Figure 4 A flowchart illustrating another method for determining touch points at the edge of a touchscreen provided in an embodiment of this application;

[0023] Figure 5 A flowchart illustrating another method for determining touch points at the edge of a touchscreen provided in an embodiment of this application;

[0024] Figure 6 A flowchart illustrating another method for determining touch points at the edge of a touchscreen provided in an embodiment of this application;

[0025] Figure 7 A flowchart illustrating another method for determining touch points at the edge of a touchscreen provided in an embodiment of this application;

[0026] Figure 8 This is a schematic diagram of the structure of a device for determining edge touch points of a touch screen provided in an embodiment of this application;

[0027] Figure 9 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application;

[0028] Figure 10 This is a schematic diagram of the structure of another electronic device provided according to an embodiment of this application;

[0029] Figure 11 This is a schematic diagram of the structure of a touch chip according to an embodiment of this application. Detailed Implementation

[0030] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with those of this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the embodiments of this application as detailed in the appended claims.

[0031] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the embodiments of this application. The singular forms “a” and “the” as used in the embodiments of this application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0032] It should be understood that although the terms first, second, third, etc., may be used to describe various information in the embodiments of this application, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the embodiments of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the words "if" and "suppose" as used herein can be interpreted as "when," "when," or "in response to a determination."

[0033] Embodiments of this application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0034] The method and apparatus for determining touch points at the edge of a touchscreen according to embodiments of this application are described below with reference to the accompanying drawings.

[0035] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating a method for determining edge touch points on a touchscreen, as provided in an embodiment of this application. Figure 1 As shown, the method includes, but is not limited to, the following steps:

[0036] S101, when the touch operation enters from the target edge of the touch screen, acquire the first position information of the first touch point measured in the experiment and the second position information of the second touch point predicted by the Kalman filter.

[0037] The method for determining touch points on the edge of a touchscreen provided in this application can be applied to electronic devices with touchscreens. For example, the electronic device can be a mobile phone, tablet computer, laptop, wearable device, smart TV, in-vehicle computer, etc.

[0038] In this embodiment of the application, the electronic device can perform trajectory tracking on the touch screen. In some implementations, an under-screen sensor can be provided below the touch screen of the electronic device. The under-screen sensor can detect touch points and then track the touch trajectory.

[0039] Touchscreens can track touch points using a Kalman filter, which outputs the predicted position information of the touch points. In this embodiment, when a touch operation slides into the touchscreen from a target edge, the first touch point and its first position information can be detected by an under-display sensor. Furthermore, the Kalman filter can predict the next touch point, i.e., the second touch point, based on the first position information, thus obtaining the second position information of the second touch point.

[0040] Optionally, the touch operation can be slid in from the top edge, bottom edge, left edge, or right edge of the electronic device. In this embodiment, the edge into which the touch operation is slid in is called the target edge. For example, when a user tries to display a notification message on an electronic device, the notification message needs to be brought up and displayed on the screen by the user from the top edge of the electronic device through a swipe-down touch operation. In this case, the top edge of the electronic device can be called the target edge.

[0041] S102, determine the candidate starting touch point for the touch operation based on the first position information and the second position information.

[0042] Due to the lag in touch detection algorithms or the hardware sensitivity of screen sensors, the first touch point measured often differs from the actual starting touch point of the touch operation. It should be noted that in this embodiment, the actual starting touch point of the touch operation can be referred to as the target starting touch point. This definition applies to subsequent embodiments of this application and will not be further elaborated upon.

[0043] In this embodiment of the application, in order to obtain the target starting touch point of the touch operation, a candidate starting touch point of the touch operation can be determined based on the first position information and the second position information.

[0044] In practice, users often perform continuous swiping motions on a touchscreen to form a touch operation. During this swiping process, touch point detection is typically performed at fixed intervals. Therefore, a candidate starting touch point can be determined based on a first distance between the first and second position information. For example, a position point at a distance from the first touch point can be selected as a candidate starting touch point based on the first distance between the first and second position information.

[0045] S103, responding to the overflow of candidate starting touch points on the touch screen, determine the edge touch point at the target edge of the touch operation, where the edge touch point is the target starting touch point of the touch operation.

[0046] It should be noted that the identified candidate starting touch point may or may not be the target starting touch point of the touch operation.

[0047] Optionally, if the candidate starting touch point is within the touch screen, it can be determined that the candidate starting touch point is the target starting touch point of the touch operation; if the candidate starting touch point is not within the touch screen, that is, the candidate starting touch point overflows the touch screen, it can be determined that the candidate starting touch point is not the target starting touch point of the touch operation.

[0048] When a candidate starting touch point overflows the touchscreen, in order to accurately respond to touch operations, this embodiment of the application can re-determine the edge touch point at the target edge for the touch operation. It should be noted that the edge touch point is the target touch point. By determining the target starting touch point, the response accuracy of edge-swipe-in ​​touch operations can be improved. For example, the accurate response rate of the top edge drop-down menu or the bottom edge drop-up menu can be improved.

[0049] Optionally, the touch direction of the touch operation can be determined based on any two of the first touch point, the second touch point, and the candidate starting touch point. The intersection of the touch direction and the target edge can then be determined to obtain the edge touch point of the target edge, which is the target starting touch point of the touch operation.

[0050] As one possible implementation, the touch direction of the touch operation can be determined based on the first position information and the second position information. Furthermore, the touch direction is extended to the target edge. During the extension process, the touch direction will intersect with the target edge. In this embodiment, the intersection of the touch direction and the target edge is determined as the edge touch point.

[0051] As another possible implementation, candidate starting position information of candidate starting touch points can be obtained. Further, based on the candidate starting position and the first position information, the touch direction of the touch operation can be determined, and the intersection of the touch direction and the target edge can be identified as the edge touch point. Optionally, based on the candidate starting position and the second position information, the touch direction of the touch operation can be determined, and the intersection of the touch direction and the target edge can be identified as the edge touch point.

[0052] In this embodiment, based on the measured position information of the first touch point and the predicted position information of the second touch point, a candidate starting touch point for a touch operation can be calculated. Furthermore, if the candidate starting touch point overflows the outer area of ​​the touchscreen, an edge touch point at the sliding edge is redefined as the actual target starting touch point for the touch operation. In this embodiment, the edge touch point can be determined in the edge sliding scenario, thereby correcting the first measured touch point. This ensures that the first touch point of the touch operation is located at the edge of the touchscreen, enabling accurate response to edge sliding touch operations.

[0053] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating a method for determining edge touch points on a touchscreen, as provided in an embodiment of this application. Figure 2 As shown, the method includes, but is not limited to, the following steps:

[0054] S201, when a touch operation enters from the target edge of the touch screen, acquire the first position information of the first measured touch point and the second position information of the second touch point predicted by the Kalman filter.

[0055] For a detailed description of step S201, please refer to the description in the above embodiments, which will not be repeated here.

[0056] S202, based on the first position information and the second position information, determine the first distance between the first touch point and the second touch point and the touch direction of the touch operation.

[0057] S203, starting from the first position information, extend the first distance in the opposite direction along the touch direction to obtain the candidate starting touch point.

[0058] S204, in response to the candidate starting touch point overflowing the touch screen, determine the edge touch point of the touch operation at the target edge, wherein the edge touch point at the target edge is the target starting touch point of the touch operation.

[0059] refer to Figure 3 Firstly, the touch operation can slide from the target edge 10 of the touchscreen into the interior of the touchscreen, allowing for the measurement of the first position information of the first touch point 11. A Kalman filter can then predict the position information of the second touch point 12. After determining the first and second position information, a first distance Dis between the first touch point 11 and the second touch point 12 can be determined based on this information. This first distance Did is the distance the touch point moves within one detection cycle. Furthermore, the touch direction of the touch operation can be determined based on the first and second position information, where the touch direction is from the first touch point 11 to the second touch point 12.

[0060] Secondly, after obtaining the first distance Dis and the touch direction, since the touch operation moves from the edge to the second touch point 12, in this embodiment, in order to determine the starting touch point of the touch operation, starting from the first position information, the first distance can be extended in the opposite direction along the touch direction to obtain the candidate starting touch point 13 of the touch operation. That is, starting from the first touch point 11, the movement moves in the opposite direction along the touch direction towards the target edge until the distance reached is the first distance. The movement in the opposite direction stops at the position where the first distance is reached. Furthermore, the stopping position is determined as the candidate starting touch point 13 of the touch operation.

[0061] Continue to refer to Figure 3Since the candidate starting touch point 13 is located outside the touchscreen, i.e., it overflows the touchscreen, in this embodiment, the target starting touch point 14 at the target edge can be redefined for the touch operation based on any two of the first touch point, the second touch point, and the candidate starting touch point. The process of re-determining the target starting touch point 14 can be found in the relevant descriptions in the above embodiments, and will not be repeated here.

[0062] In this embodiment of the application, the edge touch point can be determined in the edge sliding-in scenario, and then the first measured touch point can be corrected so that the first touch point of the touch operation is located at the edge of the touch screen, and the touch operation of edge sliding-in can be responded to accurately.

[0063] Based on the above embodiments, a new target starting touch point is determined for the touch operation. The distance between the target starting touch point and the second touch point becomes larger. When subsequent predictions are made based on the target starting position information of the target starting touch point, the prediction process of the Kalman filter may have a large error. In order to avoid prediction errors caused by the target starting touch point, the prediction process of the Kalman filter needs to be compensated in this embodiment.

[0064] Please refer to Figure 4 , Figure 4 This is a flowchart illustrating a method for determining edge touch points on a touchscreen, as provided in an embodiment of this application. After obtaining the target starting touch point, as... Figure 4 As shown, the method includes, but is not limited to, the following steps:

[0065] S401, Obtain the target starting position information of the target starting touch point.

[0066] In this embodiment of the application, when the target starting touch point is determined, the target starting position information of the target starting touch point can be obtained.

[0067] S402, based on the second position information and the target starting position information, the starting velocity information of the target starting touch point is updated by the Kalman filter.

[0068] After obtaining the second position information and the target starting position information, the second distance between the second touch point and the target starting touch point can be determined. For example... Figure 3 That is, the second distance between the second touch point 12 and the target starting touch point 14.

[0069] Furthermore, the first movement time required to move the target starting touch point to the second touch point can be determined.

[0070] Optionally, a timer can be used to time the movement, starting from the detection of a touch operation. The timer's duration can be used to determine the first movement time after the second touch point is reached. (Continue to refer to...) Figure 3 The first movement time is the movement time required for the target starting touch point 14 to move to the second touch point 12.

[0071] Furthermore, based on the second distance and the first movement time, the starting velocity information of the target starting touch point is updated, that is, the ratio of the second distance to the first movement time is used to update the starting velocity information of the target starting touch point.

[0072] In this embodiment, the initial velocity information of the target starting touch point is updated by a Kalman filter. This initial velocity information can provide a basis for the velocity compensation of the digital filter and the position compensation of the Kalman filter, thereby improving the prediction accuracy of subsequent touch points.

[0073] Figure 5 This is a flowchart illustrating a method for determining edge touch points on a touchscreen, as provided in an embodiment of this application. After obtaining the target starting touch point, as... Figure 5 As shown, the method includes, but is not limited to, the following steps:

[0074] S501, Obtain the target starting position information of the target starting touch point.

[0075] S502, based on the second position information and the target starting position information, the Kalman filter updates the starting velocity information of the target starting touch point.

[0076] For a detailed description of steps S501 to S502, please refer to the relevant content in the above embodiments, which will not be repeated here.

[0077] S503 uses a digital filter to compensate for the position information from the second touch point to the i-th touch point output by the Kalman filter, based on the initial velocity information and the target initial position information.

[0078] In this embodiment, since the distance between the target starting touch point and the second touch point is increased after redetermining the target starting position information, the predicted position and velocity of the Kalman filter will change when subsequent prediction is made based on the target starting position information of the target starting touch point, which may cause a large error in the prediction process. In order to avoid the occurrence of a large prediction error, this embodiment can also perform position prediction by digital filter, and compensate the predicted position of Kalman filter by the predicted position of digital filter.

[0079] For the j-th touch point, the digital filter outputs the velocity information of the j-th touch point based on the initial velocity information and the target initial position information. Further, the second movement time from the (j-1)-th touch point to the j-th touch point is obtained, and the position information of the j-th touch point output by the Kalman filter is compensated based on the velocity information of the j-th touch point and the second movement time.

[0080] Optionally, the process of compensating for the position information of the j-th touch point output by the Kalman filter includes:

[0081] Based on the updated velocity information and second movement time of the j-th touch point output by the digital filter, the first candidate position information of the j-th touch point output by the digital filter is determined. In this embodiment, while the digital filter is making predictions, the Kalman filter is also making synchronous predictions to obtain the second candidate position information of the j-th touch point output by the Kalman filter. After obtaining the first and second candidate positions of the j-th touch point, the first and second candidate positions can be compared.

[0082] If the difference between the first candidate position information and the second candidate position information of the j-th touch point is not within the set error range, then the first candidate position information is updated to the target position information of the j-th touch point output by the Kalman filter.

[0083] Understandably, during the compensation process of the digital filter for the Kalman filter, the digital filter can output a first candidate position for each current touch point, and the Kalman filter simultaneously outputs a second candidate position for that same touch point. After acquiring the first and second candidate position information of the current touch point, the second position difference between the first and second candidate position information can be determined. If the second position difference is within a set error range, the compensation process for the position information of the next touch point output by the digital filter for the Kalman filter ends. The next touch point corresponding to the end of the position information compensation process is the same touch point as the (i+1)th touch point.

[0084] It should be noted that if the difference between the first candidate position information and the second candidate position information of the j-th touch point is within the set error range, the compensation process of the digital filter can be terminated, and the j-th touch point is the i-th touch point.

[0085] In this embodiment, position compensation is performed on the subsequent touch points of the Kalman filter based on a digital filter. This allows for a smooth transition in the positions of the subsequent touch points, maintaining a continuous and gentle form of touch operation on the underlying layer of the touchscreen. This facilitates rapid touch operation response and reduces touch operation response time. Furthermore, compensating for the positions of the subsequent touch points further reduces the accumulation of prediction errors, improves the accuracy of subsequent predictions, and ensures the accuracy of touch operation response.

[0086] Figure 6 This is a flowchart illustrating a method for determining edge touch points on a touchscreen, as provided in an embodiment of this application. After obtaining the target starting touch point, as... Figure 6 As shown, the method includes, but is not limited to, the following steps:

[0087] S601, when a touch operation enters from the target edge of the touch screen, acquires the first position information of the first measured touch point and the second position information of the second touch point predicted by the Kalman filter.

[0088] For a detailed description of step S601, please refer to the description in the above embodiments, which will not be repeated here.

[0089] S602, determine whether to execute the process of determining the touch point at the edge of the touch screen.

[0090] If the process for determining the touch point at the edge of the touchscreen is executed, then step S603 is executed; otherwise, the process for determining the touch point at the edge of the touchscreen is skipped, and the prediction of the next touch point continues.

[0091] S603, determine the candidate starting touch point for the touch operation based on the first position information and the second position information.

[0092] S604, in response to the candidate starting touch point overflowing the touch screen, update the target starting touch point of the touch operation at the target edge.

[0093] For a detailed description of steps S602 to S604, please refer to the description in the above embodiments, which will not be repeated here.

[0094] S605, based on the second position information and the target starting position information of the target starting touch point, the starting velocity information of the target starting touch point is updated by the Kalman filter.

[0095] S606, enters the process of compensating the predicted position of the Kalman filter using a digital filter.

[0096] Since the distance between the newly determined target starting touch point and the second touch point has increased, the prediction process of the Kalman filter may have a large error. In order to avoid the occurrence of a large prediction error, the prediction position of the touch point in the first few frames of the Kalman filter can be compensated by the prediction position of the digital filter. That is, the position information from the second touch point to the i-th touch point can be compensated.

[0097] S607, For the j-th touch point, the digital filter determines the filter coefficients of the digital filter corresponding to the j-th touch point based on the touch duration corresponding to the j-th touch point.

[0098] Where j is a positive integer greater than or equal to 2 and less than or equal to i, that is, the j-th touch point can be the second touch point, the ith touch point, or a touch point between the second touch point and the ith touch point.

[0099] Optionally, the process of determining the filter coefficients of the digital filter includes: obtaining the touch duration; after obtaining the touch duration, the filter coefficients of the digital filter can be obtained based on the ratio of the set update rate and the touch duration.

[0100] For example, the update rate can be set to 256, the touch duration to t, and the filter coefficients f of the digital filter can be determined using the following formula: f = 256 / t. In some implementations, the touch duration can be timed using a timer, starting from the moment the touch begins, and the current time of the timer is the touch duration.

[0101] In this embodiment, the filter coefficients of the digital filter are negatively correlated with the touch duration. That is, the longer the touch time, the smaller the filter coefficients of the digital filter, and correspondingly, the compensation of the digital filter for speed and position will gradually decrease.

[0102] S608 determines the speed information of the j-th touch point based on the filter coefficients, the initial speed information, and the speed information of the (j-1)-th touch point.

[0103] Optionally, after the filter coefficients of the digital filter, the speed information of the j-th touch point is determined based on the filter coefficients, the initial speed information, and the speed information of the (j-1)-th touch point. In some implementations, the speed difference between the speed information of the (j-1)-th touch point and the initial speed information is obtained, the speed difference is multiplied by the filter coefficients, and the product is added to the speed information of the (j-1)-th touch point to obtain the speed information of the j-th touch point.

[0104] For example, setting the speed information V of the j-th touch point. j Then V j=V0+(V j-1 -V0)*f, where V0 represents the initial velocity information and f represents the filter coefficients of the digital filter.

[0105] S609, obtain the second movement time from the (j-1)th touch point to the jth touch point.

[0106] S610, based on the speed information of the j-th touch point and the second movement time, compensates for the position information of the j-th touch point output by the Kalman filter.

[0107] Based on the updated velocity information and second movement time of the j-th touch point output by the digital filter, the first candidate position information of the j-th touch point output by the digital filter is determined. In this embodiment, while the digital filter is making predictions, the Kalman filter is also making synchronous predictions to obtain the second candidate position information of the j-th touch point output by the Kalman filter. After obtaining the first and second candidate positions of the j-th touch point, the first and second candidate positions can be compared.

[0108] If the difference between the first candidate position information and the second candidate position information of the j-th touch point is not within the set error range, then the first candidate position information is updated to the target position information of the j-th touch point output by the Kalman filter.

[0109] It is understandable that if the difference between the first candidate position information and the second candidate position information of the j-th touch point is within the set error range, the compensation process of the digital filter can be terminated, and the j-th touch point is the i-th touch point.

[0110] In this embodiment, position compensation for subsequent touch points using a digital filter on the Kalman filter ensures a smooth transition in the positions of these touch points. This maintains a continuous and gentle touch operation on the underlying touchscreen, facilitating faster response and reducing touch operation response time. Furthermore, compensating for the positions of subsequent touch points reduces the accumulation of prediction errors, improves the accuracy of subsequent predictions, and guarantees the accuracy of touch operation response. Moreover, after compensating the first touch point to the edge, simultaneous IIR filtering updates to the speed avoid the problem of large Kalman filter errors caused by excessive speed of the first touch point. In this embodiment, by applying IIR filtering to the speed of the touch points in the preceding frames, speed changes become smoother, reducing the impact of errors caused by compensation in the first frame.

[0111] In this embodiment, a Kalman filter and a digital filter are used interactively to predict touch points. Building upon the previous embodiment, the position compensation process of the digital filter ends after the digital filter has completed compensation for the first few touch points compared to the Kalman filter. Subsequent steps can be followed... Figure 7 Subsequent touch point predictions are performed, with a Kalman filter for position prediction and an Infinite Impulse Response (IIR) digital filter for velocity tracking.

[0112] Optionally, each processing cycle may include the following steps:

[0113] S701, the IIR digital filter updates the current speed.

[0114] v t =(v t,p *level+(v t-1,p -v t,p )*factor) / level;

[0115] Among them, v t v represents the current velocity after the IIR digital filter is updated. t,p This indicates the current predicted velocity output by the Kalman filter, v. t-1,p This represents the previous prediction rate of the Kalman filter output, factor represents the filter coefficients of the digital filter, and level represents the speed gain of the digital filter.

[0116] S702, the IIR digital filter updates the current square root of the velocity.

[0117] The velocity square root can be used to provide the roll-off factor of a filter, which can be used to eliminate or improve low-speed jitter during touch tracking. In the embodiments of this application, the velocity square root can be tracked or updated based on the IIR filter to eliminate the adverse effects of drastic changes in the measured value.

[0118] S703, determine the current position error and velocity error.

[0119] The IIR digital filter can obtain the current measurement position and measurement speed, determine the position error based on the measurement position and predicted position, and determine the position error based on the measurement speed and update speed.

[0120] S704, determine the current position measurement covariance and velocity measurement covariance.

[0121] The current measurement position and measurement speed can be obtained. Furthermore, based on the previous measurement position and the current measurement position, the position measurement covariance can be obtained, and based on the previous measurement speed and the current measurement speed, the speed measurement covariance can be obtained.

[0122] S705, obtain the current position gain of the Kalman filter, position gain = position covariance / (position covariance + position measurement covariance).

[0123] In this embodiment of the application, the position covariance can be updated by a Kalman filter. Optionally, the Kalman filter determines the position covariance based on the previous predicted position and the current predicted position.

[0124] S706, obtain the current velocity gain of the Kalman filter, velocity gain = velocity covariance / (velocity covariance + velocity measurement covariance).

[0125] In this embodiment, the velocity covariance can be updated by a Kalman filter. Optionally, the Kalman filter determines the velocity covariance based on the previous predicted velocity and the current predicted velocity.

[0126] A Kalman filter can predict the location of a touch point in the next processing cycle based on the current touch position and velocity. When an update to the next touch point measurement is detected, the position and velocity gain factors can be updated, with the position gain factor used to calculate the filtered position information.

[0127] It should be noted that a higher gain factor biases the results towards the measured position, while a lower gain factor biases the results towards the predicted position. Furthermore, high position gain and low velocity gain are required for high-speed swipe-in ​​touch operations, while low position gain and high velocity gain are required for low-speed swipe-in ​​touch operations. To meet these requirements, position gain is directly proportional to the tracking speed, and velocity gain is inversely proportional to the tracking speed.

[0128] S707, Determine the filtering position. Filtering position = Predicted position + Position gain * Position error.

[0129] S708, the Kalman filter updates the current prediction rate, prediction rate = prediction rate of the IIR digital filter + rate gain * rate error.

[0130] S709, the Kalman filter updates the current predicted position, predicted position = filtered position + prediction speed * time interval.

[0131] S710, update the position covariance and velocity covariance, and return to S701.

[0132] In this embodiment, a Kalman filter and a digital filter are used together to predict the touch point. The prediction results of the two filters influence each other, which can improve the accuracy of the prediction.

[0133] It should be noted that the embodiments provided in this application can be applied to touch fields such as trajectory prediction, touch point tracking, gesture prediction, stroke recognition, and handwriting recognition.

[0134] Figure 8 This is a schematic diagram of the structure of a touchscreen edge touch point determination device according to an embodiment of this application. Figure 8 As shown, the touchscreen edge touch point determination device 800 includes: a first acquisition module 801, a first determination module 802, and a second determination module 803, wherein...

[0135] The first acquisition module 801 is used to acquire the first position information of the first measured touch point and the second position information of the second touch point predicted by the Kalman filter when the touch operation enters from the target edge of the touch screen.

[0136] The first determining module 802 is used to determine the candidate starting touch point of the touch operation based on the first location information and the second location information.

[0137] The second determining module 803 is used to determine the edge touch point of the touch operation at the target edge when the candidate starting touch point overflows the touch screen, wherein the edge touch point is the target starting touch point of the touch operation.

[0138] In this embodiment, based on the measured position information of the first touch point and the predicted position information of the second touch point, a candidate starting touch point for a touch operation can be calculated. Furthermore, if the candidate starting touch point overflows the outer area of ​​the touchscreen, an edge touch point at the sliding edge is redefined as the actual target starting touch point for the touch operation. In this embodiment, the edge touch point can be determined in the edge sliding scenario, thereby correcting the first measured touch point. This ensures that the first touch point of the touch operation is located at the edge of the touchscreen, enabling accurate response to edge sliding touch operations.

[0139] In some embodiments, the second determining module 803 is further configured to: determine the touch direction of the touch operation based on the first position information and the second position information; extend the touch direction toward the target edge, wherein the touch direction intersects with the target edge; and determine the intersection of the touch direction and the target edge as the edge touch point.

[0140] In some embodiments, the second determining module 803 is further configured to: determine the touch direction of the touch operation based on the candidate starting position information of the candidate starting touch point and the first position information, and determine the intersection of the touch direction and the target edge as the edge touch point.

[0141] In some embodiments, the first determining module 802 is further configured to: determine a first distance between the first touch point and the second touch point and the touch direction of the touch operation based on the first location information and the second location information; and extend the first distance in the opposite direction from the first location information to obtain the candidate starting touch point.

[0142] In some embodiments, the touch screen edge touch point determination device 800 further includes: a second acquisition module 804, an update module 805, and a compensation module 806.

[0143] The second acquisition module 804 is used to acquire the target starting position information of the target starting touch point after determining the target starting touch point.

[0144] The update module 805 is used to update the initial velocity information of the target initial touch point by the Kalman filter according to the second position information and the target initial position information.

[0145] In some embodiments, the update module 805 is further configured to: determine a second distance between the second touch point and the target starting touch point based on the second position information and the target starting position information; obtain a first movement time required for the target starting touch point to move to the second touch point; and update the starting velocity information of the target starting touch point by the Kalman filter based on the second distance and the first movement time.

[0146] In some embodiments, the compensation module 805 is used to, after updating the initial velocity information of the target starting touch point, use a digital filter to compensate the position information from the second touch point to the i-th touch point output by the Kalman filter based on the initial velocity information and the target starting position information, where i is a positive integer greater than 2.

[0147] In some embodiments, the compensation module 805 is further configured to: for the j-th touch point, the digital filter outputs the speed information of the j-th touch point based on the starting speed information and the target starting position information; obtain the second movement time of the (j-1)-th touch point moving to the j-th touch point; and compensate the position information of the j-th touch point output by the Kalman filter based on the speed information of the j-th touch point and the second movement time.

[0148] In some embodiments, the compensation module 805 is further configured to: determine the first candidate position information of the j-th touch point output by the digital filter based on the updated speed information of the j-th touch point and the second movement time; obtain the second candidate position information of the j-th touch point output by the Kalman filter; and if the first position difference between the first candidate position information and the second candidate position information of the j-th touch point is not within a set error range, update the first candidate position information to the target position information of the j-th touch point output by the Kalman filter.

[0149] In some embodiments, the compensation module 805 is further configured to: for the j-th touch point, determine the filter coefficients of the digital filter corresponding to the j-th touch point based on the touch duration corresponding to the j-th touch point, where j is a positive integer greater than or equal to 2 and less than or equal to i; and determine the speed information of the j-th touch point based on the filter coefficients, the starting speed information, and the speed information of the (j-1)-th touch point.

[0150] In some embodiments, the filter coefficients are negatively correlated with the touch duration.

[0151] In some embodiments, the compensation module 805 is further configured to: obtain the speed difference between the speed information of the (j-1)th touch point and the starting speed information; obtain the speed difference multiplied by the filter coefficient, and add the product to the speed information of the (j-1)th touch point to obtain the speed information of the j-th touch point.

[0152] In some embodiments, the compensation module 805 is further configured to: obtain a first candidate position of the current touch point output by the digital filter and a second candidate position of the current touch point output by the Kalman filter; obtain a second position difference between the first candidate position information and the second candidate position information of the current touch point; if the second position difference is within the set error range, then end the compensation process of the digital filter for the position information of the next touch point output by the Kalman filter, wherein the next touch point corresponding to the end of the position information compensation process is the same touch point as the (i+1)th touch point.

[0153] It should be noted that for details not disclosed in the touch screen edge touch point determination device of the embodiments of this application, please refer to the details disclosed in the touch screen edge touch point determination method of the above embodiments of this application, which will not be repeated here.

[0154] In this embodiment, position compensation is performed on the subsequent touch points of the Kalman filter based on a digital filter. This allows for a smooth transition in the positions of the subsequent touch points, maintaining a continuous and gentle form of touch operation on the underlying layer of the touchscreen. This facilitates rapid touch operation response and reduces touch operation response time. Furthermore, compensating for the positions of the subsequent touch points further reduces the accumulation of prediction errors, improves the accuracy of subsequent predictions, and ensures the accuracy of touch operation response.

[0155] Figure 9 This is a block diagram of an electronic device according to an exemplary embodiment. For example... Figure 9 As shown, the electronic device 900 includes a touch trajectory prediction device 800. This electronic device can be a mobile electronic device or a non-mobile electronic device. For example, mobile electronic devices can be mobile phones, tablets, laptops, PDAs, in-vehicle electronic devices, wearable devices, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), etc., while non-mobile electronic devices can be network-attached storage (NAS), personal computers (PCs), televisions (TVs), ATMs, or self-service machines, etc. This application embodiment does not specifically limit the scope of the device.

[0156] According to an embodiment of this application, an electronic device is also provided, including: a processor; and a memory for storing processor-executable instructions, wherein the processor is configured to execute the instructions to implement the method for determining touch points at the edge of a touchscreen as described above.

[0157] To implement the above embodiments, this application also proposes a storage medium.

[0158] When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the method for determining the touch point at the edge of the touch screen as described above.

[0159] To implement the above embodiments, this application also provides a computer program product.

[0160] When the computer program product is executed by the processor of the electronic device, it enables the electronic device to perform the method described above.

[0161] Figure 10 This is a block diagram of an electronic device according to an exemplary embodiment. Figure 10The electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0162] like Figure 10 As shown, the electronic device 900 includes a processor 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from memory 1006 into a random access memory (RAM) 1003. The RAM 1003 also stores various programs and data required for the operation of the electronic device 900. The processor 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0163] The following components are connected to I / O interface 1005: memory 1006 including hard disk; and communication section 1007 including network interface card such as LAN (Local Area Network) card, modem, etc., communication section 1007 performs communication processing via a network such as the Internet; drive 1008 is also connected to I / O interface 1005 as needed.

[0164] Specifically, according to embodiments of this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via the communication section 1007. When the computer program is executed by the processor 1001, it performs the functions defined in the methods of this application.

[0165] In an exemplary embodiment, a storage medium including instructions is also provided, such as a memory including instructions, which can be executed by the processor 1001 of the electronic device 1000 to perform the above-described method. Optionally, the storage medium may be a non-transitory computer-readable storage medium, such as a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device.

[0166] In this application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wireline, optical fiber, RF, etc., or any suitable combination thereof.

[0167] Figure 11 This is a structural block diagram of a touch chip according to an exemplary embodiment. Figure 11 The touch chip shown is merely an example and should not be construed as limiting the functionality or scope of the embodiments described in this application. Figure 11 As shown, the touch chip 1100 includes a processor 1101 and a memory 1102. The memory 1102 is used to store program code, and the processor 1101 is connected to the memory 1102 and is used to read program code from the memory 1102 to implement the method for determining touch points at the edge of the touch screen in the above embodiment.

[0168] Alternatively, the number of processors 1101 can be one or more.

[0169] Optionally, the touch chip may also include an interface 1103, and there may be multiple interfaces 1103. The interface 1103 can connect to an application and can receive data from external devices such as sensors.

[0170] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0171] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A method of determining a touch point of a touch screen edge, characterized by, include: When a touch operation enters from the target edge of the touchscreen, the first position information of the first measured touch point and the second position information of the second touch point predicted by the Kalman filter are obtained. Based on the first location information and the second location information, a candidate starting touch point for the touch operation is determined; In response to the candidate starting touch point overflowing the touch screen, an edge touch point of the touch operation is determined at the target edge, wherein the edge touch point is the target starting touch point of the touch operation; Obtain the target starting position information of the target starting touch point; Based on the second position information and the target starting position information, the Kalman filter updates the starting velocity information of the target starting touch point; The digital filter, based on the initial velocity information and the target initial position information, adjusts the output of the Kalman filter from the second touch point to the first... i The position information of each touch point is used for compensation, wherein the... i It is a positive integer greater than 2.

2. The method according to claim 1, characterized in that, Determining the edge touch point of the touch operation at the target edge includes: The touch direction of the touch operation is determined based on the first location information and the second location information; The touch direction extends toward the edge of the target, wherein the touch direction intersects with the edge of the target; The intersection point formed by the touch direction and the target edge is determined as the edge touch point.

3. The method according to claim 1, characterized in that, Determining the edge touch point of the touch operation at the target edge includes: Based on the candidate starting position information of the candidate starting touch point and the first position information, the touch direction of the touch operation is determined, and the intersection of the touch direction and the target edge is determined as the edge touch point.

4. The method according to claim 1, characterized in that, Determining the candidate starting touch point for the touch operation based on the first location information and the second location information includes: Based on the first location information and the second location information, a first distance between the first touch point and the second touch point and the touch direction of the touch operation are determined; Starting from the first location information, extend the first distance in the opposite direction along the touch direction to obtain the candidate starting touch point.

5. The method according to claim 1, characterized in that, The step of updating the velocity information of the target starting touch point by the Kalman filter based on the second position information and the target starting position information includes: Based on the second location information and the target starting location information, a second distance is determined between the second touch point and the target starting touch point; Obtain the first movement time required for the target starting touch point to move to the second touch point; The starting velocity information of the target starting touch point is updated by the Kalman filter based on the second distance and the first movement time.

6. The method according to claim 1, characterized in that, The digital filter, based on the initial velocity information and the target initial position information, applies the second touch point to the first touch point output by the Kalman filter. i The location information of each touch point is compensated, including: Regarding the first j The digital filter outputs the first touch point based on the initial velocity information and the target initial position information. j Speed ​​information of each touch point; Get the j -1 touch point moved to the first j The second movement time of each touch point; According to the first j The speed information of the first touch point and the second movement time are used to adjust the output of the Kalman filter for the first... j The location information of each touch point is used for compensation.

7. The method according to claim 6, characterized in that, The Kalman filter outputs the j-th touch point based on the updated speed information of the j-th touch point and the second movement time. j The location information of each touch point is compensated, including: According to the updated version of the first j Based on the speed information of the first touch point and the second movement time, the output of the digital filter is determined as the first... j First candidate location information for each touch point; Obtain the first Kalman filter output j Second candidate location information for each touch point; If the first j If the first position difference between the first candidate position information and the second candidate position information of a touch point is not within the set error range, then the first candidate position information is updated to the first position difference output by the Kalman filter. j Target location information for each touch point.

8. The method according to claim 1, characterized in that, The above refers to the first j The digital filter outputs the first touch point based on the initial velocity information and the target initial position information. j Speed ​​information for each touch point, including: Regarding the first j The touch point is determined by the digital filter according to the first touch point. j The touch duration corresponding to the first touch point determines the first... j The filter coefficients of the digital filter corresponding to each touch point, the j Greater than or equal to 2 and less than or equal to i Positive integers; Based on the filter coefficients, the initial velocity information, and the first... j -1 touch point speed information, to determine the first j Speed ​​information for each touch point.

9. The method according to claim 8, characterized in that, The filter coefficients are negatively correlated with the touch duration.

10. The method according to claim 8, characterized in that, The method is based on the filter coefficients, the initial velocity information, and the first... j -1 touch point speed information, to determine the first j Speed ​​information for each touch point, including: Obtain the first j -1 speed difference between the speed information of the touch point and the initial speed information; The speed difference is obtained and multiplied by the filter coefficients, and the product is then multiplied by the first... j The speed information of -1 touch points is added together to obtain the first... j Speed ​​information for each touch point.

11. The method according to claim 7, characterized in that, The method further includes: Obtain the first candidate position of the current touch point output by the digital filter and the second candidate position of the current touch point output by the Kalman filter; Obtain the second position difference between the first candidate position information and the second candidate position information of the current touch point; If the second position difference is within the set error range, then the compensation process for the position information of the next touch point output by the digital filter to the Kalman filter ends, wherein the next touch point corresponding to the end of the position information compensation process is the same as the first... i +1 touch points are the same touch point.

12. A device for determining edge touch points of a touchscreen, characterized in that, include: The first acquisition module is used to acquire the first position information of the first measured touch point and the second position information of the second touch point predicted by the Kalman filter when the touch operation enters from the target edge of the touch screen. The first determining module is used to determine the candidate starting touch point of the touch operation based on the first location information and the second location information; The second determining module is used to overflow the touch screen at the candidate starting touch point, determine the edge touch point of the touch operation at the target edge, wherein the edge touch point is the target starting touch point of the touch operation, and obtain the target starting position information of the target starting touch point; The update module is used to update the initial velocity information of the target initial touch point by the Kalman filter according to the second position information and the target initial position information; The compensation module is used to adjust the value of the second touch point to the first touch point output by the Kalman filter based on the initial velocity information and the target initial position information, according to the initial velocity information and the target initial position information. i The position information of each touch point is used for compensation, wherein the... i It is a positive integer greater than 2.

13. The apparatus according to claim 12, characterized in that, The second determining module is further configured to: The touch direction of the touch operation is determined based on the first location information and the second location information; The touch direction extends toward the edge of the target, wherein the touch direction intersects with the edge of the target; The intersection point formed by the touch direction and the target edge is determined as the edge touch point.

14. The apparatus according to claim 12, characterized in that, The second determining module is further configured to: Based on the candidate starting position information of the candidate starting touch point and the first position information, the touch direction of the touch operation is determined, and the intersection of the touch direction and the target edge is determined as the edge touch point.

15. The apparatus according to claim 12, characterized in that, The first determining module is further configured to: Based on the first location information and the second location information, a first distance between the first touch point and the second touch point and the touch direction of the touch operation are determined; Starting from the first location information, extend the first distance in the opposite direction along the touch direction to obtain the candidate starting touch point.

16. The apparatus according to claim 12, characterized in that, The update module is also used for: Based on the second location information and the target starting location information, a second distance is determined between the second touch point and the target starting touch point; Obtain the first movement time required for the target starting touch point to move to the second touch point; The starting velocity information of the target starting touch point is updated by the Kalman filter based on the second distance and the first movement time.

17. The apparatus according to claim 12, characterized in that, The compensation module is also used for: Regarding the first j The digital filter outputs the first touch point based on the initial velocity information and the target initial position information. j Speed ​​information of each touch point; Get the j -1 touch point moved to the first j The second movement time of each touch point; According to the first j The speed information of the first touch point and the second movement time are used to adjust the output of the Kalman filter for the first... j The location information of each touch point is used for compensation.

18. The apparatus according to claim 17, characterized in that, The compensation module is also used for: According to the updated version of the first j Based on the speed information of the first touch point and the second movement time, the output of the digital filter is determined as the first... j First candidate location information for each touch point; Obtain the first Kalman filter output j Second candidate location information for each touch point; If the first j If the first position difference between the first candidate position information and the second candidate position information of a touch point is not within the set error range, then the first candidate position information is updated to the first position difference output by the Kalman filter. j Target location information for each touch point.

19. The apparatus according to claim 17, characterized in that, The compensation module is also used for: Regarding the first j The touch point is determined by the digital filter according to the first touch point. j The touch duration corresponding to the first touch point determines the first... j The filter coefficients of the digital filter corresponding to each touch point, the j Greater than or equal to 2 and less than or equal to i Positive integers; Based on the filter coefficients, the initial velocity information, and the first... j -1 touch point speed information, to determine the first j Speed ​​information for each touch point.

20. The apparatus according to claim 19, characterized in that, The filter coefficients are negatively correlated with the touch duration.

21. The apparatus according to claim 19, characterized in that, The compensation module is also used for: Obtain the first j -1 speed difference between the speed information of the touch point and the initial speed information; The speed difference is obtained and multiplied by the filter coefficients, and the product is then multiplied by the first... j The speed information of -1 touch points is added together to obtain the first... j Speed ​​information for each touch point.

22. The apparatus according to claim 18, characterized in that, The device further includes: Obtain the first candidate position of the current touch point output by the digital filter and the second candidate position of the current touch point output by the Kalman filter; Obtain the second position difference between the first candidate position information and the second candidate position information of the current touch point; If the second position difference is within the set error range, then the compensation process for the position information of the next touch point output by the digital filter to the Kalman filter ends, wherein the next touch point corresponding to the end of the position information compensation process is the same as the first... i +1 touch points are the same touch point.

23. An electronic device, characterized in that, include: The device for determining the edge touch point of a touch screen as described in any one of claims 12 to 22.

24. A touch chip, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the method as described in any one of claims 1 to 11.

25. A non-transitory computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the method as described in any one of claims 1 to 11.

26. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1-11.

Images