Touch data processing method and device, electronic equipment and storage medium
By predicting and adjusting the predicted touch coordinates when the touchscreen reports touch coordinates, the problem of inaccurate touchscreen detection in the presence of liquid is solved, thus improving the accuracy and continuity of touch response.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SHENZHEN HEYTAP TECHNOLOGY CO LTD
- Filing Date
- 2024-10-28
- Publication Date
- 2026-04-28
AI Technical Summary
When there is liquid on the touchscreen, the user's touch operation is prone to inaccurate detection, resulting in inaccurate touch response, especially during swiping operations, which are prone to "backlash" phenomenon.
During the reporting of actual touch coordinates, the predicted touch coordinates of the next frame after the actual touch coordinates of the current frame are predicted. When there is liquid on the touch screen surface, the distance between the predicted touch coordinates and the actual touch coordinates of the previous frame is reduced to avoid inaccurate touch coordinates.
It improves the accuracy of touch response, avoids the 'hook-back' problem during swipe operations, and ensures the continuity and accuracy of touch trajectory.
Smart Images
Figure CN121934729A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic equipment technology, and more specifically, to a method, apparatus, electronic device, and storage medium for processing touch data. Background Technology
[0002] With the rapid advancement of technology and living standards, electronic devices (such as smartphones and tablets) have become commonplace in people's lives. Most electronic devices nowadays are equipped with touchscreens, allowing users to interact with the device and access its various functions. However, when a user slides over a water droplet on the touchscreen, inaccurate touch detection can occur, resulting in the user's touch input failing to register. Summary of the Invention
[0003] This application proposes a method, apparatus, electronic device, and storage medium for processing touch screen data. It can avoid the problem of inaccurate touch coordinates caused by liquid on the touch screen during the process of reporting the collected touch coordinates and inserted touch coordinates on the touch screen, thereby improving the accuracy of touch response.
[0004] In a first aspect, embodiments of this application provide a method for processing touchscreen data, applied to an electronic device, the electronic device including a touchscreen, the method comprising: during the process of reporting collected real touch coordinates, predicting the predicted touch coordinates of a frame following the real touch coordinates of the current frame; after reporting the real touch coordinates of the current frame and before reporting the real touch coordinates of the next frame, reporting the predicted touch coordinates; if there is liquid on the surface of the touchscreen, reducing the distance between the predicted touch coordinates and the real touch coordinates of the previous frame of the real touch coordinates of the current frame.
[0005] Secondly, embodiments of this application provide a touchscreen data processing device applied to an electronic device, the electronic device including a touchscreen, the device including: a data interpolation module, a data reporting module, and an interpolation optimization module, wherein the data interpolation module is used to predict the predicted touch coordinates of the next frame after the current frame's actual touch coordinates during the reporting of collected actual touch coordinates; the data reporting module is used to report the predicted touch coordinates after reporting the current frame's actual touch coordinates and before reporting the next frame's actual touch coordinates; the interpolation optimization module is used to reduce the distance between the predicted touch coordinates and the previous frame's actual touch coordinates if there is liquid on the surface of the touchscreen.
[0006] Thirdly, embodiments of this application provide an electronic device, including: one or more processors; a memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to perform the touchscreen data processing method provided in the first aspect above.
[0007] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code, which can be invoked by a processor to execute the touchscreen data processing method provided in the first aspect.
[0008] The solution provided in this application predicts the touch coordinates of the next frame after the current frame's actual touch coordinates during the reporting of collected actual touch coordinates. After reporting the current frame's actual touch coordinates and before reporting the next frame's actual touch coordinates, the predicted touch coordinates are reported. If there is liquid on the touchscreen surface, the distance between the predicted touch coordinates and the previous frame's actual touch coordinates is reduced. Therefore, during the reporting and insertion of collected touch coordinates, the problem of inaccurate inserted touch coordinates caused by liquid on the touchscreen is avoided, improving the accuracy of touch response. Attached Figure Description
[0009] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0010] Figure 1 This diagram illustrates one method of inserting predicted touch coordinates in related technologies.
[0011] Figure 2 A schematic diagram of the application environment provided in the embodiments of this application is shown.
[0012] Figure 3 A flowchart illustrating a method for processing touchscreen data according to an embodiment of this application is shown.
[0013] Figure 4 A schematic diagram illustrating the effect of inserting predicted touch coordinates provided in an embodiment of this application is shown.
[0014] Figure 5 A flowchart illustrating a method for processing touchscreen data according to another embodiment of this application is shown.
[0015] Figure 6This diagram illustrates the test results of the capacitance value data of the touch screen provided in an embodiment of this application.
[0016] Figure 7 This diagram illustrates the test results of the capacitance value data of the touch screen provided in an embodiment of this application.
[0017] Figure 8 A flowchart illustrating a method for processing touchscreen data according to yet another embodiment of this application is shown.
[0018] Figure 9 A flowchart illustrating a method for processing touchscreen data according to another embodiment of this application is shown.
[0019] Figure 10 This illustration shows a schematic diagram of an example of inserting predicted touch coordinates provided in an embodiment of this application.
[0020] Figure 11 This illustration shows a schematic diagram of an example of inserting predicted touch coordinates provided in an embodiment of this application.
[0021] Figure 12 A block diagram of a touchscreen data processing apparatus according to an embodiment of this application is shown.
[0022] Figure 13 This is a block diagram of an electronic device for performing a touchscreen data processing method according to an embodiment of this application.
[0023] Figure 14 This is a storage unit in this application embodiment for storing or carrying program code that implements the touch screen data processing method according to this application embodiment. Detailed Implementation
[0024] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
[0025] Display screens in mobile devices such as smartphones and tablets typically display text, images, icons, or videos. With the increasing intelligence of mobile devices, touch technology has been widely applied in human-computer interaction. Along with the development of touch technology, more and more mobile devices are equipped with touchscreen displays. When a touchscreen is used, it can respond to user touch actions such as dragging, clicking, double-clicking, and swiping. The application of touch technology simplifies user operation and provides a better user experience.
[0026] In related technologies, when a touchscreen in an electronic device reports touch coordinates, it performs frame interpolation. This involves inserting a predicted touch coordinate frame between two adjacent frames of captured touch coordinates and reporting the predicted coordinates. This improves the touchscreen's reporting rate, enhances the electronic device's touch response speed, and avoids missed touches. Furthermore, during frame interpolation, future touch coordinates are predicted based on the already captured touch coordinates. Specifically, a touch coordinate frame is inserted between the current frame's touch coordinates and the first subsequent frame's touch coordinates, and the inserted touch coordinates are reported.
[0027] In practice, it has been found that when using electronic devices, water droplets may be present on the screen, such as when using electronic devices outdoors in rain. When water droplets are present, touching the area where a finger touches the droplet increases the detected touch area, causing a shift in the collected touch coordinates. Furthermore, the touch point decelerates in its original direction of movement. Since the predicted future touch coordinates are based on the already collected coordinates, the reported and inserted touch coordinates continue to move in the original direction of the touch operation, resulting in inaccurate insertion. This is particularly problematic when the user performs a swiping motion, easily causing the detected trajectory to exhibit a "backtracking" issue.
[0028] For example, please refer to Figure 1 ,exist Figure 1 In the process of a user swiping up on the touchscreen, the touchscreen reports the collected touch coordinates by inserting a new touch coordinate frame between the current frame's touch coordinates and the next frame's touch coordinates. This inserted touch coordinate is then reported. When the finger passes over the water droplet, the collected touch coordinates shift to the right, and the touch point decelerates in its original direction. Due to the frame interpolation, another touch coordinate frame A1 is inserted in the original direction, resulting in the detected trajectory showing... Figure 1 The "sharp corner hook" A2 shown in the image causes inaccurate touch response.
[0029] To address the aforementioned problems, the inventors have proposed a touchscreen data processing method, apparatus, electronic device, and storage medium as described in the embodiments of this application. These methods can prevent inaccurate touch coordinates caused by liquid on the touchscreen during the reporting of collected and inserted touch coordinates, thereby improving the accuracy of touch response. The specific touchscreen data processing method will be described in detail in subsequent embodiments.
[0030] The application environment involved in the embodiments of this application will be introduced below.
[0031] Please refer to Figure 2This illustration shows a schematic diagram of an application environment provided by an embodiment of this application. This application environment may include an electronic device 100. The electronic device 100 includes a touchscreen 130. The touchscreen 130, also known as a touch display, is used to identify user touch operations through touch detection (such as mutual capacitance detection and / or self-capacitance detection). The electronic device 100 may have only one or more touchscreens 130. The touchscreen 130 is a touchscreen made based on capacitive technology and is therefore also called a capacitive touchscreen. Capacitive touchscreens include self-capacitive touchscreens and mutual capacitance touchscreens, which are not specifically limited in this embodiment. The electronic device 100 refers to an electronic device with data computing, processing, and storage capabilities. The terminal device may be a device such as a smartphone, tablet computer, wearable device, intelligent robot, or PC (Personal Computer). The electronic device 100 can identify user operations on the touchscreen 130 by monitoring / acquiring the capacitance data of the touchscreen 130.
[0032] The touchscreen data processing method provided in the embodiments of this application will now be described in detail with reference to the accompanying drawings.
[0033] Please see Figure 3 , Figure 3 A flowchart illustrating a touchscreen data processing method according to an embodiment of this application is shown. In a specific embodiment, the touchscreen data processing method is applied to, for example... Figure 12 The touchscreen data processing device 500 and the electronic device 100 equipped with the touchscreen data processing device 500 are shown. Figure 13 The following will address... Figure 3 The process shown will be described in detail. The method for processing touchscreen data may specifically include the following steps:
[0034] Step S110: During the process of reporting the collected real touch coordinates, predict the predicted touch coordinates for the next frame after the real touch coordinates of the current frame.
[0035] Among them, the touch screen of the electronic device can be a capacitive touch screen, which can include horizontal and vertical electrode arrays made of ITO (Indium Tin Oxide), which form a number of test points evenly distributed on the screen surface.
[0036] In capacitive touchscreens, self-capacitance can be generated between adjacent electrodes. Therefore, by collecting changes in the self-capacitance values of each test point through self-capacitance scanning, single-point touch detection can be achieved. In self-capacitance scanning, the touch point on the touchscreen is projected onto the X and Y axes respectively, and then the coordinates in the X and Y axes are calculated separately. Finally, these coordinates are combined to form the coordinates of the touch point. Self-capacitance data typically includes the Tx channel self-capacitance value in the vertical (column direction) and the Rx channel self-capacitance value in the horizontal (row direction).
[0037] Furthermore, since mutual capacitance can also be generated between adjacent electrodes, multi-touch detection can be achieved by collecting changes in the mutual capacitance values at each test point through mutual capacitance scanning. In mutual capacitance scanning, the touchscreen contains a grid, which can be viewed as an array composed of an X*Y baseline array, forming an X*Y unit capacitance. Mutual capacitance is formed between the elements in the columns and rows. The touchscreen chip measures each node separately, changing the distortion of the electric field at the touch position. Therefore, when a finger approaches or touches the screen, the capacitance decreases. After mutual capacitance scanning, a data matrix is obtained, which represents the mutual capacitance values corresponding to each node in the array.
[0038] The above-mentioned actual touch coordinates can be calculated based on the capacitance data of the touchscreen. After each scan of the touchscreen to obtain capacitance data, the touchscreen chip can treat each scan's capacitance data as a frame of capacitance data. Based on this frame of capacitance data, a touch algorithm can calculate the actual touch coordinates for that frame. For example, for the capacitance data of the currently scanned frame, the touch algorithm can calculate the touch coordinates, which are then used as the actual touch coordinates for the current frame.
[0039] Among them, obtaining the capacitance value data of the touch screen can be done by obtaining the Diff value of the touch screen. The Diff value can be the difference between the reference touch capacitance value and the current touch capacitance value, that is, the difference obtained by subtracting the current touch capacitance value from the reference touch capacitance value. The Diff value can be understood as the amount of change in the touch capacitance value of the touch screen caused by finger touch or environmental interference.
[0040] In some implementations, the reference capacitance value can be the raw data obtained by the touchscreen chip through an analog-to-digital converter (ADC) when no touch operation is input on the touchscreen, and then the reference capacitance value is established based on the raw data. This reference capacitance value can be the raw value obtained when the touchscreen is first powered on, i.e., the first value obtained after the touchscreen is powered on. The reference capacitance value can include at least the reference mutual capacitance value, i.e., the reference capacitance value obtained through mutual capacitance scanning; of course, the reference capacitance value can also include the reference self-capacitance value, i.e., the reference capacitance value obtained through self-capacitance scanning.
[0041] In some implementations, the electronic device obtains the above capacitance value data of the touch screen by having the touch screen chip perform a full-screen scan of the touch screen to obtain the current touch capacitance value, and then determine the above Diff data based on the stored reference touch capacitance value and the scanned current touch capacitance value, thus obtaining the capacitance value data.
[0042] In the above method, the capacitance data can include at least mutual capacitance values. The touchscreen chip can scan the mutual capacitance to obtain the current mutual capacitance value of each capacitor node. Then, based on the reference mutual capacitance value in the reference capacitance value and the current original value of each capacitor node, the mutual capacitance value of each capacitor node is determined. That is, for each capacitor node, the current original mutual capacitance value is subtracted from its corresponding reference mutual capacitance value to obtain the mutual capacitance value of each capacitor node. Optionally, the current mutual capacitance values obtained by the touchscreen chip can form an original data matrix according to the positions of the scanned capacitor nodes, and the reference mutual capacitance values in the reference capacitance value can also form a reference data matrix according to the positions of the capacitor nodes. Then, based on the difference between the reference data matrix and the original data matrix, a Diff value matrix can be determined. The value of each element in the Diff value matrix is the Diff value of each node, that is, the value of each element is the mutual capacitance value of the capacitor node corresponding to that element.
[0043] Of course, the above capacitance data can also include self-capacitance values. The touch screen chip can perform self-capacitance scanning to obtain the current original self-capacitance values at each Rx and Tx position. Then, based on the reference self-capacitance value in the reference capacitance value and the current original self-capacitance values at each Rx and Tx position, the self-capacitance values at each Rx and Tx position are determined. That is, the reference capacitance value is subtracted from the current original self-capacitance value to obtain the self-capacitance value.
[0044] In this embodiment, to improve the reporting rate and enhance touch response speed while avoiding missed touches during the reporting of each frame's actual touch coordinates, a predicted touch coordinate can be predicted between adjacent actual touch coordinate frames. Specifically, after acquiring the actual touch coordinates of the current frame, the predicted touch coordinates of the next frame can be predicted. This prediction is then reported before the next frame's actual touch coordinates are reported, effectively inserting a predicted touch coordinate frame between adjacent actual touch coordinate frames. In other words, not only are the originally detected touch coordinates reported, but frame interpolation is also performed, reporting the predicted touch coordinates between two adjacent reported detected touch coordinates.
[0045] In some implementations, when predicting the predicted touch coordinates for the next frame after the actual touch coordinates of the current frame, the motion information of the touch point can be determined based on the already acquired actual touch coordinates. For example, motion speed, acceleration, etc., can be determined, and thus the predicted touch coordinates for the next frame after the actual touch coordinates of the current frame can be predicted based on the motion information. For example, the motion information of the touch point can be determined based on the actual touch coordinates of the current frame and the actual touch coordinates of the previous N frames, and the predicted touch coordinates can be determined based on the motion information.
[0046] Of course, in the embodiments of this application, the specific prediction method for predicting the touch coordinates in the next frame after predicting the actual touch coordinates of the current frame is not limited.
[0047] Step S120: After reporting the actual touch coordinates of the current frame and before reporting the actual touch coordinates of the next frame, report the predicted touch coordinates.
[0048] In this embodiment, after predicting the touch coordinates for the next frame after the actual touch coordinates of the current frame are predicted, the predicted touch coordinates can be reported after reporting the actual touch coordinates of the current frame and before reporting the actual touch coordinates of the next frame. This allows for the reporting of the predicted touch coordinates before reporting the actual touch coordinates collected in the next frame, enabling early reporting of touch coordinates, thereby improving the reporting rate, increasing touch response speed, and avoiding breakpoint issues during swiping.
[0049] For example, at time t1 (the current time), the touch coordinates of the m-th frame are detected and can be reported at the current time. Before reporting the touch coordinates of the (m+1)-th frame detected at time t2 and reporting the detected touch coordinates, the touch coordinates between the touch coordinates of the m-th frame and the touch coordinates of the (m+1)-th frame are predicted. This can also be understood as predicting the touch coordinates between time t1 and time t2 and reporting the predicted touch coordinates, thereby achieving frame interpolation of the reported touch coordinates.
[0050] Step S130: If there is liquid on the surface of the touch screen, then reduce the distance between the predicted touch coordinates and the previous frame's real touch coordinates of the current frame.
[0051] In this embodiment, considering frame interpolation during the reporting of actual touch coordinates—that is, between the reported actual touch coordinates of the current frame and the reported actual touch coordinates of the next frame—a predicted touch coordinate is reported. If there is liquid (e.g., water droplets) on the touchscreen surface, when a finger touches the location of the liquid, the reported interpolated touch coordinates will continue to move in the original direction of the touch operation, resulting in inaccurate interpolated touch coordinates. Therefore, during the above process, it can be determined whether there is liquid on the touchscreen surface. If it is determined that there is liquid on the touchscreen surface, the distance between the predicted touch coordinates and the previous frame's actual touch coordinates can be reduced, making the reported predicted touch coordinates more accurate and avoiding the "backtracking" problem in the detected trajectory when the user performs a swipe operation.
[0052] Understandably, when liquid is present on the touchscreen surface, touching the water droplet increases the detected touch area, causing a shift in the acquired touch coordinates. Furthermore, the touch point decelerates in its original direction of movement. Predicting future touch coordinates based on the acquired coordinates leads to the reported, inserted touch coordinates continuing to move in the original direction of the touch operation. This causes the predicted touch coordinates to exceed the subsequently reported actual touch coordinates, resulting in inaccurate insertion. Therefore, during the subsequent reporting of actual touch coordinates, the distance between the predicted and previous frame's actual touch coordinates can be reduced to prevent the predicted coordinates from moving too far along the original touch point's direction. This avoids inaccurate insertion and prevents the detected trajectory from exhibiting a "backtracking" problem during user swipes.
[0053] For example, please also refer to Figure 4 The touch screen data processing method provided in this application embodiment can prevent the inserted predicted touch coordinates from being predicted too far from the original trajectory when the user performs a sliding operation on the touch screen in the presence of water droplets on the touch screen surface, thus avoiding the "backtracking" problem.
[0054] In some implementations, when determining whether liquid is present on the surface of a screen, the electronic device can determine whether liquid is present on the surface of the touchscreen based on currently acquired capacitance value data and a second capacitance threshold.
[0055] In one possible implementation, the capacitance data (whether self-capacitance or mutual capacitance) generated when a finger touches the touchscreen should be less than the capacitance data generated when a liquid (such as water, coffee, or beverages in daily life) touches the touchscreen. Therefore, if the number of channels with capacitance values less than the aforementioned second capacitance threshold within a first preset number of frames meets the target channel number condition, it can be considered that liquid has touched the touchscreen, meaning that liquid is present on the surface of the touchscreen. The target channel number condition can be that the number of channels with capacitance values less than the aforementioned second capacitance threshold is greater than the target channel number.
[0056] In some implementations, when reducing the distance between the predicted touch coordinates and the previous frame's actual touch coordinates, if the motion information of the touch point is determined based on the collected actual touch coordinates, and the predicted touch coordinates are predicted based on the motion information, then the motion speed, acceleration, and other parameter values in the motion information can be reduced before predicting the predicted touch coordinates based on the motion information, thereby reducing the distance between the predicted touch coordinates and the previous frame's actual touch coordinates.
[0057] In this embodiment, the touch data processing method provided in this embodiment is executed by the touch screen chip. That is, after the touch screen chip scans the touch screen to obtain the above capacitance value data, the above steps (steps S110 and S130) can be executed to complete the reporting of touch coordinates. Alternatively, the touch data processing method provided in this embodiment can be executed by the application processor (AP) in the electronic device. That is, after the touch screen chip scans the touch screen to obtain the above capacitance value data, the capacitance value data can be directly reported to the AP without further processing. Then the AP obtains the capacitance value data of the touch screen and executes the above steps (steps S110 and S130).
[0058] The touchscreen data processing method provided in this application, during the reporting of collected real touch coordinates, predicts the predicted touch coordinates for the frame following the current frame's real touch coordinates. After reporting the current frame's real touch coordinates and before reporting the next frame's real touch coordinates, the predicted touch coordinates are reported. If liquid is present on the touchscreen surface, the distance between the predicted touch coordinates and the previous frame's real touch coordinates is reduced. Therefore, during the reporting and insertion of collected touch coordinates, the problem of inaccurate inserted touch coordinates due to liquid on the touchscreen is avoided, improving the accuracy of touch response.
[0059] Please see Figure 5 , Figure 5A flowchart illustrating a touchscreen data processing method according to another embodiment of this application is shown. This touchscreen data processing method is applied to the aforementioned electronic device, which includes a touchscreen. The following will focus on... Figure 5 The process shown will be described in detail. The method for processing touchscreen data may specifically include the following steps:
[0060] Step S210: During the process of reporting the collected real touch coordinates, predict the predicted touch coordinates of the next frame after the real touch coordinates of the current frame.
[0061] Step S220: After reporting the actual touch coordinates of the current frame and before reporting the actual touch coordinates of the next frame, report the predicted touch coordinates.
[0062] In the embodiments of this application, steps S210 and S220 can be referred to the contents of other embodiments, and will not be repeated here.
[0063] Step S230: If there is liquid on the surface of the touch screen, determine the current pressing parameters. The parameter value of the pressing parameters is positively correlated with the pressure value of the touch screen being pressed.
[0064] In this embodiment, considering the presence of liquid on the touchscreen surface, if the user does not touch the liquid location, the reported predicted touch coordinates will not be inaccurate. Therefore, during frame interpolation in the touch coordinate reporting process, if it is determined that liquid is present on the touchscreen surface, the current pressing parameters can be further determined to ascertain whether the user has touched the liquid location. The values of these pressing parameters are positively correlated with the pressure applied to the touchscreen; that is, the greater the pressure applied to the touchscreen, the greater the value of the pressing parameter.
[0065] Understandably, if the user hasn't touched the liquid location, reducing the distance between the predicted touch coordinates and the actual touch coordinates of the previous frame when predicting the touch coordinates might not only lead to inaccurate reported touch coordinates but also require more processing, increasing power consumption. Therefore, when liquid is detected on the touchscreen surface, it's necessary to further determine whether the user has touched the liquid location. Additionally, the pressure applied to the touchscreen when touching the liquid is typically greater than when not touching it. This is because touching the liquid increases the touch area, thus increasing pressure. Therefore, by determining the pressure parameters, it's possible to determine whether the user has touched the liquid location. Please also refer to... Figure 6 and Figure 7 , Figure 6This diagram illustrates the capacitance data when a finger touches the location of the liquid. Figure 7 This diagram illustrates capacitance data when a finger touches a location other than the liquid area. Locations with mutual capacitance values greater than a target threshold are defined as the touch area (i.e.,...). Figure 6 , Figure 7 (In the darker areas of the medium color), it can be seen that when a finger touches the liquid, the detected touch area becomes larger.
[0066] In some implementations, when determining the above pressing parameters, the current touch area of the touchscreen can be determined based on the currently collected capacitance value data; the accumulated value of the mutual capacitance values in the current touch area can be determined as the pressing parameters. It is understandable that when a finger touches the liquid, the area of the touch area increases, and therefore the accumulated value of the mutual capacitance values detected within the touch area also increases. Therefore, the pressure parameters can be determined by using this accumulated value.
[0067] In some implementations, when determining the above pressure parameters, the current touch area of the touchscreen can be determined based on the currently collected capacitance value data; then the sum of the capacitance nodes in the current touch area can be determined, and this sum can be used as the above pressure parameters.
[0068] Step S240: If the value of the pressing parameter is greater than the parameter threshold, then reduce the distance between the predicted touch coordinates and the previous frame's real touch coordinates of the current frame's real touch coordinates.
[0069] In this embodiment of the application, when it is determined that the value of the pressing parameter is greater than the parameter threshold, it can indicate the location of the liquid on the surface of the touch screen that the current user touches. Therefore, the distance between the predicted touch coordinates and the previous frame's real touch coordinates can be reduced, thereby improving the accuracy of the reported predicted touch coordinates.
[0070] In some implementations, considering that when a user performs a swipe operation on the screen, if the swipe passes over liquid on the screen, the swipe may break the line. This problem occurs because multiple touch areas (i.e., touch points) are detected when the user touches the liquid. Therefore, when determining the location where the user touches the liquid, it is determined whether the current touch area includes the target number of touch areas. If the current touch area includes the target number of touch areas, the target number of touch areas can be merged into a single touch area as the target touch area. Then, the touch coordinates corresponding to the target touch area are determined as the actual touch coordinates of the current frame.
[0071] The target number can be at least 2. Understandably, when a user touches the location of a liquid on the screen, it will be identified as multiple touch points (usually 2 touch points). Therefore, it can be determined whether the current touch area includes the above target number of touch areas. In this case, the detected touch areas can be merged, so that only the touch coordinates corresponding to one touch point are determined, ensuring the accuracy of the detected true touch coordinates.
[0072] The touchscreen data processing method provided in this application can avoid the problem of inaccurate touch coordinates caused by liquid on the touchscreen during the process of the touchscreen reporting the collected touch coordinates and inserted touch coordinates, thereby improving the accuracy of touch response. In addition, when it is determined that there is liquid on the surface of the touchscreen, the current pressing parameters of the touchscreen are further determined. Only when the parameter value of the pressing parameter is greater than the parameter threshold is the predicted touch coordinate optimized, thereby further improving the accuracy of the reported predicted touch coordinates.
[0073] Please see Figure 8 , Figure 8 A flowchart illustrating a touchscreen data processing method according to another embodiment of this application is shown. This touchscreen data processing method is applied to the aforementioned electronic device, and will be discussed below. Figure 8 The process shown will be described in detail. The method for processing touchscreen data may specifically include the following steps:
[0074] Step S310: During the process of reporting the collected real touch coordinates, obtain the difference between the real touch coordinates of the current frame and the real touch coordinates of the previous frame.
[0075] In this embodiment of the application, during the reporting of the actual touch coordinates of each frame, when predicting the predicted touch coordinates of the next frame after the actual touch coordinates of the current frame, the difference between the actual touch coordinates of the current frame and the actual touch coordinates of the previous frame can be obtained. It can be understood that the difference between the actual touch coordinates of the current frame and the actual touch coordinates of the previous frame can represent the movement of the touch point; therefore, this difference can be obtained to predict the predicted touch coordinates of the next frame after the actual touch coordinates of the current frame.
[0076] Step S320: Obtain the product of the difference and the target coefficient, wherein the target coefficient is less than 1.
[0077] In this embodiment, when determining the predicted touch coordinates based on the difference between the actual touch coordinates of the current frame and the actual touch coordinates of the previous frame, the product of this difference and a target coefficient can be obtained to determine the position of the predicted touch coordinates relative to the actual touch coordinates of the current frame. The target coefficient is less than 1, i.e., 0 < target coefficient < 1, to ensure that the predicted touch coordinates are located between the predicted and the actual touch coordinates acquired in the next frame. The specific value of the target coefficient is not limited; for example, the target coefficient can be 1 / 2, 1 / 3, etc.
[0078] Step S330: Obtain the sum of the product and the actual touch coordinates of the current frame to obtain the predicted touch coordinates.
[0079] In this embodiment of the application, after obtaining the above product, the sum of the above product and the actual touch coordinates of the current frame can be obtained to obtain the predicted touch coordinates.
[0080] For example, if the previous frame's true touch coordinates of the current frame are (x1, y1) and the current frame's true touch coordinates are (x2, y2), and the target coefficient is α, then the predicted touch coordinates can be: (x2, y2) + ((x2, y2) - (x1, y1)) * α.
[0081] Step S340: After reporting the actual touch coordinates of the current frame and before reporting the actual touch coordinates of the next frame, report the predicted touch coordinates.
[0082] In this embodiment of the application, after the actual touch coordinates of the current frame are determined by the above method, since the predicted touch coordinates determined by the above method are located after the actual touch coordinates of the current frame, the predicted touch coordinates can be reported after the actual touch coordinates of the current frame are reported and before the actual touch coordinates of the next frame are reported.
[0083] Step S350: If there is liquid on the surface of the touch screen, then reduce the value of the target coefficient.
[0084] In this embodiment, during the reporting of actual touch coordinates and predicted touch coordinates, if it is determined that liquid exists on the surface of the touchscreen, the value of the target coefficient can be reduced when decreasing the distance between the predicted touch coordinates and the previous frame's actual touch coordinates. This reduces the distance between the predicted touch coordinates and the previous frame's actual touch coordinates. For example, if the previous frame's actual touch coordinates are (x1, y1) and (x2, y2), and the target coefficient is α, then the predicted touch coordinates can be: (x2, y2) + ((x2, y2) - (x1, y1)) * α. After reducing α, the calculated predicted touch coordinates will obviously be closer to (x1, y1). Since the predicted touch coordinates are reported after the current frame's actual touch coordinates, the predicted touch coordinates will also be closer to the current frame's actual touch coordinates.
[0085] In some implementations, when determining that liquid is present on the touchscreen surface and reducing the value of the target coefficient, the impact of varying liquid areas on the predicted touch coordinates is considered. Furthermore, the detected touch area differs depending on the liquid area, and the detected touch area is positively correlated with the liquid area. Therefore, the target coefficient can be reduced based on the current touch area, with the reduction magnitude directly proportional to the current touch area. In other words, a larger current touch area indicates a larger liquid area on the touchscreen surface, resulting in a greater reduction in the target coefficient. This leads to a greater reduction in the distance between the predicted touch coordinates and the actual touch coordinates from the previous frame, thus ensuring the accuracy of the predicted touch coordinates.
[0086] The touch screen data processing method provided in this application embodiment can improve the accuracy of touch response by reducing the distance between the predicted touch coordinates and the previous frame's real touch coordinates, when liquid is detected on the touch screen surface during the process of the touch screen reporting the collected touch coordinates and inserted touch coordinates. This avoids the problem of inaccurate inserted touch coordinates caused by liquid on the touch screen.
[0087] Please see Figure 9 , Figure 9 A flowchart illustrating a touchscreen data processing method according to another embodiment of this application is shown. This touchscreen data processing method is applied to the aforementioned electronic device, and will be discussed below. Figure 9 The process shown will be described in detail. The method for processing touchscreen data may specifically include the following steps:
[0088] Step S410: During the process of reporting the collected real touch coordinates, obtain the difference between the real touch coordinates of the current frame and the real touch coordinates of the previous frame.
[0089] Step S420: Obtain the product of the difference and the target coefficient, wherein the target coefficient is less than 1.
[0090] Step S430: Obtain the sum of the product and the actual touch coordinates of the current frame to obtain the predicted touch coordinates.
[0091] Step S440: After reporting the actual touch coordinates of the current frame and before reporting the actual touch coordinates of the next frame, report the predicted touch coordinates.
[0092] In this embodiment, steps S410 to S440 can be referred to the content of the previous embodiment, and will not be repeated here.
[0093] Step S450: If there is liquid on the surface of the touch screen, the average value of the actual touch coordinates of the current frame and the actual touch coordinates of the previous frame is obtained as the predicted touch coordinates.
[0094] Step S460: After reporting the predicted touch coordinates, report the actual coordinates of the current frame.
[0095] In this embodiment, unlike the previous embodiment, when reducing the distance between the predicted touch coordinates and the actual touch coordinates of the current frame and the previous frame, the average value of the actual touch coordinates of the current frame and the previous frame is obtained as the predicted touch coordinates. Furthermore, the strategy for reporting the predicted touch coordinates is adjusted so that the actual touch coordinates of the current frame are reported after the predicted touch coordinates are reported. This prevents the predicted touch coordinates from exceeding the actual touch coordinates on the trajectory of the touch point, meaning that the reported predicted touch coordinates will not reach a certain position when the user has not swiped to that position.
[0096] For example, please refer to Figure 10 and Figure 11 , Figure 10 The diagram illustrates the reporting of predicted touch coordinates in the previous embodiment. In the previous embodiment, after acquiring the actual touch coordinates B of the current frame, the predicted touch coordinates C are determined based on the actual touch coordinates B of the current frame and the actual touch coordinates A of the previous frame. Then, after reporting the actual touch coordinates B of the current frame, the predicted touch coordinates C are reported. Please refer to [link to previous document]. Figure 11In this embodiment of the application, after the actual touch coordinates B of the current frame are collected, the predicted touch coordinates C are determined based on the actual touch coordinates B of the current frame and the actual touch coordinates A of the previous frame. Then, after reporting the predicted touch coordinates C, the actual touch coordinates B of the current frame are reported.
[0097] The touch screen data processing method provided in this application embodiment can improve the accuracy of touch response by reducing the distance between the predicted touch coordinates and the previous frame's real touch coordinates, when liquid is detected on the touch screen surface during the process of the touch screen reporting the collected touch coordinates and inserted touch coordinates. This avoids the problem of inaccurate inserted touch coordinates caused by liquid on the touch screen.
[0098] Please see Figure 12 This document illustrates a structural block diagram of a touchscreen data processing apparatus 500 according to an embodiment of this application. The touchscreen data processing apparatus 500 utilizes the aforementioned electronic device, which includes a touchscreen. The apparatus 500 comprises a data interpolation module 510, a data reporting module 520, and an interpolation optimization module 530. Specifically, the data interpolation module 510 predicts the predicted touch coordinates of the next frame after the current frame's actual touch coordinates during the reporting of collected actual touch coordinates; the data reporting module 520 reports the predicted touch coordinates after reporting the current frame's actual touch coordinates and before reporting the next frame's actual touch coordinates; and the interpolation optimization module 530 reduces the distance between the predicted touch coordinates and the previous frame's actual touch coordinates if liquid is present on the touchscreen surface.
[0099] In some implementations, the frame interpolation optimization module 530 may be specifically used to: if there is liquid on the surface of the touch screen, determine the current pressing parameter, the parameter value of which is positively correlated with the pressure value of the touch screen being pressed; if the parameter value of the pressing parameter is greater than a parameter threshold, reduce the distance between the predicted touch coordinates and the previous frame's real touch coordinates of the current frame's real touch coordinates.
[0100] In one possible implementation, the frame interpolation optimization module 530 can also be used to determine the current touch area of the touch screen based on the currently collected capacitance value data if there is liquid on the surface of the touch screen; and determine the accumulated value of the mutual capacitance value in the current touch area as the pressing parameter.
[0101] In one possible implementation, the touchscreen data processing device 500 may further include a region merging module and a coordinate determination module. The region merging module is used to merge the target number of touch areas into a single touch area as a target touch area if the value of the pressing parameter is greater than a parameter threshold and the current touch area includes a target number of touch areas; the coordinate determination module is used to determine the touch coordinates corresponding to the target touch area as the actual touch coordinates of the current frame.
[0102] In some implementations, the data interpolation module 510 may be specifically used to: obtain the difference between the real touch coordinates of the current frame and the real touch coordinates of the previous frame during the process of reporting the collected real touch coordinates; obtain the product of the difference and a target coefficient, wherein the target coefficient is less than 1; obtain the sum of the product and the real touch coordinates of the current frame to obtain the predicted touch coordinates.
[0103] In one possible implementation, the data interpolation module 520 may be specifically used to: reduce the value of the target coefficient if there is liquid on the surface of the touch screen.
[0104] Optionally, the data interpolation module 520 can be specifically used to: if there is liquid on the surface of the touch screen, then based on the area of the current touch area of the touch screen, reduce the value of the target coefficient, wherein the reduction in the value of the target coefficient is positively correlated with the area.
[0105] In one possible implementation, the frame interpolation optimization module 520 may be specifically used to: if there is liquid on the surface of the touch screen, obtain the average value of the current frame's actual touch coordinates and the previous frame's actual touch coordinates as the predicted touch coordinates; after reporting the predicted touch coordinates and before the next reporting of touch coordinates, report the current frame's actual coordinates.
[0106] In some embodiments, the touchscreen data processing apparatus 500 may further include a liquid determination module. The liquid determination module is used to determine whether liquid exists on the surface of the touchscreen, based on currently acquired capacitance value data and a second capacitance threshold, before reducing the distance between the predicted touch coordinates and the previous frame's true touch coordinates if liquid is present on the surface of the touchscreen.
[0107] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0108] In the several embodiments provided in this application, the coupling between modules can be electrical, mechanical, or other forms of coupling.
[0109] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.
[0110] In summary, the solution provided in this application predicts the touch coordinates of the next frame after the current frame's actual touch coordinates during the reporting of collected actual touch coordinates. It reports the predicted touch coordinates after reporting the current frame's actual touch coordinates and before reporting the next frame's actual touch coordinates. If there is liquid on the touchscreen surface, the distance between the predicted touch coordinates and the previous frame's actual touch coordinates is reduced. Therefore, during the reporting and insertion of collected touch coordinates, the problem of inaccurate inserted touch coordinates caused by liquid on the touchscreen is avoided, improving the accuracy of touch response.
[0111] Please refer to Figure 13 This document illustrates a structural block diagram of an electronic device according to an embodiment of this application. The electronic device 100 can be a smartphone, tablet computer, smartwatch, e-reader, or other electronic device capable of running applications. The electronic device 100 in this application may include one or more of the following components: a processor 110, a memory 120, a touchscreen 130, and one or more applications. The one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110. The one or more applications are configured to perform the methods described in the foregoing method embodiments.
[0112] Processor 110 may include one or more processing cores. Processor 110 connects to various parts within the electronic device 100 using various interfaces and lines, and performs various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets, or instruction sets stored in memory 120, and by calling data stored in memory 120. Optionally, processor 110 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Processor 110 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the modem may also not be integrated into processor 110 and may be implemented separately using a communication chip.
[0113] The memory 120 may include random access memory (RAM) or read-only memory (ROM). The memory 120 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described below. The data storage area may also store data created by the electronic device 100 during use (such as phonebook data, audio and video data, chat log data, etc.).
[0114] The touchscreen 130 can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touchscreen 130), and drive the corresponding connected devices according to a pre-set program.
[0115] Please refer to Figure 14 This diagram illustrates a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable medium 800 stores program code that can be called by a processor to execute the methods described in the above method embodiments.
[0116] The computer-readable storage medium 800 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 800 has storage space for program code 810 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.
[0117] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.
Claims
1. A method for processing touchscreen data, characterized in that, Applied to an electronic device, the electronic device including a touchscreen, the method includes: During the process of reporting the collected real touch coordinates, predict the touch coordinates of the next frame after the real touch coordinates of the current frame. After reporting the actual touch coordinates of the current frame and before reporting the actual touch coordinates of the next frame, the predicted touch coordinates are reported. If there is liquid on the surface of the touchscreen, the distance between the predicted touch coordinates and the previous frame's actual touch coordinates is reduced.
2. The method according to claim 1, characterized in that, If there is liquid on the surface of the touchscreen, reducing the distance between the predicted touch coordinates and the previous frame's actual touch coordinates in the current frame includes: If there is liquid on the surface of the touch screen, the current pressing parameters are determined, and the parameter values of the pressing parameters are positively correlated with the pressure value of the touch screen being pressed. If the value of the pressing parameter is greater than the parameter threshold, then the distance between the predicted touch coordinates and the previous frame's actual touch coordinates is reduced.
3. The method according to claim 2, characterized in that, If there is liquid on the surface of the touchscreen, the current pressing parameters are determined, including: If there is liquid on the surface of the touch screen, the current touch area of the touch screen is determined based on the currently collected capacitance value data. The accumulated value of mutual capacitance in the current touch area is determined as the pressing parameter.
4. The method according to claim 2, characterized in that, If the value of the pressing parameter is greater than the parameter threshold, the method further includes: If the current touch area includes a target number of touch areas, then the target number of touch areas are merged into a single touch area, which is then used as the target touch area. The touch coordinates corresponding to the target touch area are determined and used as the actual touch coordinates of the current frame.
5. The method according to claim 1, characterized in that, The process of predicting the predicted touch coordinates for the next frame after the current frame's actual touch coordinates during the reporting of collected real touch coordinates includes: During the process of reporting the collected real touch coordinates, the difference between the real touch coordinates of the current frame and the real touch coordinates of the previous frame is obtained; Obtain the product of the difference and the target coefficient, where the target coefficient is less than 1; The sum of the product and the actual touch coordinates of the current frame is obtained to get the predicted touch coordinates.
6. The method according to claim 5, characterized in that, If there is liquid on the surface of the touchscreen, reducing the distance between the predicted touch coordinates and the previous frame's actual touch coordinates in the current frame includes: If there is liquid on the surface of the touchscreen, the value of the target coefficient is reduced.
7. The method according to claim 6, characterized in that, The step of reducing the value of the target coefficient if there is liquid on the surface of the touchscreen includes: If there is liquid on the surface of the touch screen, the value of the target coefficient is reduced based on the area of the current touch area of the touch screen, and the reduction in the value of the target coefficient is positively correlated with the area.
8. The method according to claim 5, characterized in that, If there is liquid on the surface of the touchscreen, reducing the distance between the predicted touch coordinates and the previous frame's actual touch coordinates in the current frame includes: If there is liquid on the surface of the touch screen, the average value of the actual touch coordinates of the current frame and the actual touch coordinates of the previous frame is obtained as the predicted touch coordinates. After reporting the predicted touch coordinates, and before reporting the next touch coordinate, the actual coordinates of the current frame are reported.
9. The method according to any one of claims 1-7, characterized in that, Before reducing the distance between the predicted touch coordinates and the previous frame's true touch coordinates if liquid is present on the surface of the touchscreen, the method further includes: Based on the currently collected capacitance value data and the second capacitance threshold, it is determined whether there is liquid on the surface of the touch screen.
10. A touchscreen data processing device, characterized in that, Applied to electronic devices, including a touchscreen, the device includes: a data frame interpolation module, a data reporting module, and a frame interpolation optimization module, wherein... The data interpolation module is used to predict the predicted touch coordinates of the next frame after the current frame's actual touch coordinates during the process of reporting the collected actual touch coordinates. The data reporting module is used to report the predicted touch coordinates after reporting the actual touch coordinates of the current frame and before reporting the actual touch coordinates of the next frame. The frame interpolation optimization module is used to reduce the distance between the predicted touch coordinates and the previous frame's actual touch coordinates if there is liquid on the surface of the touch screen.
11. An electronic device, characterized in that, include: One or more processors; Memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs being configured to perform the method as described in any one of claims 1-9.
12. A computer-readable storage medium, characterized in that, The computer-readable storage medium contains program code that can be invoked by a processor to execute the method as described in any one of claims 1-9.