Method, device, equipment and storage medium for determining the position of a touch point
By predicting the position change information of the touch point, the movement of the touch object is to shake or slide, solve the problem of touch point jitter, and achieve a bit of stability and the balance of hand.
Patent Information
- Application Number
- CN201910877239.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-09-17
- Publication Date
- 2025-01-28
- Estimated Expiration
- 2039-09-17
AI Technical Summary
In the touch screen, touch point jitter occurs due to frequent update of the touch point position, which affects the user's operating experience.
Based on the position change information of the touch point in the at least two frames before the touch signal of the N+1 frame, it is predicted that the movement between the n+1 frame is the jitter or sliding during the stay of the touch object. If For jitter, keep the position of the nn frame. If it is sliding, the position of the n+1 frame is updated.
Achieve both consider point stability, avoid tiny coordinate jitter, and consider the point of the point coordinates and the actual touch point coordinates.
Smart Images

Figure CN112527139B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a method, device, equipment and storage medium for determining a reporting point position of a touch point. Background Art
[0002] With the continuous development of information technology, electronic devices such as smart phones and smart tablets are playing an increasingly important role in people's daily lives. With the rapid development of screen technology, display screens that support touch operations have become a standard configuration for electronic devices.
[0003] A touch screen (Touch Panel, TP for short) is a device that can accept input signals. Touch screens can include resistive touch screens and capacitive touch screens. Taking a capacitive touch screen as an example, when a user touches a capacitive touch screen, a coupling capacitor is formed between the user and the touch screen surface due to the human body's electric field. Because the touch screen is connected to a high-frequency signal, the finger absorbs a very small current, which flows out from the electrodes on the four corners of the touch screen. In theory, the current flowing through the four electrodes is proportional to the distance from the finger to the four corners of the touch screen. Therefore, by calculating the ratio of the four currents, the position of the touch point can be obtained, and the position of the touch point can be reported to the processing module. This process is referred to as the reporting process.
[0004] However, in order to ensure that the touch point follows the movement of the hand, a new touch point position is calculated for each small movement, and the touch point may jitter due to frequent updates of the touch point position. Summary of the invention
[0005] In order to overcome the problems existing in the related art, the present disclosure provides a method, an apparatus, a device and a storage medium for determining a reporting point position of a touch point.
[0006] According to a first aspect of an embodiment of the present disclosure, a method for determining a reported position of a touch point is provided, the method comprising:
[0007] Predicting, based on position change information of the touch point in at least two frames before the N+1 frame touch signal, that the action between the N frame and the N+1 frame is a jitter or a slide during the stay of the touch object;
[0008] If the touch object is jittering during its stay, the position of the touch point in the Nth frame is used as the reported position of the touch point in the N+1th frame;
[0009] If it is sliding, the position of the touch point in the N+1th frame / the position close to the position of the touch point in the N+1th frame is used as the reported point position of the touch point in the N+1th frame.
[0010] In one embodiment, the predicting, based on the position change information of the touch point in at least two frames before the N+1 frame touch signal, that the action between the Nth frame and the N+1th frame is a jitter or a slide during the stay of the touch object includes:
[0011] The point stability range of the Nth frame is determined by using a value converted from a distance between a touch point of the Nth frame and a touch point of the N-1th frame as a range reference amount and using the touch point of the Nth frame as a reference point;
[0012] If the position of the touch point in the N+1th frame is within the determined point stability range, the action between the Nth frame and the N+1th frame is jitter during the stay of the touch object; otherwise, the action between the Nth frame and the N+1th frame is sliding.
[0013] In one embodiment, the position of the touch point in the N+1th frame is predicted by the actual position of the touch point in at least two frames before the N+1th frame touch signal.
[0014] In one embodiment, the position of the touch point in the N+1th frame is the actual position of the touch point in the N+1th frame.
[0015] In one embodiment, the range reference is obtained based on the product of the interval and a specified ratio value, and the specified ratio value is less than or equal to 1.
[0016] According to a second aspect of an embodiment of the present disclosure, a device for determining a touch point position is provided, the device comprising:
[0017] The action prediction module is configured to predict the action between the Nth frame and the N+1th frame as a jitter or a slide during the stay of the touch object based on the position change information of the touch point in at least two frames before the N+1th frame touch signal;
[0018] The position determination module is configured to use the position of the touch point in the Nth frame as the reported position of the touch point in the N+1th frame if it is a jitter during the touch object's stay; and to use the position of the touch point in the N+1th frame / a position close to the position of the touch point in the N+1th frame as the reported position of the touch point in the N+1th frame if it is a slide.
[0019] In one embodiment, the action prediction module is specifically configured as follows:
[0020] The point stability range of the Nth frame is determined by using a value converted from a distance between a touch point of the Nth frame and a touch point of the N-1th frame as a range reference amount and using the touch point of the Nth frame as a reference point;
[0021] If the position of the touch point in the N+1th frame is within the determined point stability range, the action between the Nth frame and the N+1th frame is jitter during the stay of the touch object; otherwise, the action between the Nth frame and the N+1th frame is sliding.
[0022] In one embodiment, the position of the touch point in the N+1th frame is predicted by the actual position of the touch point in at least two frames before the N+1th frame touch signal.
[0023] In one embodiment, the position of the touch point in the N+1th frame is the actual position of the touch point in the N+1th frame.
[0024] In one embodiment, the range reference is obtained based on the product of the interval and a specified ratio value, and the specified ratio value is less than or equal to 1.
[0025] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:
[0026] processor;
[0027] a memory for storing processor-executable instructions;
[0028] The processor is configured to read computer instructions from the memory to implement any of the above methods for determining the position of a touch point.
[0029] According to a fourth aspect of an embodiment of the present disclosure, there is provided a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any of the above methods are implemented.
[0030] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:
[0031] The disclosed embodiment predicts, based on the position change information of the touch point in at least two frames before the N+1th frame touch signal, that the action between the Nth frame and the N+1th frame is jitter or sliding during the stay of the touch object. If it is jitter during the stay of the touch object, the position of the touch point in the Nth frame is used as the reported point position of the touch point in the N+1th frame; if it is sliding, the position of the touch point in the N+1th frame / a position close to the position of the touch point in the N+1th frame is used as the reported point position of the touch point in the N+1th frame. By predicting jitter and sliding, it is possible to consider point stability, avoid point coordinate updates due to tiny coordinate jitter, and consider point chirality, so as to avoid a large distance between the reported point coordinates and the actual touch point coordinates of the touch object in order to ensure point stability.
[0032] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0034] Figure 1 It is a schematic diagram of the point stability range illustrated in the present disclosure.
[0035] Figure 2 The present invention is a flowchart of a method for determining a reporting point position of a touch point according to an exemplary embodiment of the present invention.
[0036] Figure 3 The figure is a schematic diagram of touch point positions between multiple frames according to an exemplary embodiment of the present disclosure.
[0037] Figure 4 The figure is a flowchart of another method for determining the position of a touch point according to an exemplary embodiment of the present disclosure.
[0038] Figure 5 The present invention is a block diagram of a device for determining a touch point position according to an exemplary embodiment of the present invention.
[0039] Figure 6 The figure is a schematic diagram of the structure of a device for determining a reporting position of a touch point according to an exemplary embodiment. DETAILED DESCRIPTION
[0040] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0041] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.
[0042] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".
[0043] The touch object, also called the touch body, can be an operating body that can be recognized by the screen, such as a finger, palm, stylus, etc. When the touch object touches the screen, the signal acquisition module can collect touch signals. The signal acquisition module is a unit for collecting touch signals, for example, it can be a touch sensor electrode.
[0044] In order to ensure point stability, a range can be set based on the reported point coordinates of the Nth frame, called the point stability range of the Nth frame. The points of the N+1th frame that do not exceed the point stability range will keep the coordinates of the Nth frame unchanged to avoid coordinate changes caused by small movements.
[0045] In order to ensure the hand tracking, it is hoped that the reported coordinates of any touch point in any frame are as close as possible to the actual position of the touch object, and a smaller point stability range is preferred or the point stability range is removed.
[0046] In order to ensure that the touch point follows the movement of the hand, a new touch point position is calculated for each small movement. The touch point may jitter due to frequent updates of the touch point position. The inventors found that if the touch point coordinates are determined using a fixed point stability range each time, it is not conducive to hand tracking. Figure 1 The figure shows a schematic diagram of the point stability range. Based on the point reported in the Nth frame, there is a fixed-size point stability range (within the dotted circle). If the point reported in the N+1th frame is still within this range, the coordinates are kept the same as those in the Nth frame. Therefore, the coordinates of the N+1th frame are the same as those of the Nth frame, and there is no movement, which can ensure point stability. However, at the same time, if the point reported in the N+1th frame is just at the edge of the point stability range, there will be a large distance between the reported point coordinates and the point coordinates where the hand actually touches the screen, such as Figure 1 The distance between the reported points in the Nth frame and the reported points in the N+1th frame is not conducive to tracking hand quality.
[0047] In view of this, the embodiments of the present disclosure provide a solution for determining the reported position of a touch point. According to the position change information of the touch point in at least two frames before the touch signal of the N+1th frame, it is predicted that the action between the Nth frame and the N+1th frame is a jitter or a slide during the stay of the touch object. If it is a jitter during the stay of the touch object, the position of the touch point in the Nth frame is used as the reported position of the touch point in the N+1th frame; if it is a slide, the position of the touch point in the N+1th frame / a position close to the position of the touch point in the N+1th frame is used as the reported position of the touch point in the N+1th frame. By predicting the jitter and slide, it is possible to consider the point stability, avoid the point coordinate update while avoiding the small coordinate jitter, and consider the point tracking chirality, so as to avoid the situation where the distance between the reported point coordinates and the actual touch point coordinates of the touch object is large in order to ensure the point stability.
[0048] The embodiments of the present disclosure can be applied to electronic devices including touch screens, and can also be applied to modules for determining the position of touch points, such as touch screen ICs of electronic devices. The touch screens mentioned in the present disclosure include In-Cell, On-Cell, OGS (One Glass Solution), G / G (Cover Glass / Sensor Glass, protective glass layer / sensing glass layer, the sensing glass layer can also be called a touch function layer) and GFF (Cover Glass Film / Film, protective glass conductive layer / conductive layer) and other types of touch screens. In-Cell refers to a method of embedding the touch function into the liquid crystal pixels of a display screen, that is, embedding the touch sensor function inside the display screen; On-Cell refers to a method of embedding the touch screen between the color filter substrate and the polarizer of the display screen, that is, providing the touch function on the liquid crystal panel of the display screen. OGS technology integrates the touch screen with the protective glass, and coats the inner side of the protective glass with an ITO conductive layer. G / G and GFF touch screens refer to touch detection devices of the touch screen system installed on the upper layer of the display screen.
[0049] In the disclosed embodiments, the term "electronic device" includes various handheld devices with touch screens, vehicle-mounted devices, wearable devices, computing devices, etc. For example, smart phones, tablet computers, smart watches, PDAs (Personal Digital Assistants), e-book readers, multimedia players, etc.
[0050] like Figure 2 As shown, Figure 2 FIG. 1 is a flowchart of a method for determining a reported position of a touch point according to an exemplary embodiment of the present disclosure. The method may include the following steps:
[0051] In step 202, based on the position change information of the touch point in at least two frames before the N+1 frame touch signal, it is predicted that the action between the Nth frame and the N+1th frame is a jitter or a slide during the stay of the touch object;
[0052] In step 204, if the touch object is jittering during its stay, the position of the touch point in the Nth frame is used as the reported position of the touch point in the N+1th frame;
[0053] In step 206, if it is sliding, the position of the touch point in the N+1th frame / the position close to the position of the touch point in the N+1th frame is used as the reported point position of the touch point in the N+1th frame.
[0054] The at least two frames include the Nth frame and one or more frames before the Nth frame. It should be understood that this embodiment uses the data of the first few frames to predict the actions in the last two frames, and then determines the reported position of the touch point in the last frame. For distinction, the last two frames are named the Nth frame and the N+1th frame.
[0055] In one embodiment, the at least two frames include the N-1th frame and the Nth frame, so as to use the data of the first two frames to predict the action of the next two frames, that is, to use the position change information of the touch points of the two frames to predict whether the action between the Nth frame and the N+1th frame is a jitter or a slide during the stay of the touch object.
[0056] The jitter during the touch object's stay may refer to a small coordinate change during the touch object's sliding process, which is an action that is expected to be ignored; sliding may refer to a slightly larger coordinate change, which is an action that is expected to reflect the touch point. The movement process of the touch object is often inertial, and the position change information in the previous frame can be used to predict that the action between the Nth frame and the N+1th frame is a jitter or a slide during the touch object's stay.
[0057] In one example, whether the action between the Nth frame and the N+1th frame is a jitter or a slide during the stay of the touch object can be determined by: the position of the touch point of the N+1th frame, and the distance between the touch point of the Nth frame and the touch point of the N-1th frame. It should be understood that it is not limited to the distance between the touch point of the Nth frame and the touch point of the N-1th frame, and can also be the distance between the touch points in other frames of at least two frames, or other factors to determine whether the action between the Nth frame and the N+1th frame is a jitter or a slide during the stay of the touch object.
[0058] For example, predicting the action between the Nth frame and the N+1th frame as a jitter or a slide during the stay of the touch object based on the position change information of the touch point in at least two frames before the N+1th frame touch signal includes:
[0059] The point stability range of the Nth frame is determined by using a value converted from a distance between a touch point of the Nth frame and a touch point of the N-1th frame as a range reference amount and using the touch point of the Nth frame as a reference point;
[0060] If the position of the touch point in the N+1th frame is within the determined point stability range, the action between the Nth frame and the N+1th frame is jitter during the stay of the touch object; otherwise, the action between the Nth frame and the N+1th frame is sliding.
[0061] Among them, the position change information of the touch point in at least two frames may include the distance D between the touch point of the Nth frame and the touch point of the N-1th frame. The range reference amount can be a reference amount used to determine the point stability range, which can be a radius value or a short radius value or a long radius value, etc., determined according to the shape of the point stability range. For example, the shape of the point stability range may include but is not limited to a circle, an ellipse, etc. The range reference amount can be obtained by converting the distance between the touch point of the Nth frame and the touch point of the N-1th frame. For example, the range reference amount can be a function related to the distance between the touch point of the Nth frame and the touch point of the N-1th frame. For example, the range reference amount is obtained based on the product of the distance and a specified ratio value, and the specified ratio value is less than or equal to 1.
[0062] Regarding whether the position of the touch point in the N+1th frame is within the determined point stability range, for example, the distance between the reported point in the Nth frame and the reported point in the N+1th frame can be directly compared with the range reference amount.
[0063] like Figure 3 FIG. 1 is a schematic diagram of a touch point position in multiple frames according to an exemplary embodiment of the present disclosure. The radius R of the point stability range of the Nth frame is determined by the following formula:
[0064]
[0065] Indicates the specified ratio value, and D indicates the distance between the N-1th frame and the Nth frame. If the distance between the Nth frame and the N+1th frame is less than or equal to the radius R, it tends to be considered as a slight jitter, and the stability of the point is more important, and the coordinates reported to the system are closer to the position of the Nth frame; if the distance between the Nth frame and the N+1th frame is greater than the radius R, it tends to be considered as a sliding behavior, and the chirality is more important, and the coordinates reported to the system are closer to the position of the N+1th frame. The specified ratio value can be determined according to the platform or electronic device or other requirements. For example, if you pursue speed, the smaller the specified ratio value is within a certain range, the better. If you pursue stability or are limited by the hardware requirements of the electronic device, the specified ratio value can be larger, or even 1.
[0066] It should be understood that the range reference amount may also be determined by the distance between the touch point in the other frame and the frame in at least two frames, or by other data of at least two frames, etc., which will not be elaborated here.
[0067] Regarding the position of the touch point in the N+1th frame, in one embodiment, the position of the touch point in the N+1th frame is the actual position of the touch point in the N+1th frame.
[0068] In this embodiment, after obtaining the actual position of the touch point in the Nth frame and before the Nth frame, and the actual position of the touch point in the N+1th frame, the actual position of the touch point in the previous frames can be used to predict the movement of the touch point in the Nth frame and the N+1th frame. Specifically, the actual position of the touch point in the previous frames can be used to adjust the point stability range of the Nth frame, and the reported position of the touch point in the N+1th frame is determined by comparing the actual position of the N+1th frame with the point stability range of the Nth frame. For example, the N+1th frame is the current frame. When the touch signal of the N+1th frame is detected, if the reported point position of the N+1th frame is to be reported, the reported position of the touch point in the N+1th frame is determined by comparing the actual position of the N+1th frame with the point stability range of the Nth frame.
[0069] In another embodiment, the position of the touch point in the N+1th frame may be predicted from the actual position of the touch point in at least two frames before the N+1th frame touch signal.
[0070] In this embodiment, when the actual position of the touch point in the Nth frame and before the Nth frame is obtained, the actual position of the touch point in the previous frames can be used to predict the position of the N+1 frame, referred to as the predicted position of the N+1th frame, and the actual position of the touch point in the previous frames can be used to adjust the point stability range of the Nth frame, and the reported position of the touch point in the N+1th frame is determined by comparing the predicted position of the N+1th frame with the point stability range of the Nth frame. For example, the Nth frame is the current frame, and when the touch signal of the Nth frame is detected, the position of the touch point in the N+1th frame is predicted.
[0071] This embodiment can report the reported position of the N+1th frame without obtaining the actual position of the touch point of the N+1th frame.
[0072] Regarding how to predict the position of the touch point of the N+1th frame, in one example, the position of the touch point of the N-1th frame and the position of the touch point of the Nth frame can be obtained by weighted summation. For example, the position of the touch point of the N-1th frame is multiplied by the first weight value, the position of the touch point of the Nth frame is multiplied by the second weight value, and the two products are added to obtain the position of the touch point of the N+1th frame. The first weight value and the second weight value can be configured according to actual needs. For example, if faster speed is pursued, the second weight value can be greater than the first weight value. If accuracy needs to be ensured, the second weight value can be equal to the first weight value, etc. This embodiment can quickly obtain the position of the touch point of the N+1th frame by weighted summation of the position of the touch point of the N-1th frame and the position of the touch point of the Nth frame.
[0073] It should be understood that other existing or future methods for determining the position of the touch point of the N+1th frame may also be applicable to the present disclosure and should be included in the protection scope of the present disclosure. For example, the position of the touch point of the N+1th frame may be predicted based on the touch point velocity and acceleration determined from multiple frames of data.
[0074] The reported point position of the touch point may be the position reported to the processing module for the touch point, for example, the reported point coordinates. The reported point position of the touch point may be the actual position of the touch point or may not be the actual position of the touch point. Therefore, in order to distinguish, the position reported to the processing module is called the reported point position.
[0075] If it is a jitter during the touch object's stay, the position of the touch point in the Nth frame is used as the reported position of the touch point in the N+1th frame, thereby avoiding the update of the touch point position caused by the jitter. If it is a slide, the position of the touch point in the N+1th frame is used as the reported position of the touch point in the N+1th frame, or a position close to the position of the touch point in the N+1th frame is used as the reported position of the touch point in the N+1th frame. The close position can be a position within the specified range of the position of the touch point in the N+1th frame. For example, the position between the touch point in the Nth frame and the touch point in the N+1th frame and close to the touch point in the N+1th frame can be used as the reported position of the touch point in the N+1th frame.
[0076] After determining the reported position of the touch point in the N+1th frame, it can be reported to the processing module. If the reported position of the touch point in the N+1th frame is the same as the reported position of the touch point in the Nth frame, the original touch point is kept unchanged; if the reported position of the touch point in the N+1th frame is different from the reported position of the touch point in the Nth frame, it is moved.
[0077] The various technical features in the above embodiments can be arbitrarily combined as long as there is no conflict or contradiction between the combinations of features. However, due to space limitations, they are not described one by one. Therefore, any combination of the various technical features in the above embodiments also falls within the scope of this specification.
[0078] like Figure 4 As shown, Figure 4 FIG. 1 is a flowchart of another method for determining the position of a touch point according to an exemplary embodiment of the present disclosure. The method describes a combined embodiment thereof based on the aforementioned embodiment, and includes the following steps:
[0079] In step 402, a point stability range of the Nth frame is determined by using a value converted from a distance between a touch point of the Nth frame and a touch point of the N-1th frame as a range reference amount and using the touch point of the Nth frame as a reference point;
[0080] In step 404, if the position of the touch point in the N+1th frame is within the determined point stability range, the position of the touch point in the Nth frame is used as the reported point position of the touch point in the N+1th frame;
[0081] In step 406, if the position of the touch point in the N+1th frame is not within the determined point stability range, the actual position of the touch point in the N+1th frame is used as the reported point position of the touch point in the N+1th frame.
[0082] This embodiment improves the stability of the point reporting while improving the chirality of the finger movement, which can avoid the situation where the coordinates of the lifted finger are jittery and unstable after the finger slides and then lifts vertically; it can also avoid the situation where the finger slides and then naturally leaves non-vertically, the acceleration and speed are misjudged, and the fast sliding becomes slow sliding or slow sliding becomes fast sliding. By predicting the action, the size of the point stability range is dynamically adjusted, not a single fixed range.
[0083] For the aforementioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present disclosure is not limited by the described order of actions, because according to the present disclosure, certain steps can be performed in other orders or simultaneously.
[0084] Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to the present disclosure.
[0085] Corresponding to the embodiments of the aforementioned method for determining the position of a touch point, the present disclosure further provides embodiments of an apparatus for determining the position of a touch point, a device used by the apparatus, and a storage medium.
[0086] like Figure 5 As shown, Figure 5 : is a block diagram of a device for determining a touch point position according to an exemplary embodiment of the present disclosure, the device comprising:
[0087] The action prediction module 52 is configured to predict the action between the Nth frame and the N+1th frame as a jitter or a slide during the stay of the touch object based on the position change information of the touch point in at least two frames before the N+1th frame touch signal;
[0088] The position determination module 54 is configured to use the position of the touch point in the Nth frame as the reported position of the touch point in the N+1th frame if it is a jitter during the touch object's stay; and to use the position of the touch point in the N+1th frame / a position close to the position of the touch point in the N+1th frame as the reported position of the touch point in the N+1th frame if it is a slide.
[0089] In one embodiment, the action prediction module 52 is specifically configured as follows:
[0090] The point stability range of the Nth frame is determined by using a value converted from a distance between a touch point of the Nth frame and a touch point of the N-1th frame as a range reference amount and using the touch point of the Nth frame as a reference point;
[0091] If the position of the touch point in the N+1th frame is within the determined point stability range, the action between the Nth frame and the N+1th frame is jitter during the stay of the touch object; otherwise, the action between the Nth frame and the N+1th frame is sliding.
[0092] In one embodiment, the position of the touch point in the N+1th frame is predicted by the actual position of the touch point in at least two frames before the N+1th frame touch signal.
[0093] In one embodiment, the position of the touch point in the N+1th frame is the actual position of the touch point in the N+1th frame.
[0094] In one embodiment, the range reference is obtained based on the product of the interval and a specified ratio value, and the specified ratio value is less than or equal to 1.
[0095] The specific details of the implementation process of the functions and effects of each module in the above-mentioned device can be found in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.
[0096] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the disclosed solution. A person of ordinary skill in the art can understand and implement it without paying creative labor.
[0097] Accordingly, the present disclosure also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any of the above methods are implemented.
[0098] The present disclosure may take the form of a computer program product implemented on one or more storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code. Computer-usable storage media include permanent and non-permanent, removable and non-removable media, and information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0099] Accordingly, an embodiment of the present disclosure provides an electronic device, the device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to implement any of the above methods for determining the location of a touch point. For example, one of the methods may include:
[0100] Predicting, based on position change information of the touch point in at least two frames before the N+1 frame touch signal, that the action between the N frame and the N+1 frame is a jitter or a slide during the stay of the touch object;
[0101] If the touch object is jittering during its stay, the position of the touch point in the Nth frame is used as the reported position of the touch point in the N+1th frame;
[0102] If it is sliding, the position of the touch point in the N+1th frame / the position close to the position of the touch point in the N+1th frame is used as the reported point position of the touch point in the N+1th frame.
[0103] Figure 6 1 is a schematic diagram of a touch point location determination device 600 according to an exemplary embodiment. For example, the device 600 may be a user device, which may be a mobile phone, a computer, a digital broadcast terminal, a message transceiver device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a wearable device such as a smart watch, a smart glasses, a smart bracelet, a smart running shoe, etc.
[0104] Reference Figure 6 , the device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .
[0105] The processing component 602 generally controls the overall operation of the device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.
[0106] The memory 604 is configured to store various types of data to support operations on the device 600. Examples of such data include instructions for any application or method operating on the device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0107] The power supply component 606 provides power to the various components of the device 600. The power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 600.
[0108] The multimedia component 608 includes a screen that provides an output interface between the above-mentioned device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The above-mentioned touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the above-mentioned touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.
[0109] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the device 600 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.
[0110] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0111] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the device 600. For example, the sensor assembly 614 can detect the open / closed state of the device 600, the relative positioning of the components, such as the display and keypad of the device 600, the sensor assembly 614 can also detect the position change of the device 600 or a component of the device 600, the presence or absence of user contact with the device 600, the orientation or acceleration / deceleration of the device 600 and the temperature change of the device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.
[0112] The communication component 616 is configured to facilitate wired or wireless communication between the device 600 and other devices. The device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 5G NR or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0113] In an exemplary embodiment, the apparatus 600 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.
[0114] In an exemplary embodiment, a non-transitory computer-readable storage medium is also provided, such as a memory 604 including instructions. When the instructions in the storage medium are executed by a processor 620 of the device 600, the device 600 is enabled to perform a method for determining a touch point position, the method comprising:
[0115] Predicting, based on position change information of the touch point in at least two frames before the N+1 frame touch signal, that the action between the N frame and the N+1 frame is a jitter or a slide during the stay of the touch object;
[0116] If the touch object is jittering during its stay, the position of the touch point in the Nth frame is used as the reported position of the touch point in the N+1th frame;
[0117] If it is sliding, the position of the touch point in the N+1th frame / the position close to the position of the touch point in the N+1th frame is used as the reported point position of the touch point in the N+1th frame.
[0118] The non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
[0119] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.
[0120] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A method for determining the position of a touch point, characterized in that: The method comprises: Predicting, based on position change information of the touch point in at least two frames before the N+1 frame touch signal, that the action between the N frame and the N+1 frame is a jitter or a slide during the stay of the touch object; If the touch object is jittering during its stay, the position of the touch point in the Nth frame is used as the reported position of the touch point in the N+1th frame; If it is sliding, the position of the touch point in the N+1th frame / the position close to the position of the touch point in the N+1th frame is used as the reported position of the touch point in the N+1th frame; The predicting, based on the position change information of the touch point in at least two frames before the N+1 frame touch signal, that the action between the Nth frame and the N+1th frame is a jitter or a slide during the stay of the touch object includes: Using a value converted from the distance between the touch point of the Nth frame and the touch point of the N-1th frame as a range reference, and using the touch point of the Nth frame as a reference point, determining a point stability range of the Nth frame; If the position of the touch point in the N+1th frame is within the determined point stability range, the action between the Nth frame and the N+1th frame is jitter during the stay of the touch object; otherwise, the action between the Nth frame and the N+1th frame is sliding.
2. The method according to claim 1, characterized in that The position of the touch point in the N+1th frame is predicted by the actual position of the touch point in at least two frames before the N+1th frame touch signal.
3. The method according to claim 1, characterized in that The position of the touch point in the N+1th frame is the actual position of the touch point in the N+1th frame.
4. The method according to any one of claims 1 to 3, characterized in that: The range reference is obtained based on a product of the interval and a specified ratio value, where the specified ratio value is less than or equal to 1.
5. A device for determining the position of a touch point, characterized in that: The device comprises: The action prediction module is configured to predict the action between the Nth frame and the N+1th frame as a jitter or a slide during the stay of the touch object based on the position change information of the touch point in at least two frames before the N+1th frame touch signal; The position determination module is configured to use the position of the touch point in the Nth frame as the reported position of the touch point in the N+1th frame if the touch object is jittering during the stay process; and use the position of the touch point in the N+1th frame / a position close to the position of the touch point in the N+1th frame as the reported position of the touch point in the N+1th frame if the touch object is sliding; Wherein, the action prediction module is specifically configured as follows: The point stability range of the Nth frame is determined by using a value converted from a distance between a touch point of the Nth frame and a touch point of the N-1th frame as a range reference amount and using the touch point of the Nth frame as a reference point; If the position of the touch point in the N+1th frame is within the determined point stability range, the action between the Nth frame and the N+1th frame is jitter during the stay of the touch object; otherwise, the action between the Nth frame and the N+1th frame is sliding.
6. The device according to claim 5, characterized in that The position of the touch point in the N+1th frame is predicted by the actual position of the touch point in at least two frames before the N+1th frame touch signal.
7. The device according to claim 5, characterized in that The position of the touch point in the N+1th frame is the actual position of the touch point in the N+1th frame.
8. The device according to any one of claims 5 to 7, characterized in that The range reference is obtained based on a product of the interval and a specified ratio value, where the specified ratio value is less than or equal to 1.
9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to read computer instructions from the memory to implement the method for determining the position of a touch point as claimed in any one of claims 1 to 4.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.
Citation Information
Patent Citations
Control method and electronic device
CN106055187A