Method for preventing touch screen from being touched by mistake and related device

Abstract

The invention provides a method for preventing mistakenly touching a touch screen, which is applied to a process of writing on canvas of the touch screen and comprises the following steps of: detecting at least one touch point based on the detected touch point; determining a small-area contact and / or a large-area contact based on the area of the at least one contact, and responding to a first operation based on the number of the contacts; on the basis of the number of the large-area contacts and / or the small-area contacts, motion characteristics and nearby area preorder events, mistaken touch mode contacts and non-mistaken touch mode contacts are determined, and the motion characteristics comprise one or more of the motion rate, the motion track, the motion direction and the stay duration; and responding to a second operation for the mistaken touch mode contact, the second operation being used for cancelling the first operation, and processing the first operation product. By using the method, the condition of mistakenly touching the touch screen can be effectively avoided, and the user experience can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of terminal equipment, and in particular to a method and a related device for preventing accidental touching of a touch screen. Background Art

[0002] At present, the touch screen sizes of terminal devices such as mobile phones, notebooks, and tablets on the market are getting larger and larger. When users use touch screen whiteboards or other touch screen devices for annotation, they may encounter problems such as the other hand being unable to write normally due to the hand being on the edge of the touch screen, or other operation gestures being triggered by mistake. Since most users are accustomed to writing with one hand and holding the other hand on the edge of the touch screen when writing, in addition, when multiple touch points are detected on the touch screen at the same time, various problems will be triggered by mistake, such as mistaken erasure, mistaken zooming, etc. In order to avoid affecting normal writing, accurate judgment of the intention of the touch point is the key to solving the current problem. In other words, solving the problem of anti-mistouching of touch screens has become an urgent problem to be solved. Summary of the invention

[0003] In the first aspect, the present application proposes a method for preventing accidental touches on a touch screen, which is mainly used in the process of writing on the canvas of the touch screen, including: based on at least one detected touch point; based on the area of ​​the at least one touch point, determining small-area touch points and / or large-area touch points, and responding to a first operation based on the number of touch points; based on the number of the large-area touch points and / or the small-area touch points, motion characteristics, and preceding events in the nearby area, determining accidental touch mode touch points and non-accidental touch mode touch points, wherein the motion characteristics include one or more of motion rate, motion trajectory, motion direction, and dwell time; responding to a second operation for the accidental touch mode touch points, the second operation being used to cancel the first operation and process the product of the first operation.

[0004] Exemplarily, the method is mainly used to detect the appearance of other touch points during writing on a touch screen, based on the area of ​​the touch points, the number of touch points, the movement characteristics of the touch points, and previous events in the vicinity of the touch points, wherein the previous events in the vicinity refer to whether a touch point is detected within a first time interval before the touch point falls within a certain area, wherein the first time interval may be a shorter time interval set manually, and this feature is mainly used to determine whether other touch points are detected falling before the touch point within a certain range around a single small-area touch point that is a writing touch point.

[0005] This solution proposes a method for preventing accidental touches on a touch screen, which can effectively avoid the impact of accidental touches during normal writing and effectively improve the user experience.

[0006] In one possible implementation, the small-area contacts and / or large-area contacts are determined based on the area of ​​the at least one contact, and a first operation is responded to based on the number of contacts, including: starting a writing mode based on a single small-area contact; starting a move zoom waiting mode based on at least two small-area contacts that appear within a first time interval; and starting an eraser erasing mode based on a large-area contact.

[0007] In this scheme, the intention of the touch can be determined based on the area and number of the detected touch points. For example, if the detection and judgment result is a single small-area touch point, the writing mode will usually be started; for at least two small-area touch points, the canvas move zoom waiting mode will be started; for large-area touch points, the eraser erasing mode will be started.

[0008] In one possible implementation, the response to the second operation for the false touch mode contact includes: for a single small-area contact judged as a false touch mode, interrupting the writing operation of the single small-area contact and erasing the written ink of the single small-area contact; for at least two small-area contacts judged as false touch mode, interrupting the moving, zooming and waiting operations of the at least two small-area contacts and freezing the canvas; for a large-area contact judged as a false touch mode, interrupting the erasing operation of the large-area contact and restoring the erased ink of the large-area contact.

[0009] In one possible implementation, the determining of mistouch mode contacts and non-mistouch mode contacts based on the number and movement characteristics of the large-area contacts and / or the small-area contacts includes: determining that the large-area contacts are one of eraser mode contacts and mistouch mode contacts based on the number and movement characteristics of the large-area contacts; and determining that the small-area contacts are one of moving zoom mode contacts, writing mode contacts and mistouch mode contacts based on the number and movement characteristics of the small-area contacts.

[0010] In one possible implementation, the large-area contact is determined to be one of an eraser mode contact and a false touch mode contact based on the number and movement characteristics of the large-area contact, including: the large-area contact satisfies a first condition and is determined to be a false touch mode contact; wherein the first condition is that the movement rate of the contact is less than a first preset rate, and the residence time of the contact is greater than the first preset time, and the contact is determined to be the false touch mode contact.

[0011] In this solution, when the contact meets the first condition, it is considered that the contact is in a relatively static state, and is therefore considered to be in a false touch mode.

[0012] In one possible implementation, based on the number of the small-area contacts, the movement characteristics and the preceding events in the vicinity, it is determined that the small-area contacts are one of the mobile zoom mode contacts, the writing mode contacts and the mis-touch mode contacts, including: the small-area contacts satisfying the first condition are determined to be mis-touch mode contacts; the at least two small-area contacts do not satisfy the first condition, and the movement directions of the at least two small-area contacts do not satisfy the second condition, and the at least two small-area contacts are determined to be mis-touch contacts; wherein the second condition includes one of regular motion, motion in the same direction, motion towards each other and motion in opposite directions.

[0013] In this solution, when the contact does not meet the first condition, further judgment of subsequent steps is required. When at least two small surface contacts do not meet any of regular movement, movement in the same direction, movement towards each other, and movement in opposite directions, the at least two contacts are considered to be false touch contacts.

[0014] In the second aspect, the present application proposes a device for preventing accidental touches on a touch screen, which is used in the process of writing on the canvas of the touch screen, and includes: a detection module, used to detect touch points appearing on the touch screen; a processing module, used to determine small-area touch points and / or large-area touch points based on the area of ​​at least one detected touch point, and respond to a first operation based on the number of touch points; a judgment module, used to determine accidental touch mode touch points and non-accidental touch mode touch points based on the number, motion characteristics and preceding events in the vicinity of the large-area touch points and / or the small-area touch points, wherein the motion characteristics include one or more of motion rate, motion trajectory, motion direction and dwell time; the processing module is also used to respond to a second operation to the accidental touch mode touch points, and the second operation is used to cancel the first operation and process the product of the first operation.

[0015] In one possible implementation, the first operation based on the number of contacts in response also includes: starting a writing mode based on a single small-area contact; starting a move zoom waiting mode based on at least two small-area contacts appearing within a first time interval; and starting an eraser erasing mode based on a large-area contact.

[0016] In one possible implementation, the processing module responds to the second operation of the false touch mode contact and further includes: for a single small-area contact judged as a false touch mode, interrupting the writing operation of the single small-area contact and erasing the written ink of the single small-area contact; for at least two small-area contacts judged as false touch mode, interrupting the moving, zooming and waiting operations of the at least two small-area contacts and freezing the canvas; for a large-area contact judged as a false touch mode, interrupting the erasing operation of the large-area contact and restoring the erased ink of the large-area contact.

[0017] In one possible implementation, the judgment module includes: based on the number and movement characteristics of the large-area contacts, determining that the large-area contacts are one of eraser mode contacts and mistouch mode contacts; based on the number and movement characteristics of the small-area contacts, determining that the small-area contacts are one of moving zoom mode contacts, writing mode contacts and mistouch mode contacts.

[0018] In one possible implementation, the large-area contact is determined to be one of an eraser mode contact and a false touch mode contact based on the number and movement characteristics of the large-area contact, including: the large-area contact satisfies a first condition and is determined to be a false touch mode contact; wherein the first condition is that the movement rate of the contact is less than a first preset rate, and the residence time of the contact is greater than the first preset time, and the contact is determined to be the false touch mode contact.

[0019] In one possible implementation, based on the number and movement characteristics of the small-area contacts, determining that the small-area contacts are one of a moving zoom mode contact, a writing mode contact, and an error-touch mode contact includes: the small-area contacts satisfying the first condition are determined to be error-touch mode contacts; the at least two small-area contacts do not satisfy the first condition, and the movement directions of the at least two small-area contacts do not satisfy the second condition, and the at least two small-area contacts are determined to be error-touch contacts; wherein the second condition includes one of regular motion, motion in the same direction, motion toward each other, and motion in opposite directions.

[0020] In a third aspect, a touch screen device is proposed, which includes at least a touch screen and a processor. When the touch screen device is writing on the touch screen, the processor executes the method described in the first aspect or any possible implementation method thereof.

[0021] In a fourth aspect, a computer-readable storage medium is proposed, wherein the computer-readable storage medium contains instructions. When the instructions are executed on a computer, the computer executes the method described in the first aspect or any possible implementation thereof.

[0022] In a fifth aspect, a computer program product is proposed, wherein the computer-readable storage medium contains instructions, and when the instructions are executed on a computer, the computer executes the method described in the first aspect or any possible implementation thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] FIG1 is a schematic diagram of an architecture of an application scenario provided in an embodiment of the present application;

[0024] Figure 2 A flow chart of a method for preventing accidental touches on a touch screen provided in an embodiment of the present application;

[0025] Figure 3 A flowchart of another method for preventing accidental touches on a touch screen provided in an embodiment of the present application;

[0026] Figure 4 A flowchart of another method for preventing accidental touches on a touch screen provided in an embodiment of the present application;

[0027] Figure 5 A flowchart of another method for preventing accidental touches on a touch screen provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solutions and advantages of the present application clearer, the embodiments of the present application are described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only embodiments of a part of the present application, rather than all embodiments. It is known to those of ordinary skill in the art that with the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0029] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the descriptions used in this way can be interchanged where appropriate, so that the embodiments can be implemented in a sequence other than that illustrated or described in the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules that are clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices. The naming or numbering of the steps that appear in the present application does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The process steps that have been named or numbered can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.

[0030] The division of units in this application is a logical division. There may be other division methods when it is implemented in actual applications. For example, multiple units can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection between units can be electrical or other similar forms, which are not limited in this application. In addition, the units or sub-units described as separate components may or may not be physically separated, may or may not be physical units, or may be distributed in multiple circuit units, and some or all of the units may be selected according to actual needs to achieve the purpose of the present application.

[0031] To facilitate understanding, some technical terms and physical components involved in the embodiments of the present application are first introduced below.

[0032] (1) Large size electronic touch screen

[0033] Large-size screens with multi-touch function, including but not limited to capacitive screens, infrared screens, resistive screens, etc.

[0034] (2) Writing pen

[0035] Styluses that can be used to write on electronic touch screens include but are not limited to capacitive pens, passive pens, active pens, etc.

[0036] (3) Canvas

[0037] The canvas exists on the touch screen. The canvas is used to place controls and limit the area where controls can be dragged and stretched. The canvas module sets background images or background colors, controls layout, canvas ratio settings, responsive canvas, full-screen display, etc.

[0038] (4) SVM model

[0039] SVM, also known as support vector machine (SVM), is a binary classification model. Its basic model is a linear classifier with the largest interval defined in the feature space. Its learning strategy is to maximize the interval. At the same time, this method can be formalized as a solution. Figure 2 Secondary planning.

[0040] In this embodiment, the SVM model is used to generate multiple contact relative motion pattern classifiers:

[0041] During the training process, the relative motion direction features of all contacts within 100ms in the moving, scaling gestures, and accidental writing scenes in the training set are extracted to support the SVM model to distinguish these three scenes. During the reasoning process, multiple contacts to be inferred are combined in pairs, and the relative motion direction features of the two contacts within 100ms are obtained as the input features of the classifier. The classifier's scene classification result for the input (moving, scaling, and accidental touch scenes) is obtained based on the feature vector distribution of the input features. As long as any pair of contacts among all existing contacts is classified as moving or scaling contacts by the classifier, the current mode is determined to be moving and scaling.

[0042] (5) GRU model

[0043] GRU, or gated neural unit, is a variant of recurrent neural network. GRU (Gate Recurrent Unit, GRU) uses an update gate and a reset gate. Basically, these two gating vectors determine which information can eventually be used as the output of the gated recurrent unit. The special thing about these two gating mechanisms is that they can preserve information in long-term sequences and will not be cleared over time or removed because it is not relevant to the prediction.

[0044] In this embodiment, the GRU model can be used to generate multiple contact relative motion pattern classifiers:

[0045] The training method of the multi-touch relative motion pattern classifier based on the GRU model is basically the same as that of the SVM classifier. The difference is that if it is necessary to classify the multi-touch relative motion direction features within a relatively long time window, the GRU model should be used instead of the SVM model.

[0046] The main application scenario of the present invention is when a user uses a large-screen whiteboard or other annotation software to write and annotate, and the other hand cannot write normally or other operation gestures are triggered by mistake because the hand holds the edge of the screen. Because many users are accustomed to writing with one hand and holding the edge of the screen with the other hand when writing on a large screen, the hand holding the edge of the screen will not only trigger writing by mistake, leaving ink marks that the user does not want, or call out the palm erase process to erase the original handwriting by mistake, or trigger the canvas to move and zoom, causing the canvas to jump, but the responses caused by these mis-touch parts on the whiteboard will also make the other hand that meets the user's real writing intention unable to write normally.

[0047] In order to identify the accidental touch scenario and eliminate the impact of accidental touch based on the principle of not affecting the existing whiteboard multi-person writing and common gesture usage experience, the present application proposes a method and device for preventing accidental touches on a touch screen. This solution solves the problem of accidental touches by performing preliminary screening of the screen edge hot zone for any touch point obtained on the touch screen, making preliminary scene judgments based on the edge contact area to immediately respond to common gestures such as writing or erasing, edge contact movement rate and trajectory analysis, edge contact previous historical event analysis, scene recognition and prediction, canceling the existing operation process of the identified edge accidental touch point, and revoking the unintended impact of the accidental touch (eliminating accidental touch ink, restoring accidental erased content, etc.), ignoring and shielding the processed accidental touch points to avoid any impact of such touch points on other subsequent contacts.

[0048] Please refer to Figure 1, which is a schematic diagram of the architecture of an application scenario provided by an embodiment of the present application. As shown in Figure 1, the application scenario includes a touch point generator 001, a touch screen device 002, and a writing pen 003. Among them, the touch point generator 001 can be a user's hand, or any other object that can generate a touch point on the touch screen, and there can be multiple touch point generators 001 at the same time, and each touch point generator 001 can generate multiple touch points at a time, and the initial landing position and area of ​​each touch point can be different; the touch screen device 002 can be a terminal electronic device such as a mobile phone, a watch, a tablet computer, a laptop computer, etc.

[0049] As shown in Figure 1(a), a touch point generator 001 is holding the edge of a touch screen device 002, and the other hand is holding a writing pen 003 and writing on the touch screen. It can be seen that the first hand produces some ink lines due to accidental touch because it is holding the edge of the touch screen. In this case, a method for preventing accidental touches on the touch screen is applied.

[0050] As shown in FIG1(b), in one possible scenario, the contact generator 001 at the edge of the touch screen 002 leaves two or more ink marks in a double or multi-person writing mode, and in this case, if the writable channel is filled with hands that accidentally touch the edge, the writing pen may no longer be able to write. In this scenario, a method for preventing accidental touches on the touch screen is applied.

[0051] In addition, there is another scenario that is more common in life and work, as shown in Figure 1(c). In the figure, the contact point generator 001 is also supported on the edge of the touch screen device 002, and the other hand is holding a writing pen 003 and writing on the touch screen device 002. It can be seen that the handwriting written in the front is covered by the user's hand supporting the touch screen. Due to the accidental touch of the hand supporting the touch screen, the original handwriting is erased. In this case, the method of preventing accidental touches on the touch screen can also be applied.

[0052] As shown in FIG1(d), the contact generating object 001 is placed on the edge of the touch screen and two or more fingers accidentally touch the touch screen device 002. Since it is sensed that there are multiple writing contacts, the other hand holding the writing pen cannot write. In this case, the solution of the present invention can also be applied.

[0053] As shown in Figure 1(e), in a possible scenario, a finger that accidentally touches the touch point generator 001 and is resting on the edge of the touch screen 002, together with another hand or writing pen that presses in other areas with writing intention at almost the same time, may also mistakenly trigger the canvas movement and zoom mode. At this time, the hand or writing pen with the real writing intention cannot write. For this scenario, the present application can also analyze the movement of multiple touch points to determine whether it is an accidental touch or a normal need to zoom the canvas.

[0054] The above are five simple examples of application scenarios of an anti-mistouch touch screen proposed in this application. Since there are many scenarios of mis-touches in actual operations, it is difficult to list them all here. This application declares that all scenarios with multiple touch points on a touch screen can fall within the application scope of this application, among which the writing pen is not necessary and can be any device or object that can write on the touch screen; the touch points can be from one user or from two users, and scenarios of mis-touching by multiple hands are also included, without any restriction.

[0055] See also Figure 2 , Figure 2 A flow chart of a method for preventing accidental touches on a touch screen provided in an embodiment of the present application. In this embodiment, the scenario where the area of ​​the accidental touch point on the screen is the same as the area of ​​the writing touch point is mainly described. The following steps are how to meet the requirements of performing an anti-accidental touch response and ensuring that normal writing and normal operations on the screen are not affected by accidental touches. In this embodiment, the writing process is first started in a timely manner to respond to such accidental touch scenarios, and the normal writing mode and the accidental touch mode are distinguished according to the movement rate and dwell time of the touch point, and it is decided whether to stop the writing mode and erase the writing ink.

[0056] For example, Figure 2 As shown, the specific process is as follows:

[0057] Step 1. Detect a small area of ​​touch on the screen

[0058] A touch point is detected in the touch, and the area of ​​the touch point is known to be similar to the area of ​​the writing touch point.

[0059] Therefore, it is determined that the at least one contact is a small-area contact. The following determination and processing operations are performed on the small-area contact.

[0060] Step 2. Start writing mode and maintain normal writing process

[0061] The writing mode is started for each writing contact point, and the writing process is immediately started for it. In the writing mode, the processing device in the touch screen will generate writing ink marks in the corresponding area along the real-time moving track of the writing contact point.

[0062] Step 3. Analyze the movement rate characteristics of small area contacts

[0063] When the writing mode is activated, the movement rate characteristics of the small-area contact are extracted within a certain time series and the rate changes are continuously analyzed.

[0064] In one possible implementation, an SVM model or a GRU model is used to determine whether the movement of the small-area contact satisfies the mistouch mode or the normal writing mode, and the movement rate data of the small-area contact is input into the SVM or GRU model. The model analyzes the characteristics of the motion data and outputs the result of whether the small-area contact belongs to the writing mode or the mistouch mode.

[0065] In another embodiment, the judgment can be made in the following manner: with a time interval of 20ms, the movement rate data of the small-area touch point is sampled within the time period of 100ms to 200ms when the position of the small-area touch point moves, and the analysis and judgment are made based on the sampling results. When the movement rate of the small-area touch point does not exceed 0.1 pixel points within 20ms, it is considered to be low-speed movement. If the small-area touch point maintains low-speed movement within the observation time window of 100ms to 200ms, it is considered to be in the false touch mode, otherwise it is determined to be in the writing mode.

[0066] For the touch points determined to be in mis-touch mode, the writing mode will be canceled immediately, the writing process will be terminated and the mis-touch ink will be eliminated. The mis-touch touch points that have been determined will be shielded, and the shielded touch points will not be included in the scene prediction and response range in the subsequent determination and response of new touch point events.

[0067] For the contacts that are determined to be in normal writing mode, it is necessary to proceed to step 4 for further analysis.

[0068] Step 4. Analyze the dwell time of small area contacts

[0069] For the contacts that are judged as normal writing mode in the previous step Step 3, it is necessary to continue to analyze the length of time the slow movement lasts. The analysis process usually compares the length of time the current contact maintains slow movement with a preset threshold. The preset threshold can be customized according to user needs. In one possible implementation, the preset threshold is 100ms. When the contact maintains slow movement for more than 100ms, it is considered to be a false touch mode. When it is less than or equal to the threshold, it is considered to be still in writing mode.

[0070] For the touch points determined to be in mis-touch mode, the writing mode will be canceled immediately, the writing process will be terminated and the mis-touch ink will be eliminated. The mis-touch touch points that have been determined will be shielded, and the shielded touch points will not be included in the scene prediction and response range in the subsequent determination and response of new touch point events.

[0071] For the touch points determined to be in normal writing mode, it is necessary to proceed to step 5 for further analysis.

[0072] Step 4.1. Determine whether there is a contact point in the first area in the first time interval?

[0073] This step is mainly to determine whether there are other small-area touch points in the surrounding area of ​​the small-area touch point within the time window before and after the small-area touch point is detected. The size of the time window can be customized according to specific implementation requirements, and the size of the surrounding area can also be customized according to specific needs.

[0074] If the judgment result is "yes", it is considered to be a normal writing mode, and the operation characteristics of the small area contact are further analyzed and judged in the following Step 5;

[0075] If the judgment result is "no", it is considered that the small area touch point is in the mistouch mode. At this time, the writing mode needs to be canceled, the writing process is terminated, and the mistouch ink of the small area touch point is immediately eliminated. The mistouch touch points that have been judged are shielded, and the shielded touch points are not included in the scene prediction and response range in the judgment and response of subsequent new touch point events.

[0076] Step 5. Determine whether the touch point is an accidental touch based on the movement rate and dwell time?

[0077] According to the analysis of Step 3, Step 4 and Step 4.1 above, the small area touch point that enters the current step and is not shielded is determined as a non-false touch point, and the writing mode is maintained for the small area touch point and the normal writing process is performed. When the small area touch point disappears,

[0078] If it is considered as a normal end action, the writing mode will be cancelled for the contact and the writing process will be stopped immediately.

[0079] In this embodiment, the intention of a single small-area touch point is judged when it is detected. When it is determined that the small-area touch point is an erroneous touch point, the writing mode needs to be canceled, the writing process is terminated, the writing ink is promptly removed, and the erroneous touch point is shielded, and no alignment is performed for analysis and judgment in subsequent scenes. For normal writing touch points, this judgment process does not affect the normal writing process and does not cause interference.

[0080] In a possible implementation of this embodiment, the touch points of the screen edge area that are accidentally touched by the screen can be responded to and processed in a timely manner, which can not only efficiently process the accidentally touched touch points, but also effectively eliminate the influence of the accidentally touched touch points on the normal writing touch points. This method can effectively improve the processing efficiency and user experience in the accidentally touched scene.

[0081] See also Figure 3 , Figure 3 A flowchart of another method for preventing accidental touches on a touch screen is provided in an embodiment of the present application. In this embodiment, it is mainly described how to perform an anti-accidental touch response in the scenario where the palm holding the edge of the screen accidentally triggers palm erasure and meet the requirements of normal writing and normal operation on the screen without being affected by accidental touches. In this embodiment, timely erasing response is first performed for such accidental touch scenarios, and at the same time, normal palm erasure and accidental touch scenarios are distinguished according to the movement speed and dwell time of the hand holding the screen, and it is decided whether to interrupt the eraser and whether to restore the erased content.

[0082] For example, Figure 3 The specific process is as follows:

[0083] Step 1. Detect large area of ​​touch points on the screen

[0084] The touch screen device detects one or more large-area touch points on the touch screen, and performs the following judgments and operations on each large-area touch point, respectively, from Step 2 to Step 4.2.

[0085] Step 2. Start the eraser mode and erase the ink in the corresponding area as the large area touch point moves

[0086] The device receives the detection result and starts the eraser mode. As the touch point moves, the value of the pixel corresponding to the touch point is set to 0, that is, the ink content of the area corresponding to the ink mark is erased. At the same time, the motion characteristics of the large-area touch point are continued to be detected, and judgment and corresponding processing are performed according to the specific operating status. Step 3. Does the large-area touch point remain relatively still for a period of time?

[0087] First, it is necessary to judge the movement rate of the large-area contact, that is, to judge whether the large-area contact remains relatively still for a period of time. If the judgment result is "yes", it is considered that the large-area contact is in the false touch mode; if the judgment result is "no", it is necessary to continue to make further judgments according to the subsequent steps and make processing decisions.

[0088] In a possible implementation manner, the judgment of whether a large-area contact remains relatively still for a period of time may be:

[0089] Determine whether the large-area touch point moves more than 0.1 pixel every 20ms. If not, it is considered that the large-area touch point is in a relatively static state, that is, the touch point position has not changed significantly; if it exceeds, it is considered that the large-area touch point has moved significantly and is not in a relatively static state. If the large-area touch point remains relatively static for a period of time, the touch screen device cancels the eraser mode and restores the erased ink content; if the large-area touch point has moved significantly for a period of time, it is necessary to further determine the large-area touch point and enter the following steps Step4.1 and Step4.1.

[0090] Step 4.1 Large area contacts disappear immediately

[0091] If the large-area touch point disappears immediately, the touch screen device immediately cancels the eraser mode and does not restore the erased ink content.

[0092] Step 4.2 Large-area contacts move significantly over a period of time

[0093] If the position of the large-area touch point changes significantly, the touch screen device maintains the eraser mode and erases the ink content of the area corresponding to the touch point as the touch point moves, and cancels the eraser mode immediately when the large-area touch point disappears;

[0094] Among them, whether the position of the large-area contact has changed significantly can be judged based on the movement rate of the contact within a period of time after the movement is stable. There are two ways of judging. One is to judge by artificially setting a threshold. For example, the time period from 100ms to 200ms when the contact starts to move from the initial landing point is selected, and 20ms is used as a time interval to judge whether the large-area contact moves more than 0.1 pixels every 20ms. If it exceeds, it is considered to be high-speed movement, that is, the position of the contact has changed significantly, and it is considered to be an eraser mode. Otherwise, it is considered to be a low-speed movement, that is, the position of the large-area contact has not changed significantly, and it is considered to be a false touch mode; the other is to judge by a motion rate judgment model. For example, an SVM model or a GRU model is used to judge the movement rate of the large-area contact within a period of time (here usually refers to a period of time after the contact moves smoothly, and the time interval from 100ms to 200ms when the contact starts to move from the initial landing position is selected as an example. Based on the comparison, it is judged whether the movement rate of the large-area contact belongs to the eraser mode or the false touch mode.

[0095] In a possible implementation of this embodiment, when the display screen device detects multiple touch points, no matter whether the touch points are located in the edge hot zone of the display screen or in the non-edge hot zone of the display screen, the above steps can be applied to perform mode judgment. The edge hot zone of the display screen refers to the area that is one palm away from the edge of the touch screen, which is usually 15 cm, that is, an image area containing approximately 300 pixels. In addition, the touch points can be from the same user or from different users, and the number and position of the touch points are not strictly limited.

[0096] In this embodiment, a method for preventing accidental touches on a touch screen is proposed. The method determines whether to call out an anti-accidental touch mechanism of the eraser based on the initial movement rate of a large-area contact. Specifically, the scheme immediately turns on the eraser mode for the detected large-area contact, and then determines whether to cancel the eraser mode based on the movement of the position of the large-area contact to prevent accidental touches and erasures. Since the scheme performs corresponding operations through two detection and judgment, it does not limit the user experience of the palm erasing gesture.

[0097] In addition, in this embodiment, there will be no conflict between the normal contact points and the accidental touch points of the writing pen tip, and the addition of the accidental touch points will not affect the normal writing action of the shadow writing contacts. Therefore, this solution will not affect the simultaneous writing and touching operations of multiple people while preventing accidental touches.

[0098] See also Figure 4 , Figure 4A flowchart of another method for preventing accidental touches on a touch screen is provided in an embodiment of the present application. In this embodiment, the scene of detecting a large area of ​​touch points and starting the eraser mode is mainly processed.

[0099] For example, Figure 4 The specific process is described as follows:

[0100] Step 1. Detect large area of ​​touch points on the screen

[0101] It is detected that one or more touch points appear in the touch, and the one or more touch points are known to be large-area touch points based on the area of ​​the touch points. The following judgment and processing operations are performed on each large-area touch point that has completed the judgment.

[0102] Step 2. Start the eraser mode and erase the ink in the corresponding area as each large area touch point moves.

[0103] Activate Eraser mode for each large area touch point and immediately call out the Eraser to begin the erasing process.

[0104] The processing device in the touch screen will erase the ink in the corresponding area according to the real-time movement trajectory of the large-area touch point.

[0105] Step 3. Analyze the movement rate characteristics of large-area contacts

[0106] When the eraser mode is activated, the movement rate characteristics of the large-area contact are extracted within a certain time series and the rate changes are continuously analyzed.

[0107] In one possible implementation, an SVM model or a GRU model is used to determine whether the movement of the large-area contact satisfies the false touch mode or the normal eraser erasing mode, and the movement rate data of the large-area contact is input into the SVM or GRU model. The model analyzes the characteristics of the motion data and outputs the result of whether the area contact belongs to the eraser mode or the false touch mode.

[0108] In another embodiment, the judgment can be made in the following manner: with a time interval of 20ms, the movement rate data of the large-area touch point is sampled within the time period of 100ms to 200ms when the large-area touch point moves, and the analysis and judgment are made based on the sampling results. When the movement rate of the large-area touch point does not exceed 0.1 pixel point within 20ms, it is considered to be a low-speed movement. If the large-area touch point maintains a low-speed movement within the observation time window of 100ms to 200ms, it is considered to be in the false touch mode. Otherwise, it is determined to be in the eraser erasing mode.

[0109] For large-area contacts that are determined to be in false touch mode, the eraser mode will be canceled immediately, and the content erased by the large-area contacts will be restored. The false touch contacts that have been determined will be shielded, and the shielded contacts will not be included in the scene prediction and response range in the subsequent determination and response of new contact events.

[0110] For the contacts that are determined to be in normal eraser erasing mode, it is necessary to proceed to step 4 for further analysis.

[0111] Step 4. Analyze the dwell time of large-area contacts

[0112] For the contacts that are judged as normal erasing mode in the previous step Step 3, it is necessary to continue to analyze the length of time the low-speed movement lasts. The analysis process usually compares the length of time the current contact maintains low-speed movement with a preset threshold. The preset threshold can be customized according to user needs. In one possible implementation, the preset threshold is 100ms. When the contact maintains low-speed movement for more than 100ms, it is considered to be a false touch mode. When it is less than or equal to the threshold, it is considered to be still in the erasing mode.

[0113] For large-area contacts that are determined to be in false touch mode, the eraser mode will be canceled immediately, and the erased content of the large-area contacts will be restored. The false touch contacts that have been determined will be shielded, and the shielded contacts will not be included in the scene prediction and response range in the subsequent determination and response of new contact events.

[0114] For the contacts that are determined to be in normal eraser erasure mode, it is necessary to proceed to step 5 for further analysis.

[0115] Step 5. Based on the movement rate and dwell time, determine whether the touch point is an accidental touch?

[0116] According to the analysis of Step 3 and Step 4 above, for large-area contacts that have never maintained low-speed motion within a certain period of time, the contacts that can reach the current step and are not shielded are determined to be non-false touch contacts. The eraser mode is maintained for the large-area contacts and the ink is erased normally. When the large-area contacts disappear, it is considered that the erasing action is normally ended, and the eraser mode is canceled for the contacts, and there is no need to restore the erased ink.

[0117] In this embodiment, this scheme only judges the location area of ​​the touch point, and does not rely on any previous or subsequent writing pen tip information to determine whether the existing touch point is a false touch point. Therefore, the anti-false touch mechanism of this embodiment can still correctly judge the single false touch point of the screen and effectively suppress the wrong operation.

[0118] In a possible implementation of this embodiment, this embodiment can only judge the situation where a large-area touch point appears in the edge hot zone. Based on the initial landing position of the large-area touch point, it can be determined whether the large-area touch point is in the edge hot zone or in the non-edge hot zone, where the edge hot zone is defined as: a square frame is framed at the position of an adult's palm (generally about 15 cm, which is about 300 pixels in the image) from the edge of the screen, and the area between the square frame and the edge is called the edge hot zone. The reason why this scene can be judged in the case of the edge hot zone is that the edge hot zone is usually the area where mis-touch is most likely to occur, and the determination of this area is a hot spot area that urgently needs to be solved.

[0119] In a possible implementation of this embodiment, there is no restriction on the landing position of the touch point, which can be located at any position of the touch screen. For example, the initial landing position of the touch point can be an edge position or a middle position of the touch screen. For multiple detected touch points, they will be analyzed and checked one by one. For the analyzed touch points, if they are accidentally touched by supporting the screen, the touch points will be shielded. In this process, the touch points whose analysis results are accidentally touched will be shielded, and the normal writing function or other operation functions of the non-accidentally touched touch points will not be affected.

[0120] The above embodiment simply shows the scenario of starting the erase mode due to an accidental touch. In this scenario, the area of ​​the detected touch point is mainly analyzed, and only when it is determined to be a large-area touch point will the subsequent analysis continue. In addition to this scenario, the touch points detected by the touch screen may also trigger other modes. For example, when multiple small-area touch points are detected, the waiting canvas movement zoom mode may be triggered. For this situation, the following embodiment is analyzed in detail in combination with the specific situation.

[0121] In one possible implementation, when multiple touch points are detected at the same time, the canvas zoom mode may be mistakenly called out due to an accidental touch of the touch screen. In this scenario, it is necessary to analyze the movement of the multiple detected touch points, and based on the results of the analysis, further determine whether it is a false touch. If it is a false touch, the impact of the detected false touch points needs to be ignored. If it is a non-false touch mode, it is necessary to respond to the detected touch points in a timely manner.

[0122] See also Figure 5 , Figure 5A flowchart of another method for preventing accidental touches on a touch screen provided for this embodiment. In order to identify the accidental touch scenarios in this embodiment, it is necessary to simultaneously perform continuous movement rate feature analysis and relative motion trajectory analysis on multiple small-area touch points on the edge of the screen, so as to predict whether the multiple small-area touch points on the edge of the screen are accidental touches caused by holding the screen or touch points formed by canvas movement and zooming gestures. For the identified accidental touch points caused by holding the screen, the present invention terminates the canvas movement and zooming and freezes the canvas. The technical solution of this embodiment is as follows:

[0123] Step 1. Detect at least two small area contacts

[0124] The touch screen device detects that at least two touch points appear on the touch screen within a first time interval, where the first time interval can be a relatively small time range set manually. Based on the touch point area being a small-area touch point, when the judgment result is that there are at least two small-area touch points, the canvas movement and zoom mode is triggered to start.

[0125] Step 2. Start the waiting canvas movement zoom mode and continue to detect the movement of small area contacts

[0126] The waiting canvas movement zoom mode is started for at least two small-area contacts, and the next step of analysis is continued based on the movement of each small-area contact.

[0127] Step 3. Analyze the movement rate characteristics of at least two small-area contacts

[0128] When the canvas movement and zooming mode is started, the movement rate characteristics of the at least two small-area touch points are extracted within a certain time series and their rate changes are continuously analyzed. Specifically, it can be determined whether the movement of the at least two small-area touch points meets the false touch mode or the canvas movement and zooming mode by using a SVM model or a GRU model.

[0129] In another embodiment, the judgment can be made in the following manner: the movement rate data of the small-area contact point in the time period of 0ms to 100ms when the position of the small-area contact point changes is sampled at a time interval of 20ms; when the movement rate of the at least two small-area contacts changes

[0130] If the distance of movement within 20ms does not exceed 0.1 pixel, it is considered to be low-speed movement; if any small-area touch point maintains low-speed movement within 100ms, it is considered to be a relatively static touch point. After the above movement rate determination, if there are less than two non-relative static touch points among the current small-area touch points, it is determined to be a false touch mode, otherwise it is initially determined to be a canvas movement and scaling mode.

[0131] For small-area touch points that are determined to be in mis-touch mode, the canvas movement and scaling mode will be canceled immediately, and the canvas will be frozen to shield the mis-touch touch points that have been determined. In the subsequent determination and response of new touch events, the shielded touch points will not be included in the scene prediction and response range.

[0132] For the touch points determined to be in canvas moving and scaling mode, it is necessary to proceed to step 4 for further analysis.

[0133] Step 4. Analyze the dwell time of at least two small area contacts

[0134] For the contacts that are determined to be in canvas movement and zoom mode in the previous step Step 3, it is also necessary to analyze the duration of low-speed movement. The analysis process usually compares the duration of the current contact's low-speed movement with the preset threshold. The preset threshold can be customized according to the user's needs. In one possible implementation, the preset threshold is 100ms. When any contact maintains a low-speed movement time greater than 100ms, the contact is considered to be a relatively static contact. After the above movement rate judgment, if there are less than two non-relatively static contacts among the current small-area contacts, it is determined to be a false touch mode, otherwise it is preliminarily determined to be a canvas zoom mode.

[0135] For small-area contacts that are determined to be in mis-touch mode, the waiting canvas movement and scaling mode will be canceled immediately, the movement and scaling control points will be eliminated, the canvas will be frozen, and the mis-touch contacts that have been determined will be shielded. In the subsequent determination and response of new contact events, the shielded contacts will not be included in the scene prediction and response range.

[0136] For the touch points that are initially determined to be in canvas moving and scaling mode, it is necessary to proceed to step 5 for further analysis.

[0137] Step 5. Determine whether the touch point is an accidental touch based on the change in the relative movement direction of multiple touch points?

[0138] According to the analysis of Step 3 and Step 4 above, for at least two small-area contacts that are judged to be not relatively static, the contacts that can reach the current step and are not blocked are judged to be non-false touch contacts. If the number of small-area contacts that are judged to be not relatively static in the above two steps is less than two, all remaining small-area contacts are judged to be false touch contacts and are blocked; if the number of small-area contacts that are judged to be not relatively static in the above two steps is greater than or equal to two, the at least two small-area contacts are maintained in the waiting canvas movement zoom mode and the next step of judgment is performed.

[0139] Ste6.1 When the positions of at least two small-area contacts move significantly and irregularly

[0140] When the number of non-relatively static small-area contacts remaining in the above step is two or more, it is necessary to further determine whether the at least two small-area contacts have undergone regular relative motion in this step. In a possible implementation, the relative motion directions of at least two small-area contacts under multiple different multi-touch operation modes (multi-point false touch mode, false touch writing mode, canvas moving mode, canvas zooming mode) are used as sample data to train the SVM or GRU model, extract the relative motion direction change features of all current non-relatively static small-area contacts in the previous 100ms and input them into the pre-trained SVM or GRU model, and output whether the relative motion direction change of the current at least two small-area contacts belongs to regular relative motion or irregular relative motion.

[0141] When the at least two small-area touch points move obviously but in an irregular relative motion, the at least two touch points are determined to be mis-touched touch points, the waiting canvas movement zoom mode is canceled and the canvas is immediately frozen. The irregular motion means that the motion trajectories of the at least two small-area touch points are not moving towards each other, away from each other, or moving in the same direction at a similar speed.

[0142] Step 6.2 When the positions of at least two small-area contacts move significantly and move toward or away from each other

[0143] When the number of non-relatively static small-area contacts remaining in the above step is two or more, it is necessary to further determine whether the at least two small-area contacts have undergone regular relative motion in this step. Based on the judgment method in the above step Step 6.1, determine whether the motion trajectory of the at least two small-area contacts belongs to a movement towards or away from each other. When the above relative motion mode is met, it is determined that the movement of the at least two small-area contacts is intended to scale the canvas. Therefore, the operation of scaling the canvas is started until it is detected that the at least two small-area contacts disappear. When it is detected that the at least two small-area contacts disappear, the canvas movement scaling mode is immediately stopped and the canvas is frozen.

[0144] Step 6.3 When the positions of at least two small-area contacts move significantly and move in the same direction

[0145] When the number of non-relatively static small surface contacts remaining in the above step is two or more, it is necessary to further determine whether the at least two small area contacts have moved regularly in this step. Based on the judgment method in the above step Step 6.1, determine whether the movement trajectory of the at least two small area contacts belongs to moving together in the same direction at a similar rate. When the above relative motion mode is met, it is determined that the movement of the at least two small area contacts is intended to move the canvas. Therefore, the operation of moving the canvas is started until it is detected that the at least two small area contacts disappear. When it is detected that the at least two small area contacts disappear, the canvas movement zoom mode is immediately stopped and the canvas is frozen.

[0146] The solution in the above embodiment can immediately start the waiting canvas movement and scaling mode based on the judgment of the contact area when at least two contacts are detected, and based on the basic movement rate of the contacts and the relative movement trajectory characteristics, judge again whether it is a false touch and decide whether to start moving and scaling the canvas in response. This process will not affect the normal operation of scaling the canvas, and can effectively reduce the occurrence of false touches.

[0147] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0148] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a training device or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device or data center. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that contains one or more available media integration. Available media can be magnetic media, (e.g., floppy disk, hard disk, tape), optical media (e.g., DVD), or semiconductor media (e.g., solid-state hard disk (SSD)), etc.

Claims

1. A method for preventing accidental touching of a touch screen, characterized in that: Applied to the process of writing on the canvas of the touch screen, including: Based on at least one detected touch point; Determining small-area contacts and / or large-area contacts based on the area of ​​the at least one contact, and responding to a first operation based on the number of contacts; Determine the false touch mode touch point and the non-false touch mode touch point based on the number, motion characteristics and preceding events in the vicinity of the large-area touch points and / or the small-area touch points, wherein the motion characteristics include one or more of motion speed, motion trajectory, motion direction and dwell time; A second operation is responded to the mis-touch mode contact, where the second operation is used to cancel the first operation and process a product of the first operation.

2. The method according to claim 1, characterized in that: The determining of small-area contacts and / or large-area contacts based on the area of ​​the at least one contact, and responding to a first operation based on the number of contacts, comprises: Based on a single small area touch point, start the writing mode; Based on at least two small-area touch points appearing within a first time interval, starting a mobile zoom waiting mode; Based on large-area contact, the eraser erasing mode is activated.

3. The method according to claim 1, characterized in that: The step of responding to a second operation on the false touch mode contact point includes: For a single small-area contact point determined to be in an error-touch mode, interrupting the writing operation of the single small-area contact point and erasing the writing ink of the single small-area contact point; For at least two small-area touch points determined to be in the mis-touch mode, interrupting the movement, zooming, and waiting operations of the at least two small-area touch points and freezing the canvas; For the large-area touch point determined to be in the mis-touch mode, the erasing operation of the large-area touch point is interrupted and the erased ink trace of the large-area touch point is restored.

4. The method according to claim 1, characterized in that: The determining of the false touch mode contacts and the non-false touch mode contacts based on the number and movement characteristics of the large-area contacts and / or the small-area contacts comprises: Based on the number and movement characteristics of the large-area contact points, determining that the large-area contact points are one of eraser mode contact points and mistouch mode contact points; Based on the number and movement characteristics of the small-area touch points, it is determined that the small-area touch points are one of the mobile zoom mode touch points, the writing mode touch points, and the mistouch mode touch points.

5. The method according to claim 4, characterized in that: The method of determining, based on the number and movement characteristics of the large-area contact points, that the large-area contact points are one of eraser mode contact points and mistouch mode contact points comprises: The large-area contact point is determined to be a false touch mode contact point if it meets the first condition; Among them, the first condition is that the movement rate of the contact is less than the first preset rate, and the residence time of the contact is greater than the first preset time, and the contact is determined to be the false touch mode contact.

6. The method according to claim 4, characterized in that: Based on the number and movement characteristics of the small-area touch points, determining that the small-area touch points are one of a moving zoom mode touch point, a writing mode touch point, and an accidental touch mode touch point comprises: The small-area touch point is determined to be a false touch mode touch point if the first condition is met; The at least two small-area contacts do not satisfy the first condition, and the movement directions of the at least two small-area contacts do not satisfy the second condition, and the at least two small-area contacts are determined to be mis-touch contacts; The second condition includes one of regular motion, motion in the same direction, motion towards each other, and motion in opposite directions.

7. A device for preventing accidental touching of a touch screen, characterized in that: Applied to the process of writing on the canvas of the touch screen, including: A detection module, used for detecting touch points appearing on the touch screen; a processing module, configured to determine a small-area touch point and / or a large-area touch point based on an area of ​​at least one touch point detected, and respond to a first operation based on the number of the touch points; A judgment module, used to determine the false touch mode contacts and the non-false touch mode contacts based on the number of the large-area contacts and / or the small-area contacts, the motion characteristics and the preceding events in the nearby area, wherein the motion characteristics include one or more of the motion speed, the motion trajectory, the motion direction and the dwell time; The processing module is further used for responding to the false touch mode contact with a second operation, where the second operation is used for canceling the first operation and processing a product of the first operation.

8. The device according to claim 7, characterized in that: The first operation based on the number of contacts also includes: Based on a single small area touch point, start the writing mode; Based on at least two small-area touch points appearing within a first time interval, starting a mobile zoom waiting mode; Based on large-area contact, the eraser erasing mode is activated.

9. The device according to claim 7, characterized in that: The second operation of responding to the contact point in the mis-touch mode further includes: For a single small-area contact point determined to be in an accidental touch mode, interrupting the writing operation of the single small-area contact point and erasing the writing ink of the single small-area contact point; For at least two small-area touch points determined to be in the mis-touch mode, interrupting the moving, zooming, and waiting operations of the at least two small-area touch points and freezing the canvas; For the large-area touch point determined to be in the mis-touch mode, the erasing operation of the large-area touch point is interrupted and the erased ink trace of the large-area touch point is restored.

10. The device according to claim 7, characterized in that: The judging module comprises: Based on the number and movement characteristics of the large-area contact points, determining that the large-area contact points are one of eraser mode contact points and mistouch mode contact points; Based on the number and movement characteristics of the small-area touch points, it is determined that the small-area touch points are one of the mobile zoom mode touch points, the writing mode touch points, and the mistouch mode touch points.

11. The device according to claim 10, characterized in that: The method of determining, based on the number and movement characteristics of the large-area contact points, that the large-area contact points are one of eraser mode contact points and mistouch mode contact points comprises: The large-area contact point is determined to be a false touch mode contact point if it meets the first condition; Among them, the first condition is that the movement rate of the contact is less than the first preset rate, and the residence time of the contact is greater than the first preset time, and the contact is determined to be the false touch mode contact.

12. The device according to claim 10, characterized in that: Based on the number and movement characteristics of the small-area touch points, determining that the small-area touch points are one of a moving zoom mode touch point, a writing mode touch point, and an accidental touch mode touch point comprises: The small-area touch point is determined to be a false touch mode touch point if the first condition is met; The at least two small-area contacts do not satisfy the first condition, and the movement directions of the at least two small-area contacts do not satisfy the second condition, and the at least two small-area contacts are determined to be mis-touch contacts; The second condition includes one of regular motion, motion in the same direction, motion towards each other, and motion in opposite directions.

13. A touch screen device, characterized in that: The touch screen device at least includes a touch screen and a processor. When the touch screen device is writing on the touch screen, the processor executes the method described in any one of claims 1 to 6.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises instructions, and when the instructions are executed on a computer, the computer executes the method according to any one of claims 1 to 6.

15. A computer program product, characterized in that The computer-readable storage medium comprises instructions, and when the instructions are executed on a computer, the computer executes the method according to any one of claims 1 to 6.

Images