Dynamic response adjusting method for touch screen

Abstract

The invention relates to the technical field of touch screen control, in particular to a dynamic response adjusting method for a touch screen, which comprises the following steps of: firstly obtaining interface elements of the touch screen, then obtaining a primary touch thermodynamic diagram according to the interface elements, and carrying out dynamic response adjustment on the touch screen based on the primary touch thermodynamic diagram. Screen pixels and touch records of a past period of time are obtained, a predicted touch thermodynamic diagram is predicted according to the screen pixels and the touch records on the basis of a preset neural network model, and finally the primary touch thermodynamic diagram and the predicted touch thermodynamic diagram are fused to obtain a real-time touch thermodynamic diagram. And performing dynamic response adjustment on the touch screen based on the real-time touch thermodynamic diagram. Through an intelligent adjusting mechanism driven by real-time data, the parameters of the touch screen are dynamically adjusted according to real-time conditions and user behaviors, and the problem that the touch screen cannot dynamically respond in the prior art is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of touch screen control, and in particular to a dynamic response adjustment method for a touch screen. BACKGROUND

[0002] In today's digital interaction scenarios, touch screens have become the core carrier of human-computer interaction, widely covering the fields of smart phones, tablet computers, public information terminals, and industrial touch devices. Its importance is reflected in efficient and convenient operation experience, optimized structure design without physical keys, and integrated capabilities of multiple types of sensing technology.

[0003] However, most existing touch screen systems use a fixed response strategy, i.e., preset constant threshold parameters to handle touch behavior, resulting in adaptation limitations in different use scenarios. When the user has no touch intention, the interface may trigger a false touch due to sensitive response, and when fine operation is required, the threshold may be too high, causing delayed feedback.

[0004] Therefore, there is an urgent need for an intelligent response mechanism that can dynamically adjust touch screen parameters according to real-time conditions and user behavior to break through the limitations of traditional solutions and improve user experience while ensuring accuracy. SUMMARY

[0005] Therefore, the present application provides a dynamic response adjustment method for a touch screen to solve the problem that the touch screen cannot dynamically respond in the prior art.

[0006] The present application provides a dynamic response adjustment method for a touch screen, comprising: obtaining interface elements of the touch screen; obtaining a primary touch heat map based on the interface elements, and dynamically adjusting the touch screen based on the primary touch heat map; obtaining screen pixels and touch records in the past period of time; predicting a predicted touch heat map based on the screen pixels and the touch records according to a preset neural network model; fusing the primary touch heat map and the predicted touch heat map to obtain a real-time touch heat map, and dynamically adjusting the touch screen based on the real-time touch heat map; The primary touch heat map, the predicted touch heat map, and the real-time touch heat map are all used to represent the probability of the user clicking different positions on the touch screen.

[0007] In one preferred scheme, the primary touch heat map is obtained based on the interface elements, and the touch screen is dynamically adjusted based on the primary touch heat map, comprising: obtaining application information of the current display content of the touch screen; According to the application information, a preset touch heat map corresponding to the application information is obtained, wherein the preset touch heat map is used to represent the probability of a user clicking different positions on the touch screen; According to the interface element, a touch button position is obtained; According to the touch button position, the preset touch heat map is corrected to obtain a primary touch heat map; Based on the primary touch heat map, dynamic response adjustment is performed on the touch screen.

[0008] In a preferred scheme, according to the touch button position, the preset touch heat map is corrected to obtain a primary touch heat map, which includes: In the preset touch heat map, a grid is divided, and according to the touch button position, whether there is a touch button in each grid is counted; If there is a touch button in the target grid, the touch probability of all grids in a preset neighborhood centered on the target grid in the preset touch heat map is increased to obtain the primary touch heat map, wherein the touch probability of all grids in the preset neighborhood decreases from the center to the edge.

[0009] In a preferred scheme, based on a preset neural network model, a predicted touch heat map is predicted according to screen pixels and touch records, which includes: The screen area is divided into a plurality of pixel blocks; According to the distribution of screen pixels in each pixel block, a pixel feature is established; According to the distribution of touch records in each pixel block, a touch feature is established; The pixel feature and the touch feature are input into the preset neural network model to obtain the predicted touch heat map output by the preset neural network.

[0010] In a preferred scheme, according to the distribution of screen pixels in each pixel block, a pixel feature is established, which includes: According to the screen pixels, the mean value of the H / S / V channel of the pixels in each pixel block in the HSV space is counted to obtain a color histogram; According to the screen pixels, the local binary pattern mean value of the gray scale image in each pixel block is counted to obtain a texture feature value; According to the screen pixels, the difference between the mean value of the pixel gray scale value in the current frame and the mean value of the pixel gray scale value in the previous frame is counted to obtain a dynamic feature value; According to the color histogram, the texture feature value and the dynamic feature value, a vector is established as the pixel feature.

[0011] In a preferred scheme, the touch records include touch position coordinates, operation types and contact areas; according to the distribution of the touch records in each pixel block, a touch feature is established; mapping the touch position coordinates to indexes of the pixel blocks in which the touch position coordinates are located, to obtain a position feature; encoding the operation type to obtain an operation feature; normalizing the contact area to obtain a contact feature; establishing a vector according to the position feature, the operation feature and the contact feature as a touch feature.

[0012] In a preferred scheme: the preset neural network model comprises a CNN neural network layer, an LSTM neural network layer, a feature fusion layer and an output layer, wherein the CNN neural network layer comprises a first input layer, a one-dimensional convolution layer, a first pooling layer and a first output layer connected in sequence, wherein the first input layer is used for inputting the pixel feature, the one-dimensional convolution layer comprises a plurality of Conv1d convolution kernels, the number of Conv1d convolution kernels is the same as the number of pixel blocks, the first pooling layer is used for dimension reduction on the output vector of the one-dimensional convolution layer, and the first output layer is used for outputting a first context vector; the LSTM neural network layer comprises a second input layer, an LSTM layer, a second pooling layer and a second output layer connected in sequence, wherein the second input layer is used for inputting the touch feature multiple times, the LSTM neural network layer comprises a plurality of LSTM units, the second pooling layer is used for dimension reduction on the output vector of the LSTM neural network layer, and the second output layer is used for outputting a second context vector; the feature fusion layer comprises a vector splicing layer, a first full connection layer, a second full connection layer and a third output layer connected in sequence, wherein the vector splicing layer is used for splicing the first context vector and the second context vector, the first full connection layer is used for dimension reduction and analysis of the feature, the second full connection layer is used for outputting the heat weight of each pixel block, and the third output layer is used for outputting the predicted touch heat map.

[0013] In a preferred scheme: the dynamic response adjustment method of the touch screen further comprises: correcting the preset touch heat map according to the real-time touch heat map.

[0014] The application further provides an electronic device comprising: a memory and a processor; the memory is used for storing a program, and the processor is used for executing the steps of any one of the above-mentioned dynamic response adjustment methods of the touch screen when executing the program.

[0015] The application further provides a computer readable storage medium for storing a computer readable program or instruction, which can realize the steps of any one of the above-mentioned dynamic response adjustment methods of the touch screen when the program or instruction is executed by a processor.

[0016] The beneficial effects of the above-mentioned embodiments are: This invention provides a method for dynamically adjusting the response of a touch screen. First, it acquires the interface elements of the touch screen, then obtains a primary touch heatmap based on these elements, and dynamically adjusts the touch screen's response based on this heatmap. Next, it acquires screen pixels and touch records from a past period, and predicts a touch heatmap based on a preset neural network model. Finally, it merges the primary and predicted touch heatmaps to obtain a real-time touch heatmap, and dynamically adjusts the touch screen's response based on this real-time heatmap. This invention first generates a primary touch heatmap based on interface elements, quickly responding to the current interface layout features. Then, combining screen pixel states and historical touch records, it predicts potential user operation areas using a preset neural network model, generating a predictive touch heatmap for proactive response. By merging the two types of heatmaps into a real-time touch heatmap, it dynamically adjusts the touchscreen's sensitivity and response parameters, avoiding accidental touches or delays caused by fixed thresholds and adapting to different operating habits and environmental changes in various scenarios. This invention achieves dynamic adjustment of touchscreen parameters based on real-time conditions and user behavior through a real-time data-driven intelligent adjustment mechanism, thus solving the problem of touchscreens being unable to respond dynamically in the prior art. Attached Figure Description

[0017] Figure 1 A flowchart of the dynamic response adjustment method for a touch screen provided by the present invention; Figure 2 for Figure 1 A detailed step diagram of step S102 is shown below; Figure 3 for Figure 1 The detailed steps of step S104 are shown in the diagram. Detailed Implementation

[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0019] Combination Figure 1 As shown in the figure, a specific embodiment of the present invention discloses a method for adjusting the dynamic response of a touch screen, comprising: S101, Obtain the interface elements of the touch screen; S102. Obtain a primary touch heatmap based on the interface elements, and dynamically adjust the touch screen response based on the primary touch heatmap. S103, Obtain screen pixels and touch records over a past period of time; S104, predicting a predicted touch heat map based on the preset neural network model according to the screen pixels and the touch record; S105, fusing the primary touch heat map and the predicted touch heat map to obtain a real-time touch heat map, and dynamically adjusting the touch screen based on the real-time touch heat map; The primary touch heat map, the predicted touch heat map and the real-time touch heat map are all used to represent the probability of the user clicking different positions on the touch screen.

[0020] The primary touch heat map, the predicted touch heat map, the real-time touch heat map and the preset touch heat map to be mentioned later in the above three processes have the same meaning but different functions. The primary touch heat map is mainly used to quickly realize dynamic response adjustment and guarantee the basic use experience of the user. The predicted touch heat map is used for analysis of the real-time use state. The real-time touch heat map is used for fine response adjustment (by fusing the primary touch heat map and the predicted touch heat map, the specific fusion method can be flexibly designed according to the specific situation, for example, taking the maximum value or weighted summation while limiting fluctuation). The preset touch heat map in the later text is the pre-set touch heat map of different applications.

[0021] The application first generates a primary touch heat map based on the interface elements, quickly responds to the current interface layout characteristics, then combines the screen pixel state and the historical touch record, predicts the potential operation area of the user through a preset neural network model, generates a predicted touch heat map, realizes forward-looking response, and fuses the two types of heat maps into a real-time touch heat map to dynamically adjust the touch screen sensitivity and response parameters, which not only avoids the false touch or delay problem caused by the fixed threshold, but also adapts to the operation habits and environmental changes in different scenarios. Through the intelligent adjustment mechanism driven by real-time data, the application realizes dynamic adjustment of the touch screen parameters according to the real-time situation and user behavior, and solves the problem that the touch screen cannot dynamically respond in the prior art.

[0022] In the above process, the dynamic response adjustment can be any existing response adjustment method such as increasing TouchSlop (sliding trigger distance threshold), increasing the minimum pressing time of the click event (MIN_CLICK_DELAY), expanding the touch effective area (such as requiring the touch point area to be greater than a threshold), keeping the system default parameters or reducing the threshold, etc. It can be determined according to the actual situation. For example, when the user watches a full-screen video for a long time, the sensitivity of the edge area of the screen can be reduced to avoid false touch between the user's finger and the screen when holding the screen.

[0023] Further, in combination with Figure 2 It is shown that in a preferred embodiment, the above step S102, obtaining a primary touch heat map according to the interface elements, and dynamically adjusting the touch screen based on the primary touch heat map, specifically includes: S201, acquire application information of current display content of the touch screen; S202, acquire a preset touch heat map corresponding to the application information according to the application information, wherein the preset touch heat map is used to represent the probability of user clicking different positions on the touch screen; S203, obtain touch button positions according to the interface elements; S204, correct the preset touch heat map according to the touch button positions to obtain a primary touch heat map; S205, perform dynamic response adjustment on the touch screen based on the primary touch heat map.

[0024] In the above process, the current foreground application package name can be acquired as the application information through a system API (such as ActivityManager of Android) to determine whether it is a full-screen application such as a video player or a game. The interface elements can be obtained by using an accessibility service (such as AccessibilityService of Android) to traverse the current interface view tree and detect full-screen controls (such as video player controls) or split-screen regions.

[0025] The embodiment first calls a preset touch heat map template according to the current application information, quickly establishes a basic response model using application scenario characteristics (such as games, reading, drawing, etc.), locates the positions of key controls such as touch buttons through interface element analysis, corrects the heat map distribution accordingly, eliminates the generalization error of the preset template, ensures high-precision matching of actual interaction requirements, and makes the system not only quickly respond to high-frequency operation areas (such as navigation bars), but also accurately identify low-frequency but key control interactions (such as hidden function buttons).

[0026] Further, in a preferred embodiment, the step S204 of correcting the preset touch heat map according to the touch button positions to obtain a primary touch heat map specifically includes: dividing a grid in the preset touch heat map, and counting whether there is a touch button in each grid according to the touch button positions; if there is a touch button in the target grid, then the touch probability represented by all grids in a preset neighborhood centered on the target grid in the preset touch heat map is improved to obtain the primary touch heat map, wherein the touch probability improvement amount of all grids in the preset neighborhood decreases from the center to the edge.

[0027] The embodiment improves the accuracy and edge adaptability of the touch heat map through the grid probability enhancement mechanism. When a target grid contains a touch button, the touch probability of the grid is improved, and the probability enhancement effect is smoothly transitioned to the surrounding grids through neighborhood diffusion, forming a gradient probability distribution centered on the button. This design highlights the high response priority of the core interaction area and avoids the response mutation problem caused by traditional hard boundary correction through gradual improvement of the edge probability.

[0028] Further, in combination with Figure 3 As shown in the figure, in a preferred embodiment, the step S104 of predicting the predicted touch heat map based on the preset neural network model according to the screen pixels and the touch record specifically includes: S301, dividing the screen area into a plurality of pixel blocks; S302, establishing pixel features according to the distribution of screen pixels in each pixel block; S303, establishing touch features according to the distribution of touch records in each pixel block; S304, inputting the pixel features and the touch features into the preset neural network model to obtain the predicted touch heat map output by the preset neural network.

[0029] The embodiment divides the screen into a plurality of pixel blocks, extracts the screen pixel distribution features (such as brightness, color, texture, and other visual information) and touch record distribution features (such as historical click frequency, pressure distribution, and other interaction data) of each pixel block, and comprehensively captures the screen state and user behavior mode through double-channel feature modeling. Based on the multi-modal fusion capability of the deep neural network, the scheme realizes accurate prediction of the user's potential touch intention and significantly improves the intelligent level of dynamic response adjustment. More importantly, the pixel block division mechanism replaces global screen data acquisition with local feature extraction, effectively avoiding direct exposure of the original screen image while ensuring prediction accuracy, thereby eliminating the risk of privacy leakage from the root and providing a safe and reliable technical solution for touch interaction in sensitive scenarios such as mobile devices and public terminals.

[0030] Specifically, in a preferred embodiment, the step S302 of establishing pixel features according to the distribution of screen pixels in each pixel block specifically includes: According to the screen pixels, the mean values of H / S / V channels of the pixels in each pixel block in the HSV space are counted to obtain a color histogram; According to the screen pixels, the local binary pattern mean value of the grayscale image in each pixel block is counted to obtain a texture feature value; According to the screen pixels, the difference between the mean value of the pixel grayscale value in the current frame and the mean value in the previous frame is counted to obtain a dynamic feature value; A vector is established according to the color histogram, the texture feature value and the dynamic feature value as the pixel feature.

[0031] In the above process, the mean value information of three dimensions of hue (H), saturation (S) and lightness (V) in the HSV color space is decomposed to construct a color histogram, which can effectively capture the color distribution characteristics of the interface elements. The texture feature value is counted by the local binary pattern (LBP), which accurately describes the microscopic structure characteristics of the screen surface. The dynamic feature is extracted by calculating the gray difference value between the current frame and the previous frame to realize real-time perception of the interface change trend. The three-dimensional feature vector fusing color, texture and dynamic change not only comprehensively represents the visual characteristics of the pixel block, but also enhances the environmental adaptability of the touch prediction through time sequence correlation analysis.

[0032] Specifically, in a preferred embodiment, the touch record includes touch position coordinates, operation type and contact area, on the basis of which, the step S303 of establishing the touch feature according to the distribution of the touch record in each pixel block specifically includes: mapping the touch position coordinates into the index of the pixel block where the touch position coordinates are located to obtain the position feature; encoding the operation type to obtain the operation feature; normalizing the contact area to obtain the contact feature; establishing a vector according to the position feature, the operation feature and the contact feature as the touch feature.

[0033] In this embodiment, the position coordinates in the touch record are converted into pixel block indexes to construct the discretized position feature, which not only retains the spatial distribution information but also reduces the data dimension. The three-dimensional feature vector fusing spatial position, operation semantics and physical interaction intensity in this embodiment completely describes the essential features of the touch event, so that the neural network can more accurately learn the user behavior pattern. It can be understood that the touch feature is a sequence of multiple vectors.

[0034] Specifically, in a preferred embodiment, the preset neural network model comprises a CNN neural network layer, an LSTM neural network layer, a feature fusion layer and an output layer, wherein the CNN neural network layer comprises a first input layer, a one-dimensional convolution layer, a first pooling layer and a first output layer connected in sequence, wherein the first input layer is used for inputting pixel features, the one-dimensional convolution layer comprises a plurality of Conv1d convolution kernels, the number of Conv1d convolution kernels is the same as the number of pixel blocks, the first pooling layer is used for dimension reduction on the output vector of the one-dimensional convolution layer, and the first output layer is used for outputting a first context vector; the LSTM neural network layer comprises a second input layer, an LSTM layer, a second pooling layer and a second output layer connected in sequence, wherein the second input layer is used for inputting touch features multiple times, the LSTM neural network layer comprises a plurality of LSTM units, the second pooling layer is used for dimension reduction on the output vector of the LSTM neural network layer, and the second output layer is used for outputting a second context vector; the feature fusion layer comprises a vector splicing layer, a first full connection layer, a second full connection layer and a third output layer connected in sequence, wherein the vector splicing layer is used for splicing the first context vector and the second context vector, the first full connection layer is used for dimension reduction and analysis of features, the second full connection layer is used for outputting a heat weight of each pixel block, and the third output layer is used for outputting a predicted touch heat map.

[0035] The application also provides a more specific embodiment for illustrating the above design. In this embodiment, the screen is divided into 8x8 pixel blocks (a total of 64 blocks), and the touch record is a touch event sequence in the last 5 seconds (a maximum of 50). The pixel features extracted from each block include: Color histogram: mean value of H / S / V channels in HSV space (3 dimensions).

[0036] Texture feature value: local binary pattern (LBP) mean value of the gray image (1 dimension).

[0037] Dynamic feature value: average pixel difference between the current frame and the previous frame of the gray image (1 dimension).

[0038] The vector dimension of the constructed pixel features: 64 blocks x (3+1+1)=320 dimensions.

[0039] The touch features extracted from each block include: Position feature: coordinate mapping to the corresponding pixel block index (for example, x=100, y=200 is mapped to block_idx=15).

[0040] Operation feature: One-hot encoding for operation types (click / slide / long press) (3 dimensions).

[0041] Contact feature: fingertip contact area (normalized to 0~1).

[0042] Sequence padding: zero padding when data is less than 50, truncation when data is too long, and keeping the latest 50.

[0043] The vector dimension of the constructed touch feature is (1+3+1)=5, but there are a total of 50.

[0044] The preset neural network design takes lightweight as the core, adopts a double-branch parallel processing structure, is divided into a CNN branch (i.e., a CNN neural network, processing pixel features) and an LSTM branch (i.e., an LSTM neural network, processing touch feature sequences), and finally outputs 64 pixel block heat weights through feature fusion.

[0045] The CNN neural network layer includes a first input layer, a one-dimensional convolution layer, a first pooling layer, and a first output layer connected in sequence.

[0046] In the first input layer, the input channel number is 64 blocks (each block has a 5-dimensional feature). The one-dimensional convolution layer is used to extract local spatial correlation (such as color / texture difference between adjacent pixel blocks). In the one-dimensional convolution layer, Conv1d is used instead of traditional CNN to reduce spatial calculation, a small kernel (3x1) is used to reduce the number of parameters, no bias term is set to further compress the parameters, 64 convolution kernels are set, each kernel generates one feature map, and finally 64 blocks of 64-dimensional features are output. In the first pooling layer, the dimension is reduced to 16 blocks to reduce the amount of subsequent calculation. The 64 blocks of features are compressed into 16 blocks, and the mean value of each adjacent 4 blocks is taken. Finally, the first output layer outputs a 1024-dimensional first context vector. The CNN neural network layer adopts a ReLU activation function to accelerate convergence and suppress gradient disappearance.

[0047] The LSTM neural network layer includes a second input layer, an LSTM layer, a second pooling layer, and a second output layer connected in sequence.

[0048] The second input layer is used to input the pixel feature with a dimension of 5 multiple times. In the LSTM layer, a Tanh activation function is used to process the internal control signal of LSTM, and the value range is constrained in [-1, 1]. A Sigmoid activation function is used to control the gate weight of information forgetting / transferring. The second pooling layer is used to retain the most significant operation mode (such as high-frequency click area), that is, only the output of the last 8 time steps is retained to avoid processing the full sequence. Finally, the second output layer outputs a 128-dimensional second context vector.

[0049] The feature fusion layer includes a vector splicing layer, a first full connection layer, a second full connection layer, and a third output layer connected in sequence.

[0050] The vector splicing layer is used for splicing the first context vector and the second context vector, and outputs a 1024+128=1152-dimensional vector, the first full connection layer is used for dimension reduction and feature analysis, and the data is reduced to 32 dimensions, cross-modal feature interaction is learned, and the ReLU activation function is used to accelerate convergence, the second full connection layer is used for further analysis to output the heat weight of 64 pixel blocks, and the third output layer is used for outputting the predicted touch heat map, and the Sigmoid activation function is used to realize normalization, that is, the heat weight corresponding to each pixel block is limited between 0 and 1, representing a probability weight.

[0051] This design realizes adaptive touch sensitivity adjustment by capturing user behavior and pixel dynamic characteristics accurately while ensuring real-time through a lightweight network structure and feature engineering.

[0052] Further, in a preferred embodiment, the dynamic response adjustment method of the touch screen further comprises: Correcting the preset touch heat map according to the real-time touch heat map.

[0053] It should be noted that the above steps in the present application and the steps S103-S105 in the foregoing can be performed in the cloud, and a certain trigger condition (such as watching a video for a long time or calling a game software) can be set to avoid affecting local computing power. The present embodiment further proposes a feedback mechanism for dynamically correcting the preset touch heat map according to the real-time touch heat map, which significantly improves the long-term adaptability and user experience of the system.

[0054] The present application also provides an electronic device, characterized in that it comprises: a memory and a processor; The memory is used for storing a program, and the processor is used for executing the steps of the dynamic response adjustment method of the touch screen in any of the above embodiments when executing the program.

[0055] The present application also provides a computer readable storage medium for storing computer readable programs or instructions, which can realize the steps of the dynamic response adjustment method of the touch screen in any of the above embodiments when the programs or instructions are executed by the processor.

[0056] The application provides a dynamic response adjustment method of a touch screen, which comprises the following steps: obtaining interface elements of the touch screen, obtaining a primary touch heat map according to the interface elements, adjusting the dynamic response of the touch screen based on the primary touch heat map, obtaining screen pixels and touch records in the past period of time, predicting a predicted touch heat map based on a preset neural network model according to the screen pixels and the touch records, fusing the primary touch heat map and the predicted touch heat map to obtain a real-time touch heat map, and adjusting the dynamic response of the touch screen based on the real-time touch heat map. The primary touch heat map is generated based on the interface elements, the current interface layout features are quickly responded, the potential operation area of the user is predicted by the preset neural network model by combining the screen pixel state and the historical touch records, the predicted touch heat map is generated, the prospective response is realized, the two types of heat maps are fused into the real-time touch heat map, the sensitivity and the response parameters of the touch screen are dynamically adjusted, the false touch or the delay problem caused by the fixed threshold is avoided, and the operation habits and the environmental changes in different scenes can be adapted. The intelligent adjustment mechanism driven by the real-time data is used, the touch screen parameters are dynamically adjusted according to the real-time situation and the user behavior, and the problem that the touch screen cannot dynamically respond in the prior art is solved.

[0057] It should be noted that each of the embodiments in the specification adopts a progressive manner for description, and each embodiment focuses on the difference from other embodiments, and the same and similar parts between the embodiments can be referred to each other.

[0058] The above description of the disclosed embodiments enables a person skilled in the art to implement or use the application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the application will not be limited to these embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method of dynamically adjusting the response of a touch screen, characterized by, The method comprises the following steps: obtaining interface elements of the touch screen; obtaining a primary touch heat map according to the interface elements, and adjusting the dynamic response of the touch screen based on the primary touch heat map; obtaining screen pixels and touch records in a past period of time; predicting a predicted touch heat map based on a preset neural network model according to the screen pixels and the touch records; fusing the primary touch heat map and the predicted touch heat map to obtain a real-time touch heat map, and adjusting the dynamic response of the touch screen based on the real-time touch heat map; wherein the primary touch heat map, the predicted touch heat map and the real-time touch heat map are all used to represent the probability of user clicking different positions on the touch screen.

2. The dynamic response adjustment method of a touch screen according to claim 1, wherein, The method for obtaining the primary touch heat map according to the interface elements and adjusting the dynamic response of the touch screen based on the primary touch heat map comprises the following steps: obtaining application information of the current display content of the touch screen; obtaining a preset touch heat map corresponding to the application information according to the application information, wherein the preset touch heat map is used to represent the probability of user clicking different positions on the touch screen; obtaining the position of the touch button according to the interface elements; correcting the preset touch heat map according to the position of the touch button to obtain the primary touch heat map; adjusting the dynamic response of the touch screen based on the primary touch heat map.

3. The method of claim 2, wherein the dynamic response adjustment is performed by: The method for correcting the preset touch heat map according to the position of the touch button to obtain the primary touch heat map comprises the following steps: dividing a grid in the preset touch heat map, and counting whether there is a touch button in each grid according to the position of the touch button; if there is a touch button in the target grid, then the touch probability represented by all grids in a preset neighborhood centered on the target grid in the preset touch heat map is increased to obtain the primary touch heat map; wherein the touch probability of all grids in the preset neighborhood decreases from the center to the edge.

4. The dynamic response adjustment method of a touch screen according to claim 2, wherein, The method for predicting the predicted touch heat map based on the preset neural network model according to the screen pixels and the touch records comprises the following steps: dividing the screen area into a plurality of pixel blocks; establishing pixel features according to the distribution of screen pixels in each pixel block; establishing touch features according to the distribution of touch records in each pixel block; inputting the pixel features and the touch features into the preset neural network model to obtain the predicted touch heat map output by the preset neural network.

5. The method of claim 4, wherein the dynamic response adjustment is performed by: The method for establishing pixel features according to the distribution of screen pixels in each pixel block comprises the following steps: statistically obtaining the mean value of H / S / V channels in HSV space of pixels in each pixel block according to the screen pixels to obtain a color histogram; statistically obtaining the mean value of local binary pattern of grayscale images in each pixel block according to the screen pixels to obtain a texture feature value; statistically obtaining the difference between the mean value of pixel grayscale values in the current frame and the mean value of pixel grayscale values in the previous frame according to the screen pixels to obtain a dynamic feature value; establishing a vector as the pixel features according to the color histogram, the texture feature value and the dynamic feature value.

6. The method of claim 4, wherein the dynamic response adjustment is performed by: The touch records comprise touch position coordinates, operation types and contact areas; the method for establishing touch features according to the distribution of touch records in each pixel block comprises the following steps: mapping the touch position coordinates to the index of the pixel block where the touch position coordinates are located to obtain position features; encoding the operation types to obtain operation features; The contact area is normalized to obtain a contact feature; A vector is established according to the position feature, the operation feature and the contact feature as the touch feature.

7. The method of claim 4, wherein the dynamic response adjustment is performed by a processor of the touch screen. The preset neural network model comprises a CNN neural network layer, an LSTM neural network layer, a feature fusion layer and an output layer. The CNN neural network layer comprises a first input layer, a one-dimensional convolution layer, a first pooling layer and a first output layer connected in sequence. The first input layer is configured to input a pixel feature. The one-dimensional convolution layer comprises a plurality of Conv1d convolution kernels. The number of Conv1d convolution kernels is the same as the number of pixel blocks. The first pooling layer is configured to reduce the dimension of an output vector of the one-dimensional convolution layer. The first output layer is configured to output a first context vector. The LSTM neural network layer comprises a second input layer, an LSTM layer, a second pooling layer and a second output layer connected in sequence. The second input layer is configured to input the touch feature multiple times. The LSTM neural network layer comprises a plurality of LSTM units. The second pooling layer is configured to reduce the dimension of an output vector of the LSTM neural network layer. The second output layer is configured to output a second context vector. The feature fusion layer comprises a vector splicing layer, a first full connection layer, a second full connection layer and a third output layer connected in sequence. The vector splicing layer is configured to splice the first context vector and the second context vector. The first full connection layer is configured to reduce the dimension and analyze the feature. The second full connection layer is configured to output a heat weight of each pixel block. The third output layer is configured to output a predicted touch heat map.

8. The method of claim 2, wherein the dynamic response adjustment is performed by a processor of the touch screen. The dynamic response adjustment method of the touch screen further comprises: The preset touch heat map is corrected according to the real-time touch heat map.

9. An electronic device, comprising: The dynamic response adjustment method of the touch screen further comprises: A memory and a processor; The memory is configured to store a program. The processor is configured to execute the steps in the dynamic response adjustment method of the touch screen in any one of claims 1-8 when executing the program.

10. A computer-readable storage medium, characterized in that, A computer readable program or instruction is stored. The program or instruction is executed by the processor to realize the steps in the dynamic response adjustment method of the touch screen in any one of claims 1-8.

Images