A multi-touch point recognition method and system for a touch display screen

By identifying and processing the user's pre-entered finger data on the touch display, generating identity information and collecting touch points, the problem of difficulty in accurately identifying multi-contacts on the touch display screen is solved, and higher touch accuracy and system performance are achieved.

CN118963588BActive Publication Date: 2025-04-18SHENZHEN MEIJIAAI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411084234.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-08
Publication Date
2025-04-18
Estimated Expiration
2044-08-08

AI Technical Summary

Technical Problem

It is difficult for the touch display to accurately track and identify the positions and actions of multiple touch points, resulting in low accuracy and accuracy when the user actually touches.

Method used

The pre-included identity information is generated based on the user's pre-entered finger data, and the user is given central control permission, collect and identify touch points, generate touch tracks, and separate touch events from background tasks through multi-threading technology to improve response speed and system performance.

Benefits of technology

It realizes a more accurate depiction of the user's touch trajectory, reduces errors, improves the smoothness of user operations and the overall performance of the system, and ensures the stability and response speed of the system under high load conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118963588B_ABST
    Figure CN118963588B_ABST
Patent Text Reader

Abstract

The present invention provides a multi-touch point recognition method and system for a touch display screen, which are applied to the field of data processing. The present invention collects multiple touch points within a preset time period, which can more accurately depict the user's touch trajectory and reduce errors. By connecting the touch points to form a touch trajectory and identifying the touch function on the trajectory, the user's touch action can be tracked more accurately. At the same time, the touch event is separated from the background task through multi-threading technology, which can effectively allocate system resources, avoid mutual influence between the touch event and the background task, improve the response speed and the overall performance of the system, and buffer the touch event or the background task to a preset buffer, which can avoid system overload and improve the stability and reliability of the system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data processing, and in particular to a multi-touch point recognition method and system for a touch display screen. Background Art

[0002] At present, traditional touch screen technologies include resistive, capacitive or acoustic wave types. These technologies have been widely used to a certain extent. With the popularization of mobile devices and interactive displays, the demand for touch technology is increasing. Touch technology allows users to use fingers or objects to operate, thereby providing a more flexible and intuitive user experience. However, since it is difficult for users to accurately track and identify the position and movement of touch points, the precision and accuracy of users' actual touch are not high. Summary of the invention

[0003] The present invention aims to solve the problem that a touch display screen has difficulty in accurately tracking and identifying the positions and actions of multiple touch points detected simultaneously, resulting in low precision and accuracy when a user actually touches, and provides a multi-touch point recognition method and system for a touch display screen.

[0004] The present invention adopts the following technical means to solve the technical problem:

[0005] The present invention provides a multi-touch point recognition method for a touch display screen, comprising:

[0006] Based on the finger data pre-entered by the user, pre-recorded identity information is generated from the touch display screen, and the user is granted central control authority over the touch display screen according to the identity information, wherein the finger data specifically includes finger fingerprint data, touch area data, and touch force data;

[0007] Determining whether the touch display screen can detect the finger contact point of the user;

[0008] If it is possible, at least one touch point of the finger contact is collected, the touch points are connected within a preset time period to form a touch track, the touch function corresponding to the touch track is identified, a touch instruction corresponding to the touch function is provided to the user through the touch display screen, an executable instruction corresponding to the touch track is generated, and at least two executable instructions selected by the user are obtained;

[0009] Determining whether the execution instruction can be synchronously executed through the touch display screen;

[0010] If not, the touch response time of the execution instruction is collected, and based on the touch response time, the preset multi-threading technology is applied to separate the touch event from the background task of the touch display screen, and the touch event or the background task is buffered in a preset buffer. According to the priority mechanism preset by the user on the touch display screen, the queue response event of the touch display screen is allocated.

[0011] Furthermore, the step of collecting at least one touch point of the finger contact includes:

[0012] Based on the preset sensors of the touch display screen, the sensor data of the user on the touch display screen is collected, wherein the sensors specifically include capacitive sensors, optical sensors and pressure sensors, and the sensor data specifically include capacitance values, optical information and pressure values;

[0013] determining whether the sensing data matches the finger contact point;

[0014] If so, extract the feature points of the sensing data, identify the touch points based on the feature points, apply a preset clustering algorithm to group and cluster the touch points, and generate touch points on the touch display screen, wherein the feature points specifically include capacitance change characteristics, brightness changes, edge features, pressure peaks, and pressure change rates.

[0015] Furthermore, before the step of connecting the touch points within a preset time period to form a touch track, the method further includes:

[0016] Based on the original touch data collected by the touch display screen, adjusting the filter parameters corresponding to the preset low-pass filter, applying a moving average filter to perform low-pass filtering on the original touch data, setting the window of the moving average filter to a preset number of touch points, and calculating and generating a smoothed average value, wherein the original touch data specifically includes touch point coordinates and touch timestamps;

[0017] Determining whether the average value matches a preset moving window;

[0018] If so, identify the smooth touch point corresponding to the average value, take the touch coordinates of the smooth touch point and the preset points before and after it, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all the smooth touch points on the touch display screen, and generate the touch trajectory.

[0019] Furthermore, the step of buffering the touch event or the background task into a preset buffer further includes:

[0020] Based on the thread pool preset by the touch display screen, monitor the load rate of each preset thread, and dynamically adjust the number of threads in the thread pool according to the load rate;

[0021] Determine whether the number of threads reaches a preset upper limit;

[0022] If so, extract the continuous memory blocks required for the load rate from the preset memory pool, divide the continuous memory blocks into free memory blocks of preset sizes, add the free memory blocks to the pre-established free block linked list, allocate the free memory blocks in the free block linked list to the corresponding thread request objects, and output the pointer corresponding to the allocated memory block to the thread request object.

[0023] Furthermore, the step of determining whether the touch display screen can detect the finger contact of the user further includes:

[0024] Based on a preset calibration procedure of the touch display screen, presenting a preset pattern on the touch display screen and guiding the user to touch and click the preset pattern, and detecting a finger contact point corresponding to the touch and click;

[0025] Determining whether the finger contact is aligned with the preset pattern;

[0026] If so, the touch data is collected periodically according to the preset time nodes, the touch data is stored in a preset ring buffer, the touch data is timestamped in the ring buffer, and the touch track corresponding to the touch data is restored according to the timestamp.

[0027] Furthermore, the step of determining whether the execution instruction can be synchronously executed through the touch display screen further includes:

[0028] Verifying the path information of the execution instruction based on the hierarchical dependency relationship preset by the touch display screen;

[0029] Determining whether a circular dependency is detected in the path information;

[0030] If so, loop nodes are marked from the path information, the loop nodes are sorted to collect key dependent nodes, and a preset intermediate state is introduced to execute part of the instructions of the key dependent nodes in batches.

[0031] Furthermore, the step of generating pre-recorded identity information from the touch display screen based on the finger data pre-recorded by the user, and granting the user central control authority over the touch display screen according to the identity information, further includes:

[0032] Generating preset guidance content from the touch display screen based on the identity information;

[0033] Determining whether the user has completed the guidance content;

[0034] If not, the personalized interface of the touch display screen is dynamically adjusted according to the identity information of the user, and the user is granted the authority to change the personalized interface.

[0035] The present invention also provides a multi-touch point recognition system for a touch display screen, comprising:

[0036] A generation module, used to generate pre-recorded identity information from the touch display screen based on finger data pre-recorded by the user, and grant the user central control authority over the touch display screen according to the identity information, wherein the finger data specifically includes finger fingerprint data, touch area data and touch force data;

[0037] A determination module, used to determine whether the touch display screen can detect the finger contact point of the user;

[0038] an execution module, configured to, if possible, collect at least one touch point of the finger contact, connect the touch points within a preset time period to form a touch track, identify the touch function corresponding to the touch track, provide the user with a touch instruction corresponding to the touch function through the touch display screen, generate selectable execution instructions corresponding to the touch track, and obtain at least two of the execution instructions selected by the user;

[0039] A second judgment module is used to judge whether the execution instruction can be synchronously executed through the touch display screen;

[0040] The second execution module is used to collect the touch response time of the execution instruction if not, and apply the preset multi-threading technology based on the touch response time to separate the touch event from the background task of the touch display screen, buffer the touch event or the background task to a preset buffer, and allocate the queue response event of the touch display screen according to the priority mechanism preset by the user on the touch display screen.

[0041] Furthermore, the execution module includes:

[0042] A collection unit, configured to collect sensor data of the user on the touch display screen based on a sensor preset in the touch display screen, wherein the sensor specifically includes a capacitive sensor, an optical sensor and a pressure sensor, and the sensor data specifically includes a capacitance value, optical information and a pressure value;

[0043] a judging unit, configured to judge whether the sensing data matches the finger contact point;

[0044] An execution unit is used to extract feature points of the sensing data, identify the touch points according to the feature points, group and cluster the touch points using a preset clustering algorithm, and generate touch points on the touch display screen, wherein the feature points specifically include capacitance change characteristics, brightness changes, edge features, pressure peak values, and pressure change rates.

[0045] Furthermore, it also includes:

[0046] a calculation module, configured to adjust the filter parameters corresponding to the preset low-pass filter based on the raw touch data collected by the touch display screen, apply a moving average filter to perform low-pass filtering on the raw touch data, set the window of the moving average filter to a preset number of touch points, and calculate and generate a smoothed average value, wherein the raw touch data specifically includes touch point coordinates and touch timestamps;

[0047] A third judgment module is used to judge whether the average value matches a preset moving window;

[0048] The third execution module is used to identify the smooth touch point corresponding to the average value, take the touch coordinates of the smooth touch point and the preset points before and after it, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all the smooth touch points on the touch display screen, and generate the touch trajectory.

[0049] The present invention provides a multi-touch point recognition method and system for a touch display screen, which has the following beneficial effects:

[0050] The present invention collects multiple touch points within a preset time period, which can more accurately depict the user's touch trajectory and reduce errors. By connecting the touch points to form a touch trajectory and identifying the touch function on the trajectory, the user's touch action can be tracked more accurately. At the same time, the touch event is separated from the background task through multi-threading technology, which can effectively allocate system resources and avoid mutual influence between the touch event and the background task, thereby improving the response speed and the overall performance of the system. In addition, the touch event or the background task is buffered in a preset buffer, which can avoid system overload and improve the stability and reliability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 A schematic diagram of a flow chart of an embodiment of a method for identifying multiple touch points on a touch display screen of the present invention;

[0052] Figure 2 The structure diagram of an embodiment of a multi-touch point recognition system for a touch display screen of the present invention. DETAILED DESCRIPTION

[0053] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. The implementation of the objectives, functional features and advantages of the present invention will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

[0054] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0055] Reference Figure 1 , is a multi-touch point recognition method for a touch display screen in an embodiment of the present invention, comprising:

[0056] S1: Based on the finger data pre-entered by the user, pre-recorded identity information is generated from the touch display screen, and the user is granted central control authority over the touch display screen according to the identity information, wherein the finger data specifically includes finger fingerprint data, touch area data, and touch force data;

[0057] S2: Determine whether the touch display screen can detect the finger contact point of the user;

[0058] S3: If yes, collecting at least one touch point of the finger contact point, connecting the touch points within a preset time period to form a touch track, identifying the touch function corresponding to the touch track, providing the user with a touch instruction corresponding to the touch function through the touch display screen, generating selectable execution instructions corresponding to the touch track, and obtaining at least two of the execution instructions selected by the user;

[0059] S4: Determine whether the execution instruction can be synchronously executed through the touch display screen;

[0060] S5: If not, then collect the touch response time of the execution instruction, apply the preset multi-threading technology based on the touch response time to separate the touch event from the background task of the touch display screen, buffer the touch event or the background task into a preset buffer, and allocate the queue response event of the touch display screen according to the priority mechanism preset by the user on the touch display screen.

[0061] In this embodiment, the system generates pre-recorded user identity information from the touch display screen based on the finger data pre-recorded by the user in the touch display screen, the finger data specifically including finger fingerprint data, touch area data and touch force data, and grants different users central control permissions to the touch display screen according to different user identity information. The system then determines whether the touch display screen can detect the user's finger contact points to execute corresponding steps. For example, when the system determines that the touch display screen cannot detect the user's finger contact points, the system will consider that the user's finger contact points have not been pre-recorded or the identification is inaccurate, and the system will display information to prompt the user to touch correctly. When the user touches the screen, for example, "Touch is not detected, please make sure your finger is in contact with the screen", the system reminds the user to try touching the screen again through sound, guides the user to adjust the placement of the finger, prompts the user to re-place the finger on the touch screen, ensures the correct finger position and strength, and prompts the user to clean the screen surface to ensure that there are no stains, water droplets, grease, etc. that interfere with touch recognition, and dynamically adjusts the sensitivity of the touch sensor to adapt to different usage environments and improve the accuracy of touch recognition; for example, when the system determines that the touch screen can detect the user's finger contact, the system will assume that the user's finger contact can be recognized by the touch screen. That is, the touch screen can execute the instructions input by the user's finger. The system will collect at least one touch point of the finger contact, connect these touch points within a preset time period to form the touch track required by the user, identify the touch function corresponding to the touch track, provide the user with the touch instruction corresponding to the touch function through the touch screen, generate the corresponding selectable execution instructions in the touch track, and obtain at least two execution instructions selected by the user; the system can recognize the user's touch track in real time and provide the corresponding touch instruction, that is, the user can immediately see the operation result, improve the fluency and satisfaction of the operation, and recognize the corresponding touch track. Touch function, users can perform a variety of touch operations, such as sliding, zooming, rotating, etc., enriching the interaction mode. At the same time, selectable execution instructions are generated according to the recognized touch track. Users can select multiple execution instructions for combination to flexibly meet different operation requirements. Through intelligent allocation and optimization of system resources, efficient processing of touch events and background tasks is ensured, and overall system performance is improved. In addition, touch points are collected and connected within a preset time period to form a complete touch track, ensuring that the system can quickly respond to user operations to reduce delays; then the system determines whether these execution instructions can be executed synchronously through the touch display screen to execute the corresponding steps;For example, when the system determines that two or more execution instructions that the user needs to execute can be executed synchronously through the touch display screen, the system will consider that there is no conflict between these execution instructions and that they can be executed in parallel without interfering with each other. The system will start the multi-tasking mechanism to execute multiple instructions of the user, and reasonably allocate resources such as CPU and memory according to the needs of each execution instruction to ensure that each instruction can obtain sufficient resource support. At the same time, the execution status of each execution instruction is monitored in real time to ensure that all instructions are executed within expectations. If it is found that some instructions execute slowly or occupy more resources, the system will make dynamic adjustments to balance resource allocation to ensure overall execution efficiency, and provide real-time feedback to the user on the execution status of each execution instruction through the touch display screen, such as progress bar, prompt information, etc., so that the user can understand the task execution status; for example, when the system determines that two or more execution instructions that the user needs to execute cannot be executed synchronously through the touch display screen, the system will consider that these execution instructions are in conflict, and the system will collect the touch response time of the execution instruction, and apply the pre-set multi-threading technology based on different touch response times to connect the touch event with the touch The background tasks of the display screen are separated, and the touch events or background tasks are buffered in a pre-set buffer. According to the priority mechanism pre-set by the user on the touch display screen, the queue response events of the touch display screen, that is, the instructions to be executed in the queue of the touch display screen, are allocated; the system can detect conflicts between the instructions that the user needs to execute, avoiding resource competition or operation confusion caused by simultaneous execution. By separating the touch events from the background tasks and buffering the conflicting instructions, the problem of instruction conflicts is effectively solved, ensuring the stability of the system and the continuity of operation. At the same time, the touch events are separated from the background tasks by using multi-threading technology, so that the system can process multiple tasks at the same time, improve resource utilization efficiency, store touch events or background tasks in the buffer, avoid system resources being occupied by a single task, optimize the overall performance of the system, and reasonably allocate the queue response events of the touch display screen according to the priority mechanism preset by the user, ensure that high-priority tasks can be executed in time, and improve the response speed of the system. Through dynamic scheduling, the system can flexibly respond to the execution requirements of different tasks and avoid system performance degradation caused by unreasonable resource allocation. ;

[0062] It should be noted that a specific example of separating the touch event from the background task of the touch display screen by applying a preset multi-threading technology based on the touch response time is as follows:

[0063] Assume there are two touch scenarios;

[0064] Scenario 1: Simple click and slide operation;

[0065] When a user clicks a button or performs a simple sliding operation on the touch screen, such as sliding through a picture or document, the system captures the user's click or sliding action in real time, obtains the touch point and operation type, and assigns it to a high-priority processing thread based on the priority of the touch event. The high-priority thread immediately processes the touch event, such as updating the interface content or performing the corresponding functional operation. That is, the system immediately feeds back the operation result to the user through the display to ensure a smooth and real-time user experience;

[0066] Scenario 2: Complex gestures and background data processing;

[0067] When users perform complex gesture operations, such as multi-touch gestures to edit images or perform special actions in games, the system assigns gesture recognition and processing to high-priority threads based on the complexity of the gestures and the preset priority mechanism. High-priority threads respond to and process complex gestures immediately, such as recognizing and performing related operations of multi-touch gestures. At the same time, the system may have background tasks to process, such as data synchronization or background calculations, and these tasks are assigned to low-priority threads to ensure that they do not affect the real-time response of user gesture operations. Finally, the system dynamically adjusts the task allocation and priority of threads to ensure that when users perform complex gesture operations, the execution of background tasks does not interfere with the smoothness and real-time performance of foreground operations.

[0068] To sum up, the system can significantly improve the response speed and overall performance of the system by applying the preset multi-threading technology to separate touch events from the background tasks of the touch display screen. It also ensures real-time response to user operations and continuous operation of background tasks through a reasonable task allocation and scheduling mechanism, thereby improving user experience and system stability.

[0069] In this embodiment, the step S3 of collecting at least one touch point of the finger contact point includes:

[0070] S31: Based on the preset sensors of the touch display screen, collecting sensor data of the user on the touch display screen, wherein the sensors specifically include capacitive sensors, optical sensors and pressure sensors, and the sensor data specifically include capacitance values, optical information and pressure values;

[0071] S32: Determine whether the sensing data matches the finger contact point;

[0072] S33: If yes, extract the feature points of the sensing data, identify the touch points according to the feature points, apply a preset clustering algorithm to group and cluster the touch points, and generate touch points on the touch display screen, wherein the feature points specifically include capacitance change characteristics, brightness changes, edge features, pressure peaks and pressure change rates.

[0073] In this embodiment, the system collects sensor data of the user on the touch screen based on the sensors pre-set on the touch screen, which specifically include capacitive sensors, optical sensors and pressure sensors. The sensor data specifically include capacitance values, optical information and pressure values, and then the system determines whether these sensor data match the finger contacts to execute corresponding steps; for example, when the system determines that the sensor data cannot match the finger contacts, the system will consider that the user's touch operation is invalid, and the system will collect the sensor data again to confirm the accuracy of the current reading and avoid instantaneous errors of the sensor. At the same time, it provides guidance information to help the user perform the touch operation correctly, and displays a prompt message on the touch screen to inform the user that the operation is unsuccessful and recommend the user to try again, and records abnormal sensor data and related information, such as time, sensor readings, etc., to facilitate subsequent analysis and troubleshooting; for example, when the system determines that the sensor data can match the finger contacts, the system will consider that the user's touch operation is valid, and the system will extract feature points of the sensor data, which specifically include capacitance values, optical information and pressure values. The system can identify the touch points according to different feature points, group and cluster the touch points by applying a pre-set clustering algorithm, and generate touch points on the touch display screen; the system can more accurately identify the user's touch operation by extracting multiple feature points of the sensing data (such as capacitance change characteristics, brightness change, edge characteristics, pressure peak value and pressure change rate). This multi-dimensional data processing method improves the accuracy and reliability of the touch points and reduces the cases of misidentification and missed identification. At the same time, the touch points are grouped and clustered by applying a pre-set clustering algorithm, which can quickly process a large amount of touch data and effectively identify the touch points. Because the clustering algorithm can classify the touch points in a relatively short time, the system can quickly respond to the user's operation, thereby improving the overall response speed of the system. By accurately identifying and responding to the user's touch operation, the system can provide a smoother interactive experience, and each touch of the user can get fast and accurate feedback, thereby enhancing the user's satisfaction and usage experience.

[0074] It should be noted that a specific example of extracting feature points of the sensing data, identifying the touch points according to the feature points, grouping and clustering the touch points using a preset clustering algorithm, and generating touch points on the touch display screen is as follows:

[0075] Assume that the user uses three fingers to operate on the touch screen. The system needs to identify and distinguish the three touch points through sensor data. The specific steps are as follows:

[0076] First, the system will obtain the following data from the sensor, including

[0077] Touch point 1: capacitance value A1, brightness change B1, pressure value C1;

[0078] Touch point 2: capacitance value A2, brightness change B2, pressure value C2;

[0079] Touch point 3: capacitance value A3, brightness change B3, pressure value C3;

[0080] Then feature point extraction is performed. The data to extract feature points include

[0081] Touch point 1: capacitance change characteristic A1, brightness change B1, pressure change rate C1;

[0082] Touch point 2: capacitance change characteristic A2, brightness change B2, pressure change rate C2;

[0083] Touch point 3: capacitance change characteristic A3, brightness change B3, pressure change rate C3;

[0084] Then the touch point is identified and the precise location of the touch point is calculated through data fusion, including

[0085] Touch point 1: position (x1, y1);

[0086] Touch point 2: position (x2, y2);

[0087] Touch point 3: position (x3, y3);

[0088] Then, the K-means algorithm is applied to group and cluster. By setting the initial position of the cluster center, each touch point is assigned to the nearest cluster center, and the center of each cluster is calculated, that is, the average value of all points belonging to the cluster. The calculation iteration is repeated until the position of the cluster center no longer changes or the preset number of iterations is reached. Specifically,

[0089] Cluster center 1: initial position (x1, y1);

[0090] Cluster center 2: initial position (x2, y2);

[0091] Cluster center 3: initial position (x3, y3);

[0092] According to the distance from the touch point to the cluster center, each touch point is assigned to the nearest cluster center, including

[0093] Touch point 1 is assigned to cluster center 1;

[0094] Touch point 2 is assigned to cluster center 2;

[0095] Touch point 3 is assigned to cluster center 3;

[0096] By calculating the center position of each cluster, including

[0097] Cluster center 1 is updated to the position of touch point 1 (x1, y1);

[0098] Cluster center 2 is updated to the position of touch point 2 (x2, y2);

[0099] Cluster center 3 is updated to the position of touch point 3 (x3, y3);

[0100] Finally, the steps of allocating points and updating centers are repeated until the position of the cluster center is stable and the touch points are generated. That is, the system will generate touch points on the touch screen according to the clustering results, including

[0101] Touch point 1: position (x1, y1);

[0102] Touch point 2: position (x2, y2);

[0103] Touch point 3: position (x3, y3);

[0104] To sum up, through the fusion of multiple sensor data and clustering algorithms, the system can accurately identify multiple touch points. The clustering algorithm can quickly process and group touch points to ensure that the system responds to user operations in real time. Accurate and real-time touch feedback provides a smooth interactive experience. The system can handle multi-touch and complex gesture operations and adapt to various usage scenarios. Because of the application of multi-sensor data fusion and clustering algorithms, the system can operate stably in various environments, improving the robustness and reliability of the system.

[0105] In this embodiment, before the step S3 of connecting the touch points within a preset time period to form a touch track, the method further includes:

[0106] S301: Based on the original touch data collected by the touch display screen, adjusting the filter parameters corresponding to the preset low-pass filter, applying a moving average filter to perform low-pass filtering on the original touch data, setting the window of the moving average filter to a preset number of touch points, and calculating and generating a smoothed average value, wherein the original touch data specifically includes touch point coordinates and touch timestamps;

[0107] S302: Determine whether the average value matches a preset moving window;

[0108] S303: If so, identify the smooth touch point corresponding to the average value, take the touch coordinates of the smooth touch point and the preset points before and after it, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all the smooth touch points on the touch display screen, and generate the touch trajectory.

[0109] In this embodiment, the system is based on the original touch data collected by the touch display screen, the original touch data specifically includes the touch point coordinates and the touch timestamp, adjusts the filtering parameters corresponding to the preset low-pass filter, applies the moving average filter to perform low-pass filtering on the original touch data, sets the window of the moving average filter to the preset number of touch points, calculates and generates the average value after smoothing, and then the system determines whether the average value matches the preset moving window to execute the corresponding steps; for example, when the system determines that the average value cannot match the preset moving window, the system will consider that the actual number of touch points is larger than the set moving window. If there is a small mismatch, resulting in inaccurate filtering results, the system will check the original touch data, identify and remove obvious noise and outliers, such as applying statistical methods such as median filtering or using a preset threshold range to filter data. At the same time, according to the actual situation of the touch data, adjust the parameters of the low-pass filter (such as window size, weight coefficient, etc.) to optimize the filtering effect, such as dynamically adjusting the window size of the moving average filter according to the rate of change of the data, and dynamically adjusting the size of the moving window according to the actual number of touch points to ensure the accuracy of the filtering results. A minimum and maximum window range can be set and automatically adjusted according to the number of touch points; for example, when the system determines that When the average value can match the preset moving window, the system will consider that the actual number of touch points matches the set moving window size, and the system will identify the smooth touch points corresponding to the average value, take these smooth touch points and the touch coordinates of the preset points before and after, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all smooth touch points on the touch display screen, and generate a touch trajectory; the system uses moving average filtering to effectively suppress the noise and abnormal values ​​in the original touch data, and the generated touch trajectory is smoother and more natural, avoiding jitter and mutation, and the touch trajectory after smoothing is smoother and more natural. The touch trajectory can more accurately reflect the user's actual touch operation, improving the user experience. At the same time, smoothing can reduce errors in touch data and improve the accuracy of touch point coordinates, so that the system can more accurately identify the user's touch trajectory and operation. That is, accurate touch point coordinates help the system better respond to the user's touch commands and improve the accuracy of touch operations. By low-pass filtering and smoothing the touch data, the system can better cope with noise and interference in the touch environment, enhancing the robustness and stability of the system. Even in noisy or interfering environments, the system can maintain high touch recognition accuracy and response speed.

[0110] It should be noted that a specific example of applying a moving average filter to perform low-pass filtering on the original touch data, setting the window of the moving average filter to a preset number of touch points, and calculating and generating the average value after smoothing is as follows:

[0111] Assume there is a set of raw touch data (touch point coordinates), including

[0112] Point 1: coordinates (10,20);

[0113] Point 2: coordinates (15,25);

[0114] Point 3: coordinates (20,30);

[0115] Point 4: coordinates (25,35);

[0116] Point 5: coordinates (30,40);

[0117] If the window size of the moving average filter is set to 3, the specific calculation process is as follows:

[0118] Initialized window size = 3

[0119] The first window, point 1, point 2, point 3, includes

[0120] Smooth point 1=[(10+15+20) / 3,(20+25+30) / 3]=[15,25];

[0121] Second window: Point 2, Point 3, Point 4, including

[0122] Smooth point 2=[(15+20+25) / 3,(25+30+35) / 3]=[20,30];

[0123] The third window: Point 3, Point 4, Point 5, including

[0124] Smooth point 3=[(20+25+30) / 3,(30+35+40) / 3]=[25,35];

[0125] Starting position (point 1), since there is only one data point, the value of this point can be used directly for compensation.

[0126] Smooth point 0=[10,20];

[0127] End position (point 5)

[0128] Smooth point 4=[30,40];

[0129] Then the final smooth touch point includes

[0130] Smoothing point 0: coordinates (10,20);

[0131] Smoothing point 1: coordinates (15,25);

[0132] Smooth point 2: coordinates (20,30);

[0133] Smoothing point 3: coordinates (25,35);

[0134] Smoothing point 4: coordinates (30,40);

[0135] The calculation process is explained as follows, including

[0136] The first window: contains the 1st, 2nd and 3rd points of the original data, and calculates their average to get the smoothing point 1;

[0137] The second window: contains the 2nd, 3rd, and 4th points of the original data, and calculates their average to get smooth point 2;

[0138] The third window: contains the 3rd, 4th and 5th points of the original data, and calculates their average to get the smoothing point 3;

[0139] For the initial and final points, a simple compensation method is used, that is, the values ​​of the original points are directly used as smoothing points;

[0140] To sum up, through moving average filtering, the noise and mutations in the original touch data are smoothed, and the generated touch trajectory is more natural and smooth. At the same time, the smoothed touch points after filtering can more accurately reflect the user's real touch operation, thereby improving the accuracy of touch recognition. In addition, the system can maintain stable performance and high accuracy when processing different touch data, thereby improving the user experience.

[0141] In this embodiment, the step S5 of buffering the touch event or the background task into a preset buffer further includes:

[0142] S51: Based on the thread pool preset by the touch display screen, monitoring the load rate of each preset thread, and dynamically adjusting the number of threads in the thread pool according to the load rate;

[0143] S52: Determine whether the number of threads reaches a preset upper limit;

[0144] S53: If so, extract the continuous memory blocks required by the load rate from the preset memory pool, divide the continuous memory blocks into free memory blocks of preset sizes, add the free memory blocks to a pre-established free block linked list, allocate the free memory blocks in the free block linked list to the corresponding thread request objects, and output the pointer corresponding to the allocated memory block to the thread request object.

[0145] In this embodiment, the system monitors the load rate of each preset thread based on the thread pool pre-set by the touch display screen, dynamically adjusts the number of threads in the thread pool according to different load rates, and then the system determines whether the number of threads reaches the preset upper limit to execute the corresponding steps; for example, when the system determines that the number of threads in the thread pool has not reached the preset upper limit, the system will consider that the current load is still within the controllable range and is still capable of processing more tasks or adding more threads to improve the concurrent processing capability. The system will dynamically increase the number of threads in the thread pool according to the current load rate to better share the load, improve the concurrent processing capability of the system, ensure that the newly added threads can be reasonably allocated to each task, avoid resource waste and task congestion, and at the same time allocate waiting tasks to the newly added threads for execution, reduce the waiting time of tasks, improve task processing efficiency, ensure that new tasks can be quickly processed, improve user experience and system response speed, and continuously monitor the load rate and number of threads in the thread pool, and promptly feedback the effect of the adjustment to ensure stable system operation. According to real-time monitoring data, the thread pool management strategy is further optimized to ensure that the system can run efficiently under different load conditions; for example, when the system determines that the number of threads in the thread pool is When the load reaches the preset upper limit, the system will think that the load is difficult to control, and the system will extract the continuous memory blocks required by the load rate from the preset memory pool, divide the continuous memory blocks into free memory blocks of preset sizes, and add the free memory blocks to the pre-established free block linked list, allocate the free memory blocks in the free block linked list to the corresponding thread request object, and output the pointer corresponding to the allocated memory block to the thread request object; by extracting the continuous memory blocks required by the load rate from the memory pool and allocating them, the system can effectively alleviate the resource bottleneck problem when the thread pool reaches the upper limit, and improve the system under high The resource allocation capability under load conditions avoids task backlogs and slow system response caused by insufficient thread pool resources. At the same time, the use of memory pool technology can reduce memory fragmentation and improve the efficiency of memory allocation and recovery. Through the management of pre-set memory block size and free block linked list, the system can quickly find and allocate suitable memory blocks, reduce memory allocation overhead, and by adding free memory blocks to the free block linked list and allocating them to thread request objects, the system can quickly meet the memory requirements of threads, improve task processing efficiency, avoid frequent memory allocation and release operations, and improve the overall performance and stability of the system.

[0146] It should be noted that the specific examples are as follows:

[0147] Assume that the system sets the thread pool limit to 100 threads. When the system load increases and the number of threads in the thread pool reaches 100, the system will take the following actions, including

[0148] Extract memory blocks and extract continuous memory blocks from a pre-set memory pool. For example, if 1000 bytes of memory are needed, divide these continuous memory blocks into pre-set sizes, such as 100 bytes per memory block, and divide them into 10 free memory blocks in total. Then manage the free memory blocks and add the 10 divided free memory blocks to the free block linked list. The linked list maintains the information and pointers of these free memory blocks. Finally, allocate memory blocks. That is, when a thread requests memory, the system allocates a free memory block from the free block linked list to the corresponding thread request object, and outputs the pointer corresponding to the allocated memory block to the thread request object. The thread can use the memory block for data storage and processing.

[0149] In this embodiment, the step S2 of determining whether the touch display screen can detect the finger contact of the user further includes:

[0150] S21: Based on a preset calibration procedure of the touch display screen, present a preset pattern on the touch display screen and guide the user to touch and click the preset pattern, and detect a finger contact point corresponding to the touch and click;

[0151] S22: Determine whether the finger contact is aligned with the preset pattern;

[0152] S23: If yes, periodically collect touch data according to preset time nodes, use a preset ring buffer to store the touch data, timestamp the touch data in the ring buffer, and restore the touch trajectory corresponding to the touch data according to the timestamp.

[0153] In this embodiment, the system presents a preset pattern on the touch screen based on a calibration program pre-set on the touch screen, guides the user to touch and click the pattern, detects the finger contact point corresponding to the touch and click, and then the system determines whether the user's finger contact point is aligned with the pattern to execute the corresponding steps; for example, when the system determines that the user's finger contact point is not aligned with the pattern, the system will believe that there may be a calibration deviation on the touch screen or the user has offset during operation, and the system will re-present the pattern, display the preset pattern on the touch screen again, and guide the user to touch and click, perform multiple calibration operations to ensure that more data is obtained to determine the accuracy of the calibration, and at the same time record the specific positions of the user's multiple touch clicks, analyze the deviation, adjust the mapping relationship of the touch coordinates through the calibration algorithm, ensure that the user's click position accurately corresponds to the preset pattern, and provide real-time feedback on the calibration result, display the accuracy after calibration, and prompt the user to successfully operate or continue calibration; for example, when the system determines that the user's finger contact point can be aligned with the pattern When a touch screen is used, the system will assume that the user's touch command can be recorded by the touch display screen. The system will periodically collect touch data according to the preset time nodes, apply the preset ring buffer to store the touch data, and timestamp the touch data in the ring buffer. According to different timestamps, the touch trajectory corresponding to the touch data is restored. The system can evenly distribute the collection tasks by regularly collecting touch data, reduce the pressure of instantaneous data processing, and improve the response speed of the system. The ring buffer can efficiently manage the storage of touch data and avoid memory fragmentation and overflow problems that may occur in traditional buffers. At the same time, by timestamping the touch data, the system can accurately restore the touch trajectory to ensure the continuity and integrity of the data. By restoring the touch trajectory using the timestamp, the system can accurately reflect the user's touch operation and ensure a complete record of the user's operation. In addition, the ring buffer will automatically overwrite the earliest data when it is fully loaded, so that the memory space can be fully utilized, and there is no need to frequently allocate and release memory, thereby improving memory utilization.

[0154] In this embodiment, the step S4 of determining whether the execution instruction can be synchronously executed by the touch display screen further includes:

[0155] S41: verifying the path information of the execution instruction based on the hierarchical dependency relationship preset by the touch display screen;

[0156] S42: Determine whether a circular dependency is detected in the path information;

[0157] S43: If yes, then mark the loop nodes from the path information, sort the loop nodes to collect key dependent nodes, introduce a preset intermediate state to execute part of the instructions of the key dependent nodes in batches.

[0158] In this embodiment, the system verifies the path information of the execution instruction based on the hierarchical dependency relationship pre-set by the touch display screen, and then the system determines whether these path information detects circular dependencies to execute the corresponding steps; for example, when the system determines that the path information of the execution instruction does not detect circular dependencies, the system will consider that the dependency relationship between the execution instructions is valid and has no conflicts, and can be executed normally in sequence. The system will execute the instructions in sequence according to the order in the dependencies, ensuring that each instruction starts to execute after the dependent predecessor instructions are executed. For instructions without dependencies, they can be executed in parallel to improve efficiency. At the same time, the execution status of each instruction is monitored in real time, and the execution results and execution time are recorded, including the execution log of each instruction, including the start time, end time, execution results and other information, to facilitate subsequent analysis and troubleshooting, and the execution results are fed back to the user to ensure that the user understands the execution process and results; for example, when the system determines that the path information of the execution instruction can detect circular dependencies, the execution results and execution time are recorded, including the execution log of each instruction, including the start time, end time, execution results and other information, to facilitate subsequent analysis and troubleshooting, and the execution results are fed back to the user to ensure that the user understands the execution process and results. When there is a dependency, the system will think that there is a conflict in the dependency relationship between the execution instructions. The system will mark the loop nodes from the path information, sort the different loop nodes to collect the key dependency nodes, and introduce the pre-set intermediate state to execute some instructions of the key dependency nodes in batches; by sorting the key nodes in the loop dependency, the system can effectively decompose the complex dependency relationship and gradually resolve the conflict. By marking the nodes of the loop dependency, the system can clearly identify the specific location of the conflict, which is convenient for subsequent processing. At the same time, by introducing the intermediate state to execute some instructions of the key nodes in batches, the system can check and adjust at each stage to ensure the stability of the execution process. Executing some instructions of the key nodes in batches can reduce the execution risk and avoid the problems that may be caused by executing all instructions at one time. In addition, through batch execution, the system can allocate and use resources more reasonably to avoid excessive occupation or waste of resources, and give priority to key dependency nodes, which helps to speed up the resolution of dependency conflicts and improve the overall execution efficiency.

[0159] In this embodiment, based on the finger data pre-recorded by the user, the pre-recorded identity information is generated from the touch display screen, and the step S1 of granting the user the central control authority of the touch display screen according to the identity information further includes:

[0160] S11: generating preset guidance content on the touch display screen based on the identity information;

[0161] S12: Determine whether the user has completed the guidance content;

[0162] S13: If not, dynamically adjusting the personalized interface of the touch display screen according to the identity information of the user, and granting the user the authority to change the personalized interface.

[0163] In this embodiment, the system generates pre-set guidance content from the touch screen based on the identity information, and then the system determines whether the user has completed the guidance content to execute the corresponding steps; for example, when the system determines that the user has completed the guidance content generated by the touch screen, the system will consider that the user has successfully performed the pre-set operation or learning steps, and the system will store information such as the time and steps of the user completing the guidance content in the user's personal profile, update the user's progress information, and at the same time, according to the user's completion of the guidance, unlock the system's advanced functions or next operation permissions, recommend relevant operation guides, usage skills or advanced functions to the user, further enhance the user experience, and adjust the system's personalized settings, such as touch sensitivity and interface layout, according to the user's performance during the guidance process; for example, when the system determines that the user has not completed When the guidance content is completed, the system will think that the touch screen has not yet recognized the identity of the user. The system will dynamically adjust the personalized interface provided by the touch screen for the visitor user based on the user's visitor identity information, and grant the visitor user the authority to change the personalized interface; the system dynamically adjusts the interface according to the identity information of different users, and can flexibly respond to various user needs. Both first-time visitors and registered users who have completed the guidance can obtain suitable interfaces and functions. At the same time, users who have not completed the guidance log in as visitors, and the system restricts their permissions to prevent unverified users from operating the core functions of the system, thereby ensuring the security and stability of the system. In addition, by providing some personalized functions and interface change permissions, the system attracts visitor users to experience the system in depth, increases their motivation to complete the guidance and registration, and thus improves user stickiness and retention rate.

[0164] Reference Figure 2 , is a multi-touch point recognition system for a touch display screen in one embodiment of the present invention, comprising:

[0165] A generating module 10 is used to generate pre-recorded identity information from the touch display screen based on finger data pre-recorded by the user, and grant the user central control authority over the touch display screen according to the identity information, wherein the finger data specifically includes finger fingerprint data, touch area data and touch force data;

[0166] A determination module 20, configured to determine whether the touch screen can detect the finger contact of the user;

[0167] an execution module 30, configured to, if possible, collect at least one touch point of the finger contact, connect the touch points within a preset period of time to form a touch track, identify the touch function corresponding to the touch track, provide the user with a touch instruction corresponding to the touch function through the touch display screen, generate selectable execution instructions corresponding to the touch track, and obtain at least two of the execution instructions selected by the user;

[0168] A second judgment module 40 is used to judge whether the execution instruction can be synchronously executed through the touch display screen;

[0169] The second execution module 50 is used to collect the touch response time of the execution instruction if not, and apply the preset multi-threading technology based on the touch response time to separate the touch event from the background task of the touch display screen, buffer the touch event or the background task to a preset buffer, and allocate the queue response event of the touch display screen according to the priority mechanism preset by the user on the touch display screen.

[0170] In this embodiment, the generation module 10 generates pre-recorded user identity information from the touch display screen based on the finger data pre-recorded by the user in the touch display screen, the finger data specifically including finger fingerprint data, touch area data and touch force data, and grants different users central control permissions to the touch display screen according to different user identity information. Then the judgment module 20 judges whether the touch display screen can detect the user's finger contact points to execute corresponding steps; for example, when the system determines that the touch display screen cannot detect the user's finger contact points, the system will consider that the user's finger contact points have not been pre-recorded or the recognition is inaccurate, and the system will display a message prompting the user to When the user touches the screen correctly, a message such as "No touch detected, please make sure your finger is in contact with the screen" is displayed, and the user is reminded to try to touch the screen again through a sound. At the same time, the user is guided to adjust the placement of the finger, and the user is prompted to re-place the finger on the touch screen to ensure the correct finger position and strength. The user is also prompted to clean the screen surface to ensure that there are no stains, water droplets, grease, etc. that interfere with touch recognition, and the sensitivity of the touch sensor is dynamically adjusted to adapt to different usage environments and improve the accuracy of touch recognition. For example, when the system determines that the touch screen can detect the user's finger contact, the execution module 30 will consider that the user's finger contact can be touched by the touch display. The screen is recognized, that is, the touch display screen can execute the instructions input by the user's finger. The system will collect at least one touch point of the finger contact, connect these touch points within a preset time period to form the touch track required by the user, identify the touch function corresponding to the touch track, provide the user with the touch instruction corresponding to the touch function through the touch display screen, generate the corresponding selectable execution instructions in the touch track, and obtain at least two execution instructions selected by the user; the system can recognize the user's touch track in real time and provide corresponding touch instructions, that is, the user can immediately see the operation result, improve the fluency and satisfaction of the operation, and recognize the corresponding touch function on the touch track. Function, the user can perform a variety of touch operations, such as sliding, zooming, rotating, etc., enriching the interaction mode, and generating selectable execution instructions according to the identified touch track. The user can select multiple execution instructions for combination to flexibly meet different operation requirements, and ensure the efficient processing of touch events and background tasks through intelligent allocation and optimization of system resources, improve the overall system performance, and collect and connect touch points within a preset time period to form a complete touch track, ensuring that the system can quickly respond to user operations to reduce delays; then the second judgment module 40 determines whether these execution instructions can be synchronously executed through the touch display screen to execute the corresponding steps;For example, when the system determines that two or more execution instructions that the user needs to execute can be executed synchronously through the touch display screen, the system will consider that there is no conflict between these execution instructions and they can be executed in parallel without interfering with each other. The system will start the multi-tasking mechanism to execute multiple instructions of the user. According to the requirements of each execution instruction, the system will reasonably allocate resources such as CPU and memory to ensure that each instruction can get sufficient resource support. At the same time, the execution status of each execution instruction is monitored in real time to ensure that all instructions are executed within expectations. If it is found that some instructions are executed slowly or occupy more resources, the system will make dynamic adjustments to balance resource allocation to ensure overall execution efficiency, and feedback the execution status of each execution instruction to the user in real time through the touch display screen, such as progress bar, prompt information, etc., so that the user can understand the task execution status; for example, when the system determines that two or more execution instructions that the user needs to execute cannot be executed synchronously through the touch display screen, the second execution module 50 will consider that these execution instructions are in conflict, and the system will collect the touch response time of the execution instruction, and apply the pre-set multi-threading technology based on different touch response times to convert the touch event Separate the touch screen from the background tasks, buffer the touch events or background tasks in a pre-set buffer, and allocate the queue response events of the touch screen, that is, the instructions to be executed in the touch screen queue, according to the priority mechanism pre-set by the user on the touch screen; the system can detect conflicts between the instructions that the user needs to execute, avoiding resource competition or operation confusion caused by simultaneous execution. By separating the touch events from the background tasks and buffering the conflicting instructions, the problem of instruction conflicts is effectively solved, ensuring the stability of the system and the continuity of operations. At the same time, using multi-threading technology, the touch events are separated from the background tasks, so that the system can process multiple tasks at the same time, improve resource utilization efficiency, store touch events or background tasks in the buffer, avoid system resources being occupied by a single task, optimize the overall performance of the system, and reasonably allocate the queue response events of the touch screen according to the priority mechanism preset by the user, ensure that high-priority tasks can be executed in time, and improve the response speed of the system. Through dynamic scheduling, the system can flexibly respond to the execution requirements of different tasks and avoid system performance degradation caused by unreasonable resource allocation. ;

[0171] In this embodiment, the execution module includes:

[0172] A collection unit, configured to collect sensor data of the user on the touch display screen based on a sensor preset in the touch display screen, wherein the sensor specifically includes a capacitive sensor, an optical sensor and a pressure sensor, and the sensor data specifically includes a capacitance value, optical information and a pressure value;

[0173] a judging unit, configured to judge whether the sensing data matches the finger contact point;

[0174] An execution unit is used to extract feature points of the sensing data, identify the touch points according to the feature points, group and cluster the touch points using a preset clustering algorithm, and generate touch points on the touch display screen, wherein the feature points specifically include capacitance change characteristics, brightness changes, edge features, pressure peak values, and pressure change rates.

[0175] In this embodiment, the system collects sensor data of the user on the touch screen based on the sensors pre-set on the touch screen, which specifically include capacitive sensors, optical sensors and pressure sensors. The sensor data specifically include capacitance values, optical information and pressure values, and then the system determines whether these sensor data match the finger contacts to execute corresponding steps; for example, when the system determines that the sensor data cannot match the finger contacts, the system will consider that the user's touch operation is invalid, and the system will collect the sensor data again to confirm the accuracy of the current reading and avoid instantaneous errors of the sensor. At the same time, it provides guidance information to help the user perform the touch operation correctly, and displays a prompt message on the touch screen to inform the user that the operation is unsuccessful and recommend the user to try again, and records abnormal sensor data and related information, such as time, sensor readings, etc., to facilitate subsequent analysis and troubleshooting; for example, when the system determines that the sensor data can match the finger contacts, the system will consider that the user's touch operation is valid, and the system will extract feature points of the sensor data, which specifically include capacitance values, optical information and pressure values. The system can identify the touch points according to different feature points, group and cluster the touch points by applying a pre-set clustering algorithm, and generate touch points on the touch display screen; the system can more accurately identify the user's touch operation by extracting multiple feature points of the sensing data (such as capacitance change characteristics, brightness change, edge characteristics, pressure peak value and pressure change rate). This multi-dimensional data processing method improves the accuracy and reliability of the touch points and reduces the cases of misidentification and missed identification. At the same time, the touch points are grouped and clustered by applying a pre-set clustering algorithm, which can quickly process a large amount of touch data and effectively identify the touch points. Because the clustering algorithm can classify the touch points in a relatively short time, the system can quickly respond to the user's operation, thereby improving the overall response speed of the system. By accurately identifying and responding to the user's touch operation, the system can provide a smoother interactive experience, and each touch of the user can get fast and accurate feedback, thereby enhancing the user's satisfaction and usage experience.

[0176] In this embodiment, it also includes:

[0177] a calculation module, configured to adjust the filter parameters corresponding to the preset low-pass filter based on the raw touch data collected by the touch display screen, apply a moving average filter to perform low-pass filtering on the raw touch data, set the window of the moving average filter to a preset number of touch points, and calculate and generate a smoothed average value, wherein the raw touch data specifically includes touch point coordinates and touch timestamps;

[0178] A third judgment module is used to judge whether the average value matches a preset moving window;

[0179] The third execution module is used to identify the smooth touch point corresponding to the average value, take the touch coordinates of the smooth touch point and the preset points before and after it, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all the smooth touch points on the touch display screen, and generate the touch trajectory.

[0180] In this embodiment, the system is based on the original touch data collected by the touch display screen, the original touch data specifically includes the touch point coordinates and the touch timestamp, adjusts the filtering parameters corresponding to the preset low-pass filter, applies the moving average filter to perform low-pass filtering on the original touch data, sets the window of the moving average filter to the preset number of touch points, calculates and generates the average value after smoothing, and then the system determines whether the average value matches the preset moving window to execute the corresponding steps; for example, when the system determines that the average value cannot match the preset moving window, the system will consider that the actual number of touch points is larger than the set moving window. If there is a small mismatch, resulting in inaccurate filtering results, the system will check the original touch data, identify and remove obvious noise and outliers, such as applying statistical methods such as median filtering or using a preset threshold range to filter data. At the same time, according to the actual situation of the touch data, adjust the parameters of the low-pass filter (such as window size, weight coefficient, etc.) to optimize the filtering effect, such as dynamically adjusting the window size of the moving average filter according to the rate of change of the data, and dynamically adjusting the size of the moving window according to the actual number of touch points to ensure the accuracy of the filtering results. A minimum and maximum window range can be set and automatically adjusted according to the number of touch points; for example, when the system determines that When the average value can match the preset moving window, the system will consider that the actual number of touch points matches the set moving window size, and the system will identify the smooth touch points corresponding to the average value, take these smooth touch points and the touch coordinates of the preset points before and after, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all smooth touch points on the touch display screen, and generate a touch trajectory; the system uses moving average filtering to effectively suppress the noise and abnormal values ​​in the original touch data, and the generated touch trajectory is smoother and more natural, avoiding jitter and mutation, and the touch trajectory after smoothing is smoother and more natural. The touch trajectory can more accurately reflect the user's actual touch operation, improving the user experience. At the same time, smoothing can reduce errors in touch data and improve the accuracy of touch point coordinates, so that the system can more accurately identify the user's touch trajectory and operation. That is, accurate touch point coordinates help the system better respond to the user's touch commands and improve the accuracy of touch operations. By low-pass filtering and smoothing the touch data, the system can better cope with noise and interference in the touch environment, enhancing the robustness and stability of the system. Even in noisy or interfering environments, the system can maintain high touch recognition accuracy and response speed.

[0181] In this embodiment, the second execution module further includes:

[0182] A monitoring unit, configured to monitor the load rate of each preset thread based on the thread pool preset by the touch display screen, and dynamically adjust the number of threads in the thread pool according to the load rate;

[0183] A second judging unit, used to judge whether the number of threads reaches a preset upper limit;

[0184] The second execution unit is used to extract the continuous memory blocks required for the load rate from the preset memory pool, divide the continuous memory blocks into free memory blocks of preset sizes, add the free memory blocks to a pre-established free block linked list, allocate the free memory blocks in the free block linked list to the corresponding thread request objects, and output the pointer corresponding to the allocated memory block to the thread request object.

[0185] In this embodiment, the system monitors the load rate of each preset thread based on the thread pool pre-set by the touch display screen, dynamically adjusts the number of threads in the thread pool according to different load rates, and then the system determines whether the number of threads reaches the preset upper limit to execute the corresponding steps; for example, when the system determines that the number of threads in the thread pool has not reached the preset upper limit, the system will consider that the current load is still within the controllable range and is still capable of processing more tasks or adding more threads to improve the concurrent processing capability. The system will dynamically increase the number of threads in the thread pool according to the current load rate to better share the load, improve the concurrent processing capability of the system, ensure that the newly added threads can be reasonably allocated to each task, avoid resource waste and task congestion, and at the same time allocate waiting tasks to the newly added threads for execution, reduce the waiting time of tasks, improve task processing efficiency, ensure that new tasks can be quickly processed, improve user experience and system response speed, and continuously monitor the load rate and number of threads in the thread pool, and promptly feedback the effect of the adjustment to ensure stable system operation. According to real-time monitoring data, the thread pool management strategy is further optimized to ensure that the system can run efficiently under different load conditions; for example, when the system determines that the number of threads in the thread pool is When the load reaches the preset upper limit, the system will think that the load is difficult to control, and the system will extract the continuous memory blocks required by the load rate from the preset memory pool, divide the continuous memory blocks into free memory blocks of preset sizes, and add the free memory blocks to the pre-established free block linked list, allocate the free memory blocks in the free block linked list to the corresponding thread request object, and output the pointer corresponding to the allocated memory block to the thread request object; by extracting the continuous memory blocks required by the load rate from the memory pool and allocating them, the system can effectively alleviate the resource bottleneck problem when the thread pool reaches the upper limit, and improve the system under high The resource allocation capability under load conditions avoids task backlogs and slow system response caused by insufficient thread pool resources. At the same time, the use of memory pool technology can reduce memory fragmentation and improve the efficiency of memory allocation and recovery. Through the management of pre-set memory block size and free block linked list, the system can quickly find and allocate suitable memory blocks, reduce memory allocation overhead, and by adding free memory blocks to the free block linked list and allocating them to thread request objects, the system can quickly meet the memory requirements of threads, improve task processing efficiency, avoid frequent memory allocation and release operations, and improve the overall performance and stability of the system.

[0186] In this embodiment, the judgment module further includes:

[0187] A detection unit, configured to present a preset pattern on the touch display screen based on a preset calibration procedure of the touch display screen, guide the user to touch and click the preset pattern, and detect a finger contact point corresponding to the touch and click;

[0188] A third judging unit, used for judging whether the finger contact point is aligned with the preset pattern;

[0189] The third execution unit is used to periodically collect touch data according to preset time nodes, apply a preset ring buffer to store the touch data, timestamp the touch data in the ring buffer, and restore the touch trajectory corresponding to the touch data according to the timestamp.

[0190] In this embodiment, the system presents a preset pattern on the touch screen based on a calibration program pre-set on the touch screen, guides the user to touch and click the pattern, detects the finger contact point corresponding to the touch and click, and then the system determines whether the user's finger contact point is aligned with the pattern to execute the corresponding steps; for example, when the system determines that the user's finger contact point is not aligned with the pattern, the system will believe that there may be a calibration deviation on the touch screen or the user has offset during operation, and the system will re-present the pattern, display the preset pattern on the touch screen again, and guide the user to touch and click, perform multiple calibration operations to ensure that more data is obtained to determine the accuracy of the calibration, and at the same time record the specific positions of the user's multiple touch clicks, analyze the deviation, adjust the mapping relationship of the touch coordinates through the calibration algorithm, ensure that the user's click position accurately corresponds to the preset pattern, and provide real-time feedback on the calibration result, display the accuracy after calibration, and prompt the user to successfully operate or continue calibration; for example, when the system determines that the user's finger contact point can be aligned with the pattern When a touch screen is used, the system will assume that the user's touch command can be recorded by the touch display screen. The system will periodically collect touch data according to the preset time nodes, apply the preset ring buffer to store the touch data, and timestamp the touch data in the ring buffer. According to different timestamps, the touch trajectory corresponding to the touch data is restored. The system can evenly distribute the collection tasks by regularly collecting touch data, reduce the pressure of instantaneous data processing, and improve the response speed of the system. The ring buffer can efficiently manage the storage of touch data and avoid memory fragmentation and overflow problems that may occur in traditional buffers. At the same time, by timestamping the touch data, the system can accurately restore the touch trajectory to ensure the continuity and integrity of the data. By restoring the touch trajectory using the timestamp, the system can accurately reflect the user's touch operation and ensure a complete record of the user's operation. In addition, the ring buffer will automatically overwrite the earliest data when it is fully loaded, so that the memory space can be fully utilized, and there is no need to frequently allocate and release memory, thereby improving memory utilization.

[0191] In this embodiment, the second determination module further includes:

[0192] A verification unit, used to verify the path information of the execution instruction based on the hierarchical dependency relationship preset by the touch display screen;

[0193] A fourth determination unit, configured to determine whether a circular dependency is detected in the path information;

[0194] The fourth execution unit is used to mark the loop nodes from the path information, sort the loop nodes to collect key dependent nodes, and introduce a preset intermediate state to execute part of the instructions of the key dependent nodes in batches.

[0195] In this embodiment, the system verifies the path information of the execution instruction based on the hierarchical dependency relationship pre-set by the touch display screen, and then the system determines whether these path information detects circular dependencies to execute the corresponding steps; for example, when the system determines that the path information of the execution instruction does not detect circular dependencies, the system will consider that the dependency relationship between the execution instructions is valid and has no conflicts, and can be executed normally in sequence. The system will execute the instructions in sequence according to the order in the dependencies, ensuring that each instruction starts to execute after the dependent predecessor instructions are executed. For instructions without dependencies, they can be executed in parallel to improve efficiency. At the same time, the execution status of each instruction is monitored in real time, and the execution results and execution time are recorded, including the execution log of each instruction, including the start time, end time, execution results and other information, to facilitate subsequent analysis and troubleshooting, and the execution results are fed back to the user to ensure that the user understands the execution process and results; for example, when the system determines that the path information of the execution instruction can detect circular dependencies, the execution results and execution time are recorded, including the execution log of each instruction, including the start time, end time, execution results and other information, to facilitate subsequent analysis and troubleshooting, and the execution results are fed back to the user to ensure that the user understands the execution process and results. When there is a dependency, the system will think that there is a conflict in the dependency relationship between the execution instructions. The system will mark the loop nodes from the path information, sort the different loop nodes to collect the key dependency nodes, and introduce the pre-set intermediate state to execute some instructions of the key dependency nodes in batches; by sorting the key nodes in the loop dependency, the system can effectively decompose the complex dependency relationship and gradually resolve the conflict. By marking the nodes of the loop dependency, the system can clearly identify the specific location of the conflict, which is convenient for subsequent processing. At the same time, by introducing the intermediate state to execute some instructions of the key nodes in batches, the system can check and adjust at each stage to ensure the stability of the execution process. Executing some instructions of the key nodes in batches can reduce the execution risk and avoid the problems that may be caused by executing all instructions at one time. In addition, through batch execution, the system can allocate and use resources more reasonably to avoid excessive occupation or waste of resources, and give priority to key dependency nodes, which helps to speed up the resolution of dependency conflicts and improve the overall execution efficiency.

[0196] In this embodiment, the generation module further includes:

[0197] A generating unit, configured to generate preset guidance content from the touch display screen based on the identity information;

[0198] A fifth judgment unit, used to judge whether the user has completed the guidance content;

[0199] The fifth execution unit is used to dynamically adjust the personalized interface of the touch display screen according to the identity information of the user if the answer is no, and grant the user the authority to change the personalized interface.

[0200] In this embodiment, the system generates pre-set guidance content from the touch screen based on the identity information, and then the system determines whether the user has completed the guidance content to execute the corresponding steps; for example, when the system determines that the user has completed the guidance content generated by the touch screen, the system will consider that the user has successfully performed the pre-set operation or learning steps, and the system will store information such as the time and steps of the user completing the guidance content in the user's personal profile, update the user's progress information, and at the same time, according to the user's completion of the guidance, unlock the system's advanced functions or next operation permissions, recommend relevant operation guides, usage skills or advanced functions to the user, further enhance the user experience, and adjust the system's personalized settings, such as touch sensitivity and interface layout, according to the user's performance during the guidance process; for example, when the system determines that the user has not completed When the guidance content is completed, the system will think that the touch screen has not yet recognized the identity of the user. The system will dynamically adjust the personalized interface provided by the touch screen for the visitor user based on the user's visitor identity information, and grant the visitor user the authority to change the personalized interface; the system dynamically adjusts the interface according to the identity information of different users, and can flexibly respond to various user needs. Both first-time visitors and registered users who have completed the guidance can obtain suitable interfaces and functions. At the same time, users who have not completed the guidance log in as visitors, and the system restricts their permissions to prevent unverified users from operating the core functions of the system, thereby ensuring the security and stability of the system. In addition, by providing some personalized functions and interface change permissions, the system attracts visitor users to experience the system in depth, increases their motivation to complete the guidance and registration, and thus improves user stickiness and retention rate.

[0201] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A multi-touch point recognition method for a touch display screen, characterized in that: The following steps are involved: Based on the finger data pre-entered by the user, pre-recorded identity information is generated from the touch display screen, and the user is granted central control authority over the touch display screen according to the identity information, wherein the finger data specifically includes finger fingerprint data, touch area data, and touch force data; Determining whether the touch display screen can detect the finger contact point of the user; If it is possible, at least one touch point of the finger contact is collected, the touch points are connected within a preset time period to form a touch track, the touch function corresponding to the touch track is identified, a touch instruction corresponding to the touch function is provided to the user through the touch display screen, an executable instruction corresponding to the touch track is generated, and at least two executable instructions selected by the user are obtained; Determining whether the execution instruction can be synchronously executed through the touch display screen; If not, collecting the touch response time of the execution instruction, applying a preset multi-threading technology based on the touch response time to separate the touch event from the background task of the touch display screen, buffering the touch event or the background task into a preset buffer, and allocating the queue response event of the touch display screen according to the priority mechanism preset by the user on the touch display screen; Wherein, the step of buffering the touch event or the background task into a preset buffer further includes: Based on the thread pool preset by the touch display screen, monitor the load rate of each preset thread, and dynamically adjust the number of threads in the thread pool according to the load rate; Determine whether the number of threads reaches a preset upper limit; If yes, extract the continuous memory blocks required by the load rate from the preset memory pool, divide the continuous memory blocks into free memory blocks of preset sizes, add the free memory blocks to a pre-established free block linked list, allocate the free memory blocks to corresponding thread request objects in the free block linked list, and output the pointer corresponding to the allocated memory block to the thread request object; Wherein, the step of determining whether the execution instruction can be synchronously executed through the touch display screen further includes: Verifying the path information of the execution instruction based on the hierarchical dependency relationship preset by the touch display screen; Determining whether a circular dependency is detected in the path information; If so, loop nodes are marked from the path information, the loop nodes are sorted to collect key dependent nodes, and a preset intermediate state is introduced to execute part of the instructions of the key dependent nodes in batches.

2. The multi-touch point recognition method for a touch display screen according to claim 1, characterized in that: The step of collecting at least one touch point of the finger contact point includes: Based on the preset sensors of the touch display screen, the sensor data of the user on the touch display screen is collected, wherein the sensors specifically include capacitive sensors, optical sensors and pressure sensors, and the sensor data specifically include capacitance values, optical information and pressure values; determining whether the sensing data matches the finger contact point; If so, extract the feature points of the sensing data, identify the touch points based on the feature points, apply a preset clustering algorithm to group and cluster the touch points, and generate touch points on the touch display screen, wherein the feature points specifically include capacitance change characteristics, brightness changes, edge features, pressure peaks, and pressure change rates.

3. The multi-touch point recognition method of a touch display screen according to claim 1, characterized in that: Before the step of connecting the touch points within a preset time period to form a touch track, the method further includes: Based on the original touch data collected by the touch display screen, adjusting the filter parameters corresponding to the preset low-pass filter, applying a moving average filter to perform low-pass filtering on the original touch data, setting the window of the moving average filter to a preset number of touch points, and calculating and generating a smoothed average value, wherein the original touch data specifically includes touch point coordinates and touch timestamps; Determining whether the average value matches a preset moving window; If so, identify the smooth touch point corresponding to the average value, take the touch coordinates of the smooth touch point and the preset points before and after it, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all the smooth touch points on the touch display screen, and generate the touch trajectory.

4. The multi-touch point recognition method for a touch display screen according to claim 1, characterized in that: The step of determining whether the touch display screen can detect the finger contact point of the user also includes: Based on a preset calibration procedure of the touch display screen, presenting a preset pattern on the touch display screen and guiding the user to touch and click the preset pattern, and detecting a finger contact point corresponding to the touch and click; Determining whether the finger contact is aligned with the preset pattern; If so, the touch data is collected periodically according to the preset time nodes, the touch data is stored in a preset ring buffer, the touch data is timestamped in the ring buffer, and the touch track corresponding to the touch data is restored according to the timestamp.

5. The multi-touch point recognition method for a touch display screen according to claim 1, characterized in that: The step of generating pre-recorded identity information from the touch display screen based on the finger data pre-recorded by the user, and granting the user central control authority over the touch display screen according to the identity information, further includes: Generating preset guidance content from the touch display screen based on the identity information; Determining whether the user has completed the guidance content; If not, the personalized interface of the touch display screen is dynamically adjusted according to the identity information of the user, and the user is granted the authority to change the personalized interface.

6. A multi-touch point recognition system for a touch display screen, characterized in that: include: A generation module, used to generate pre-recorded identity information from the touch display screen based on finger data pre-recorded by the user, and grant the user central control authority over the touch display screen according to the identity information, wherein the finger data specifically includes finger fingerprint data, touch area data and touch force data; A determination module, used to determine whether the touch display screen can detect the finger contact point of the user; an execution module, configured to, if possible, collect at least one touch point of the finger contact, connect the touch points within a preset time period to form a touch track, identify the touch function corresponding to the touch track, provide the user with a touch instruction corresponding to the touch function through the touch display screen, generate selectable execution instructions corresponding to the touch track, and obtain at least two of the execution instructions selected by the user; A second judgment module is used to judge whether the execution instruction can be synchronously executed through the touch display screen; a second execution module, for collecting the touch response time of the execution instruction if no, applying a preset multi-threading technology to separate the touch event from the background task of the touch display screen based on the touch response time, buffering the touch event or the background task into a preset buffer, and allocating the queue response event of the touch display screen according to the priority mechanism preset by the user on the touch display screen; The second execution module further includes: A monitoring unit, configured to monitor the load rate of each preset thread based on the thread pool preset by the touch display screen, and dynamically adjust the number of threads in the thread pool according to the load rate; A second judging unit, used to judge whether the number of threads reaches a preset upper limit; a second execution unit, configured to extract, from a preset memory pool, the continuous memory blocks required by the load rate, divide the continuous memory blocks into free memory blocks of a preset size, add the free memory blocks to a pre-established free block linked list, allocate the free memory blocks in the free block linked list to corresponding thread request objects, and output a pointer corresponding to the allocated memory blocks to the thread request object; The second judgment module further includes: A verification unit, used to verify the path information of the execution instruction based on the hierarchical dependency relationship preset by the touch display screen; A fourth determination unit, configured to determine whether a circular dependency is detected in the path information; The fourth execution unit is used to mark the loop nodes from the path information, sort the loop nodes to collect key dependent nodes, and introduce a preset intermediate state to execute part of the instructions of the key dependent nodes in batches.

7. The multi-touch point recognition system for a touch display screen according to claim 6, characterized in that: The execution module includes: A collection unit, configured to collect sensor data of the user on the touch display screen based on a sensor preset in the touch display screen, wherein the sensor specifically includes a capacitive sensor, an optical sensor and a pressure sensor, and the sensor data specifically includes a capacitance value, optical information and a pressure value; a judging unit, configured to judge whether the sensing data matches the finger contact point; An execution unit is used to extract feature points of the sensing data, identify the touch points according to the feature points, group and cluster the touch points using a preset clustering algorithm, and generate touch points on the touch display screen, wherein the feature points specifically include capacitance change characteristics, brightness changes, edge features, pressure peak values, and pressure change rates.

8. The multi-touch point recognition system for a touch display screen according to claim 6, characterized in that: Also includes: a calculation module, configured to adjust the filter parameters corresponding to the preset low-pass filter based on the raw touch data collected by the touch display screen, apply a moving average filter to perform low-pass filtering on the raw touch data, set the window of the moving average filter to a preset number of touch points, and calculate and generate a smoothed average value, wherein the raw touch data specifically includes touch point coordinates and touch timestamps; A third judgment module is used to judge whether the average value matches a preset moving window; The third execution module is used to identify the smooth touch point corresponding to the average value, take the touch coordinates of the smooth touch point and the preset points before and after it, and perform average calculation in sequence, and continue until the calculation of each touch point of the original touch data is completed, output the touch point coordinates corresponding to all the smooth touch points on the touch display screen, and generate the touch trajectory.

Citation Information

Patent Citations

  • SAR ADC with dynamic input scaling and offset adjustment

    US20090244014A1

  • Control method and device

    US20230188638A1