Multi-point gesture resolution response method and device for touch display screen

Abstract

This invention provides a method and apparatus for parsing and responding to multi-touch gestures on a touch display screen. The method includes: generating multiple touch motion trajectories based on the displacement paths of each initial touch point generated on the touch display screen over time; performing trajectory coordination matching based on the relative positional changes between the various touch motion trajectories to obtain a candidate coordination trajectory group, and determining the trajectory persistence based on the temporal duration characteristics of each touch motion trajectory in the candidate coordination trajectory group to obtain a target coordination trajectory group; performing trajectory morphology identification based on the spatial morphological characteristics of each touch motion trajectory in the target coordination trajectory group to obtain a valid gesture trajectory group; and driving the touch display screen to perform an interface display ratio adjustment operation matching the spacing evolution variable of each touch motion trajectory in the valid gesture trajectory group. This invention ensures that scaling commands are only responded to when multi-finger coordination is confirmed, guaranteeing accuracy for users during multi-touch gesture interactions.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a method and apparatus for parsing and responding to multi-point gestures on a touch screen. Background Technology

[0002] In existing touch display interaction technologies, multi-point gesture recognition methods based on contact area thresholds are commonly used. This method detects the physical contact area of ​​all touch points on the screen, identifies touch points with a contact area smaller than a preset threshold as false touches (such as non-intentional touches on the edge of the palm or finger joints), and filters them out; touch points with a contact area larger than the preset threshold are identified as valid operation points, and then execute corresponding scaling, rotation, or translation commands based on the movement trajectory of the valid operation points.

[0003] However, this existing method has a major drawback: when a user performs fine-grained operations (such as pinching to zoom in on image details with two fingers), if one finger's pressure is too light or its physiological characteristics cause the contact area to temporarily decrease below a preset threshold, the touch point of that finger will be incorrectly identified as a mis-touch and ignored by the system. In this case, the original two-finger gesture is truncated into a single-finger gesture, causing the expected zoom operation to unexpectedly become a drag operation, resulting in interaction interruption or execution of incorrect commands, severely impacting the accuracy of complex gesture operations. Summary of the Invention

[0004] This invention provides a multi-point gesture parsing and response method and apparatus for a touch screen, which enables the response to zoom commands only when multi-finger collaboration is confirmed, avoiding the technical problem of gesture semantic abrupt change caused by single-finger signal loss or accidental touch in the prior art, and ensuring the accuracy of users in multi-point gesture operation interaction.

[0005] In a first aspect, the present invention provides a multi-point gesture parsing and response method for a touch display screen, comprising: Based on the displacement paths of each initial touch point in the initial touch point set generated on the touch display screen as time changes, multiple touch motion trajectories are generated. Trajectory coordination matching is performed based on the relative positional change relationship between each touch motion trajectory to obtain a candidate coordination trajectory group. Then, trajectory persistence is determined based on the time duration characteristics of each touch motion trajectory in the candidate coordination trajectory group to obtain a target coordination trajectory group. Based on the spatial morphological characteristics of each touch motion trajectory in the target collaborative trajectory group, trajectory morphology is identified to obtain an effective gesture trajectory group; Based on the spacing evolution of each touch motion trajectory in the effective gesture trajectory group, the touch screen is driven to perform an interface display ratio adjustment operation that matches the spacing evolution.

[0006] In a second aspect, the present invention also provides a multi-point gesture parsing and response device for a touch display screen, applied to the multi-point gesture parsing and response method for a touch display screen as described in the first aspect; the multi-point gesture parsing and response device for a touch display screen includes: The motion trajectory generation module is used to generate multiple touch motion trajectories based on the displacement paths of each initial touch point in the initial touch point set generated on the touch display screen as time changes. The trajectory parsing module is used to perform trajectory cooperative matching based on the relative positional change relationship between each touch motion trajectory to obtain a candidate cooperative trajectory group, and to determine the trajectory persistence based on the time duration characteristics of each touch motion trajectory in the candidate cooperative trajectory group to obtain a target cooperative trajectory group. The trajectory shape recognition module is used to perform trajectory shape recognition based on the spatial shape characteristics of each touch motion trajectory in the target collaborative trajectory group to obtain an effective gesture trajectory group. The gesture response module is used to drive the touch screen to perform an interface display ratio adjustment operation that matches the spacing evolution variable based on the spacing evolution variable of each touch motion trajectory in the effective gesture trajectory group.

[0007] Thirdly, the present invention also provides an electronic device, comprising: a memory for storing computer software programs; and a processor for reading and executing the computer software programs, thereby implementing the multi-point gesture parsing and response method for a touch screen as described above.

[0008] Fourthly, the present invention also provides a non-transitory computer-readable storage medium storing a computer software program, which, when executed by a processor, implements the multi-point gesture parsing and response method for a touch screen as described above.

[0009] Fifthly, the present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the multi-point gesture parsing and response method for a touch display screen as described above.

[0010] The multi-touch gesture parsing and response method for touch displays provided in this invention captures the displacement paths of each initial touch point in the initial touch point set on the touch display over time, generating multiple touch motion trajectories. It comprehensively collects the dynamic change information of all touch points, overcoming the limitation of existing technologies that only focus on the contact area of ​​touch points and ignore the dynamic characteristics of the trajectories. Based on the relative positional changes between each touch motion trajectory, trajectory coordination matching is performed to filter out candidate coordination trajectory groups with coordination motion characteristics (such as reverse displacement or synchronous movement during two-finger zooming). Then, the duration of each touch motion trajectory is combined with the time duration characteristics to determine trajectory persistence, eliminating trajectories that exist only briefly and lack stable operation characteristics (corresponding to single-finger trajectories in existing technologies where the contact area temporarily decreases due to light pressure; these trajectories have short durations and no coordination characteristics). The resulting target coordination trajectory group, through coordination matching and persistence determination, initially identifies trajectory groups with multi-finger coordination operation potential, avoiding misjudging a single trajectory as a valid operation. Based on the spatial morphological characteristics of each touch motion trajectory in the target collaborative trajectory group, trajectory morphology is identified to filter out effective gesture trajectory groups that conform to the gesture operation rules and exclude meaningless and chaotic trajectories (such as irregular trajectories generated by accidental touches on the edge of the palm). This ensures that the retained trajectories are all effective trajectories generated by the user's active operation, reducing the probability of misjudgment. The spacing evolution variables of each touch motion trajectory in the effective gesture trajectory group are detected and analyzed. Only when a spacing evolution variable conforming to the scaling operation characteristics (such as a decrease in the time interval of two-finger pinching and an increase in the time interval of two-finger opening) is detected in the effective gesture trajectory group is the touch screen driven to execute the corresponding interface display ratio adjustment operation, ensuring that the operation command and the user's intention are accurately matched. Therefore, this embodiment of the invention implements a scaling command response only when multi-finger collaboration is confirmed, fundamentally solving the technical problem in the prior art where light pressure from a single finger or a temporary reduction in the contact area due to physiological characteristics leads to misjudgment as a mistouch, resulting in a sudden change in gesture semantics (two-finger scaling becomes single-finger dragging). It achieves precise control over the entire process from touch point acquisition to trajectory filtering and command execution, ensuring the accuracy of user multi-point gesture operation interaction. Attached Figure Description

[0011] Figure 1 This is a flowchart of the multi-point gesture parsing and response method for a touch screen provided in an embodiment of the present invention; Figure 2 This is a structural diagram of the multi-point gesture parsing and response device for a touch screen provided in an embodiment of the present invention; Figure 3 An embodiment diagram of the electronic device provided in this invention; Figure 4 An embodiment diagram of a computer-readable storage medium provided in accordance with the present invention. Detailed Implementation

[0012] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0013] In the description of this invention, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the stated features. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0014] In the description of this invention, the term "for example" is used to mean "used as an example, illustration, or description." Any embodiment described as "for example" in this invention is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use the invention. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that the invention can be made without using these specific details. In other instances, well-known structures and processes will not be described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed herein.

[0015] Optionally, see Figure 1 , Figure 1 This is a flowchart of the multi-point gesture parsing and response method for a touch screen provided by the present invention. In this embodiment of the present invention, the executing entity of the multi-point gesture parsing and response method for a touch screen is a gesture response device. Therefore, the multi-point gesture parsing and response method for a touch screen includes: Step 10: Based on the displacement paths of each initial touch point in the initial touch point set generated on the touch display screen as time changes, generate multiple touch motion trajectories.

[0016] Optionally, the gesture response device collects touch signals on the touch display screen in real time. When one or more touch operations by the user are applied to the surface of the touch display screen, the touch display screen will detect the corresponding touch position, and the gesture response device will record these detected initial touch positions as an initial touch point set.

[0017] The initial touch point set refers to the total number of touch points formed on the touch screen at the initial moment of the user's touch operation. Each initial touch point corresponds to a unique initial touch position, which is determined based on the pixel coordinates of the touch screen. That is, each initial touch point has clear horizontal and vertical pixel coordinates.

[0018] The gesture response device initiates a timer function, continuously collecting the real-time touch positions of each initial touch point according to a preset sampling period, starting from the moment the initial touch point is generated. The preset sampling period refers to the time interval at which the gesture response device collects the touch point positions. This time interval can be set according to the actual application scenario, for example, it can be set to 10 milliseconds, meaning that the gesture response device collects the real-time positions of all currently existing touch points every 10 milliseconds.

[0019] For each initial touch point in the initial touch point set, the gesture response device sorts its real-time touch positions collected at different sampling times in chronological order. Each real-time touch position corresponds to a unique sampling time. The real-time touch positions of the same initial touch point at different sampling times are connected sequentially to form the displacement path of that initial touch point over time. The displacement path refers to the continuous path formed by the position changes of a single touch point from its initial touch position at subsequent sampling times, which can completely reflect the movement process of the touch point.

[0020] The gesture response device processes the displacement path corresponding to each initial touch point independently. Each displacement path corresponds to a touch motion trajectory, ultimately generating multiple touch motion trajectories that match the number of initial touch points in the initial touch point set. Therefore, a touch motion trajectory refers to a continuous trajectory that clearly reflects the movement pattern of the touch point, retaining all positional and temporal information of the displacement path.

[0021] In one embodiment, assuming a user touches the touch screen with two fingers simultaneously, the gesture response device detects two initial touch points, namely initial touch point 1 and initial touch point 2, wherein the initial pixel coordinates of initial touch point 1 are (100, 200) and the initial pixel coordinates of initial touch point 2 are (300, 200), and the preset sampling period is set to 10 milliseconds. Starting from the initial touch moment, the gesture response device collects the real-time positions of the two touch points every 10 milliseconds, and collects them 10 times in a row. The real-time coordinates of the initial touch point 1 at the 10 sampling moments are (100, 200), (110, 205), (120, 210), (130, 215), (140, 220), (150, 225), (160, 230), (170, 235), (180, 240), (190, 245); the real-time coordinates of the initial touch point 2 at the 10 sampling moments are (300, 200), (290, 205), (280, 210), (270, 215), (260, 220), (250, 225), (240, 230), (230, 235), (220, 240), (210, 245). The 10 real-time coordinates of the initial touch point 1 are connected sequentially according to the sampling time to form the displacement path of the initial touch point 1, generating a touch motion trajectory; the 10 real-time coordinates of the initial touch point 2 are connected sequentially according to the sampling time to form the displacement path of the initial touch point 2, generating another touch motion trajectory, and finally two touch motion trajectories are obtained, corresponding to the movement process of the two fingers respectively.

[0022] Step 20: Perform trajectory coordination matching based on the relative positional change relationship between each touch motion trajectory to obtain a candidate coordination trajectory group, and determine the trajectory persistence based on the time duration characteristics of each touch motion trajectory in the candidate coordination trajectory group to obtain the target coordination trajectory group.

[0023] Optionally, the gesture response device extracts the position information of all touch motion trajectories, calculates the position difference between any two touch motion trajectories at the same sampling time, and analyzes the relative positional change relationship between each touch motion trajectory. The relative positional change relationship refers to the changing patterns of parameters such as positional distance and positional direction between multiple touch motion trajectories during their movement.

[0024] The gesture response device performs trajectory coordination matching based on the relative positional change relationship between each touch motion trajectory to obtain multiple candidate coordination trajectory groups, as detailed in steps 201 to 203.

[0025] The gesture response device extracts the temporal duration characteristics of each touch motion trajectory in each candidate cooperative trajectory group, where the temporal duration characteristic refers to the total time length experienced by the touch motion trajectory from the start to the end of its generation. The gesture response device determines the trajectory persistence based on the temporal duration characteristics of each touch motion trajectory in the candidate cooperative trajectory group to obtain the target cooperative trajectory group, as described in steps 204 to 207.

[0026] Step 30: Based on the spatial morphological characteristics of each touch motion trajectory in the target collaborative trajectory group, trajectory morphology is identified to obtain an effective gesture trajectory group.

[0027] Optionally, the gesture response device extracts the spatial morphological characteristics of each touch motion trajectory in the target collaborative trajectory group. These spatial morphological characteristics include trajectory arc length, trajectory envelope area, maximum curvature, starting tangent angle, ending tangent angle, horizontal projection span, vertical projection span, and minimum curvature. Specifically, trajectory arc length refers to the actual curve length of the touch motion trajectory; trajectory envelope area refers to the area enclosed by the touch motion trajectory; maximum curvature refers to the curvature with the largest value among all points on the touch motion trajectory, where curvature indicates the degree of bending of the trajectory curve; starting tangent angle refers to the angle between the tangent at the starting point of the touch motion trajectory and the horizontal direction; ending tangent angle refers to the angle between the tangent at the ending point of the touch motion trajectory and the horizontal direction; horizontal projection span refers to the maximum projection distance of the touch motion trajectory in the horizontal direction; vertical projection span refers to the maximum projection distance of the touch motion trajectory in the vertical direction; and minimum curvature refers to the curvature with the smallest value among all points on the touch motion trajectory.

[0028] The gesture response device performs shape recognition based on the spatial shape characteristics of each touch motion trajectory in the target collaborative trajectory group. For example, touch motion trajectories whose spatial shape characteristics do not meet the preset conditions are eliminated, and touch motion trajectories that meet the preset conditions are retained to obtain a valid gesture trajectory group, as detailed in steps 301 to 304.

[0029] Step 40: Based on the spacing evolution of each touch motion trajectory in the effective gesture trajectory group, drive the touch screen to perform an interface display ratio adjustment operation that matches the spacing evolution.

[0030] Optionally, the gesture response device extracts the position information of all touch motion trajectories in the effective gesture trajectory group. For any two touch motion trajectories in the effective gesture trajectory group, it calculates the spacing value at each sampling moment. The spacing value refers to the straight-line distance between the touch points corresponding to the two touch motion trajectories at the same sampling moment. It is calculated based on the pixel coordinates of the two touch points using the distance calculation method between two points, that is, the distance between two points is equal to the square root of the sum of the squares of the differences in the horizontal and vertical pixel coordinates. The gesture response device uses the spacing value of the same pair of touch motion trajectories at the initial sampling moment as the initial spacing value, and compares the spacing value at each subsequent sampling moment with the initial spacing value to calculate the spacing change at each sampling moment. The spacing changes at all sampling moments together constitute the spacing evolution variable of the pair of touch motion trajectories. The spacing evolution variable refers to the total change of the spacing between the two touch motion trajectories from the initial moment to each subsequent moment. It can reflect whether the spacing between the two touch motion trajectories increases, decreases, or remains unchanged, as well as the magnitude and trend of the change.

[0031] The gesture response device comprehensively analyzes the spacing evolution of all pairs of touch motion trajectories in the effective gesture trajectory group to determine the overall spacing evolution trend and magnitude. Based on the preset correspondence between the spacing evolution and the interface display ratio adjustment operation, it determines the interface display ratio adjustment operation that matches the current spacing evolution. The interface display ratio adjustment operation refers to the operation of changing the scaling ratio of the content displayed on the touch screen, including zooming in and zooming out. When the spacing evolution is zero, the corresponding operation is zooming in; when the spacing evolution is zero, the corresponding operation is zooming out; when the spacing evolution is zero or close to zero, the interface display ratio adjustment operation is not executed.

[0032] The gesture response device sends a control signal to the touch screen, driving the touch screen to perform a determined interface display ratio adjustment operation. During the adjustment process, the interface display ratio is updated in real time according to the changes in the spacing variable until the spacing variable tends to stabilize or the user stops the touch operation, thus completing the adjustment of the interface display ratio.

[0033] In one embodiment, assuming the effective gesture trajectory group includes two touch motion trajectories, trajectory A and trajectory B, the preset initial sampling time is the first sampling time. The coordinates of trajectory A at the first sampling time are (100, 200), and the coordinates of trajectory B at the first sampling time are (300, 200). The calculated initial spacing value is 200 pixels. The preset sampling period is 10 milliseconds, and the coordinates of the second to tenth sampling times are subsequently collected sequentially. At the tenth sampling time, the coordinates of trajectory A are (190, 245), and the coordinates of trajectory B are (210, 245). The calculated spacing value at the tenth sampling time is 20 pixels. The gesture response device calculates the spacing change at each sampling moment. At the second sampling moment, the spacing value is 180 pixels, and the spacing change is -20 pixels; at the third sampling moment, the spacing value is 160 pixels, and the spacing change is -40 pixels; and so on, with the spacing change at the 10th sampling moment being -180 pixels. The spacing changes at all sampling moments constitute the spacing evolution variable, which shows an overall trend of continuously decreasing spacing, with a total change of 180 pixels. According to a preset correspondence, the spacing evolution variable corresponds to a reduction in the interface display ratio when the spacing decreases. The gesture response device sends a reduction control signal to the touch screen, driving the touch screen to gradually reduce the interface display ratio from the initial ratio until the 10th sampling moment, when the interface display ratio is reduced to a size matching the spacing evolution variable, completing the interface display ratio adjustment operation.

[0034] If the spacing variation stabilizes at subsequent sampling times, meaning the spacing no longer changes, the gesture response device stops driving the touch screen to adjust the ratio and maintains the current display ratio.

[0035] This invention implements a zoom command response only when multi-finger collaboration is confirmed, fundamentally solving the problem of misjudging a touch as a false touch due to light pressure from a single finger or a temporary reduction in contact area caused by physiological characteristics, which leads to a sudden change in gesture semantics (two-finger zoom becomes single-finger drag). It achieves precise control from touch point acquisition to trajectory filtering and command execution, ensuring the accuracy of user interaction under multi-point gesture operation.

[0036] Optionally, steps 201 to 203 include: Step 201: For each track pair in the touch motion trajectory, spatial distance is calculated based on the first and second coordinate positions generated at the start time of the first initial touch point and the second initial touch point in the track pair, and the third and fourth coordinate positions generated at the end time, respectively, to obtain the initial spacing value corresponding to the start time and the termination spacing value corresponding to the termination time for each track pair.

[0037] Optionally, the gesture response device extracts all possible trajectory combinations from multiple touch motion trajectories. Each pair of touch motion trajectories forms a trajectory pair, which is used to analyze the relative positional relationship between the two touch motion trajectories. For each trajectory pair, the gesture response device extracts the initial touch points corresponding to the two touch motion trajectories, namely the first initial touch point and the second initial touch point. The first initial touch point corresponds to the first touch motion trajectory in the trajectory pair, and the second initial touch point corresponds to the second touch motion trajectory in the trajectory pair.

[0038] The gesture response device extracts the coordinate position of the first initial touch point generated at the start time, i.e., the first coordinate position; and extracts the coordinate position of the second initial touch point generated at the start time, i.e., the second coordinate position. The start time refers to the moment when the touch motion trajectory begins to be generated, which is the moment when the initial touch point is generated. Both the first and second coordinate positions are based on the pixel coordinates of the touch screen and both include clearly defined horizontal and vertical pixel coordinates.

[0039] The gesture response device extracts the coordinate position of the first initial touch point at the termination time, i.e., the third coordinate position; and extracts the coordinate position of the second initial touch point at the termination time, i.e., the fourth coordinate position. The termination time refers to the moment when the touch motion trajectory stops generating, i.e., the moment when the user's touch operation ends and the touch screen no longer detects the touch point. The third and fourth coordinate positions are also based on the pixel coordinates of the touch screen, including explicit horizontal and vertical pixel coordinates.

[0040] The gesture response device calculates the spatial distance for each trajectory pair. It calculates the initial distance value based on the first and second coordinate positions, and then calculates the final distance value based on the third and fourth coordinate positions. The spatial distance calculation uses the straight-line distance calculation method between two points, which will not be elaborated further here.

[0041] In one embodiment, it is assumed that step 10 generates two touch motion trajectories, forming a trajectory pair, where the first initial touch point corresponds to the first touch motion trajectory, and the second initial touch point corresponds to the second touch motion trajectory. At the initial moment, the first coordinate position of the first initial touch point is (100, 200), the second coordinate position of the second initial touch point is (300, 200), and the gesture response device calculates an initial spacing value of 200 pixels. At the termination moment, the third coordinate position of the first initial touch point is (150, 250), the fourth coordinate position of the second initial touch point is (250, 250), and the calculated termination spacing value is 100 pixels.

[0042] Step 202: Calculate the direction vector based on the coordinate position sequence generated by the first initial touch point from the start time to the end time to obtain the first motion direction vector of the first initial touch point, and calculate the direction vector based on the coordinate position sequence generated by the second initial touch point from the start time to the end time to obtain the second motion direction vector of the second initial touch point.

[0043] Optionally, the gesture response device extracts all coordinate positions generated by the first initial touch point from the start time to the end time, and arranges them in the order of sampling times to form a coordinate position sequence of the first initial touch point. The coordinate position sequence refers to the ordered set of coordinate positions corresponding to all sampling times of the same initial touch point throughout the entire movement process, which can completely reflect the position change process of the initial touch point from start to end. Based on the coordinate position sequence of the first initial touch point, the gesture response device calculates the direction vector to obtain the first motion direction vector of the first initial touch point.

[0044] The direction vector refers to a vector that reflects the direction and trend of the touch point's movement. The calculation process is as follows: taking the first coordinate position at the start time in the coordinate position sequence as the starting point and the third coordinate position at the end time as the ending point, calculate the difference in horizontal and vertical coordinates from the starting point to the ending point. The difference in horizontal coordinates is the difference between the horizontal pixel coordinates of the third coordinate position and the horizontal pixel coordinates of the first coordinate position. The difference in vertical coordinates is the difference between the vertical pixel coordinates of the third coordinate position and the vertical pixel coordinates of the first coordinate position. The difference in horizontal and vertical coordinates together constitute the first motion direction vector, which can clearly reflect the overall motion direction of the first initial touch point from the start time to the end time.

[0045] Using the same method, the gesture response device extracts all coordinate positions generated by the second initial touch point from the start time to the end time, arranges them in the order of sampling time, and forms a coordinate position sequence of the second initial touch point. Then, taking the second coordinate position at the start time in this coordinate position sequence as the starting point and the fourth coordinate position at the end time as the ending point, the horizontal coordinate difference and the vertical coordinate difference between the starting point and the ending point are calculated. The horizontal coordinate difference is the horizontal pixel coordinate of the fourth coordinate position minus the horizontal pixel coordinate of the second coordinate position, and the vertical coordinate difference is the vertical pixel coordinate of the fourth coordinate position minus the vertical pixel coordinate of the second coordinate position. These two differences together constitute the second motion direction vector of the second initial touch point, which clearly reflects the overall motion direction of the second initial touch point from the start time to the end time.

[0046] Continuing with the embodiment based on step 201, the coordinate position sequence of the first initial touch point includes all sampled coordinates from the start time to the end time. The first coordinate position at the start time is (100, 200), and the third coordinate position at the end time is (150, 250). The first motion direction vector is calculated: the horizontal coordinate difference is 150-100=50, and the vertical coordinate difference is 250-200=50. Therefore, the first motion direction vector consists of a horizontal difference of 50 and a vertical difference of 50, reflecting the overall movement of the first initial touch point in a direction that increases horizontally and vertically. In the coordinate position sequence of the second initial touch point, the second coordinate position at the start time is (300, 200), and the fourth coordinate position at the end time is (250, 250). The second motion direction vector is calculated: the horizontal coordinate difference is 250-300=-50, and the vertical coordinate difference is 250-200=50. Therefore, the second motion direction vector consists of a horizontal difference of -50 and a vertical difference of 50, reflecting the overall movement of the second initial touch point in a direction that decreases horizontally and increases vertically.

[0047] Step 203: Based on the first and second coordinate positions of each trajectory pair, as well as the first and second motion direction vectors, determine the candidate cooperative trajectory group.

[0048] Optionally, the gesture response device determines candidate cooperative trajectory groups based on the first and second coordinate positions of each trajectory pair, as well as the first and second motion direction vectors, as described in steps 2031 to 2034.

[0049] This invention enables precise capture of collaborative features of touch motion trajectories, effectively distinguishing trajectory pairs with collaborative operation potential (such as two-finger zooming and synchronous movement) from trajectory pairs without collaborative relationships. It eliminates single trajectory combinations without collaborative features, avoiding invalid processing of trajectories without collaborative value in subsequent screening processes. This provides support for "locking multi-finger collaborative operation trajectories" in the entire gesture response process, ensuring that subsequent target collaborative trajectory groups have the preliminary features of collaborative operation and improving the accuracy of gesture recognition.

[0050] Optionally, the process of steps 2031 to 2034 includes: Step 2031: Perform a difference calculation based on the initial spacing value and the final spacing value to obtain the amount of spacing change generated by each trajectory pair during the time period from the start time to the end time.

[0051] Optionally, the gesture response device performs a difference calculation on each trajectory pair based on the initial and final spacing values, i.e., subtracting the initial spacing value from the final spacing value, to obtain the spacing change of the trajectory pair during the time period from the start to the end. The spacing change reflects the overall magnitude and trend of the spacing between the two touch motion trajectories in the trajectory pair throughout the entire movement process. When the spacing change is positive, it indicates that the spacing of the trajectory pair is increasing; when the spacing change is negative, it indicates that the spacing of the trajectory pair is decreasing; when the spacing change is zero, it indicates that the spacing of the trajectory pair remains unchanged.

[0052] Continuing with the embodiments based on steps 201 and 202, the initial spacing value of a certain trajectory pair is 200 pixels and the final spacing value is 100 pixels. The gesture response device performs a difference calculation, subtracting the initial spacing value of 200 pixels from the final spacing value of 100 pixels, and obtains that the spacing change of the trajectory pair is -100 pixels. This indicates that the spacing of the trajectory pair decreases from the start time to the end time, and decreases by 100 pixels overall.

[0053] Step 2032: Calculate the angle between the first motion direction vector and the second motion direction vector to obtain the angle value between the first motion direction vector and the second motion direction vector.

[0054] Optionally, the gesture response device calculates the angle between the corresponding first motion direction vector and the second motion direction vector for each trajectory to obtain the direction angle value, specifically as shown in the angle calculation formula. The direction angle value ranges from 0 to 180 degrees and is used to reflect the degree of deviation of the motion directions of the two initial touch points.

[0055] Continuing with the aforementioned embodiment, the first motion direction vector is composed of a lateral difference of 50 and a longitudinal difference of 50, and the second motion direction vector is composed of a lateral difference of -50 and a longitudinal difference of 50. The cosine value is 0, and taking the inverse cosine yields a direction angle of 90 degrees, indicating that the motion directions of the two initial touch points are perpendicular to each other.

[0056] Step 2033: Determine whether the trajectory pair meets the spacing coordination condition based on the spacing change and the coordination spacing threshold, and determine whether the trajectory pair meets the direction coordination condition based on the direction angle value and the coordination direction threshold.

[0057] Optionally, the hand coordination distance threshold is a critical value used to determine whether the change in the distance of the trajectory pair conforms to the coordination characteristics, and the coordination direction threshold is a critical value used to determine whether the movement direction of the trajectory pair conforms to the coordination characteristics. Both thresholds can be set according to the actual gesture operation requirements. For example, the coordination distance threshold can be set to ±50 pixels, and the coordination direction threshold can be set to 30 degrees.

[0058] The gesture response device determines whether a trajectory pair meets the spacing coordination condition based on the spacing change and the coordination spacing threshold of each trajectory pair. The specific determination method is as follows: When the absolute value of the change in spacing is greater than or equal to the cooperative spacing threshold, the trajectory pair is determined to meet the spacing cooperation condition; when the absolute value of the change in spacing is less than the cooperative spacing threshold, the trajectory pair is determined to not meet the spacing cooperation condition, that is, the spacing change of the trajectory pair is too small and does not have the spacing characteristics of cooperative motion.

[0059] The gesture response device determines whether the trajectory pair meets the direction coordination condition based on the directional angle value and the coordination direction threshold of each trajectory pair. The specific determination method is as follows: When the directional angle value is less than or equal to the cooperative directional threshold, the trajectory pair is determined to meet the directional cooperation condition, indicating that the movement direction deviation of the two initial touch points is small and has the directional characteristics of cooperative motion. When the directional angle value is greater than the cooperative direction threshold, the trajectory pair is determined to not meet the directional cooperation condition, that is, the movement direction deviation of the two initial touch points is too large and does not have the directional characteristics of cooperative movement.

[0060] In one embodiment, the preset coordination spacing threshold is ±50 pixels, and the coordination direction threshold is 30 degrees. Continuing with the previous embodiment, if the spacing change of a trajectory pair is -100 pixels, and its absolute value of 100 pixels is greater than the coordination spacing threshold of 50 pixels, then the trajectory pair is determined to meet the spacing coordination condition; if the directional angle of the trajectory pair is 90 degrees, which is greater than the coordination direction threshold of 30 degrees, then the trajectory pair is determined not to meet the direction coordination condition. If the spacing change of another trajectory pair is 60 pixels, and its absolute value is greater than 50 pixels, then the spacing coordination condition is met; if the directional angle is 20 degrees, which is less than 30 degrees, then the direction coordination condition is met.

[0061] Step 2034: Combine the trajectory pairs that satisfy both the spacing coordination condition and the direction coordination condition to obtain the candidate coordinated trajectory group.

[0062] Optionally, the gesture response device combines trajectory pairs that satisfy both the spacing and direction coordination conditions to obtain a candidate coordinated trajectory group. Continuing with the embodiment based on step 2033, assuming there are 3 trajectory pairs, trajectory pair 1 satisfies the spacing coordination condition but not the direction coordination condition, trajectory pair 2 satisfies both coordination conditions, and trajectory pair 3 satisfies both coordination conditions, the gesture response device selects trajectory pair 2 and trajectory pair 3, and combines these two trajectory pairs to form a candidate coordinated trajectory group.

[0063] The embodiments of the present invention effectively eliminate trajectory pairs with no cooperative value due to insignificant spacing changes and excessive deviations in movement direction, ensuring that each trajectory in the candidate cooperative trajectory group has clear cooperative motion characteristics, and ensuring that the target cooperative trajectory group selected subsequently is more in line with the user's multi-finger cooperative operation intention.

[0064] Optionally, steps 204 to 207 include: Step 204: Based on the comparison of the start time of each touch motion trajectory in the candidate collaborative trajectory group, the maximum value is selected as the latest start time in the group, and based on the comparison of the end time of each touch motion trajectory in the candidate collaborative trajectory group, the minimum value is selected as the earliest end time in the group.

[0065] Optionally, each candidate collaborative trajectory group contains at least one trajectory pair, and each trajectory pair contains two touch motion trajectories. Each touch motion trajectory has a clearly defined start time and end time. The start time refers to the moment when the touch motion trajectory begins to be generated, that is, the moment when the initial touch point is generated; the end time refers to the moment when the touch motion trajectory stops being generated, that is, the moment when the user's touch operation ends and the touch display no longer detects the touch point. Both the start time and the end time are recorded in the form of timestamps.

[0066] The gesture response device extracts and compares the start times of all touch motion trajectories within a single candidate collaborative trajectory group, selecting the maximum value among all start times as the latest start time within that group. The latest start time within a group refers to the latest start time among all touch motion trajectories in that group, reflecting the start time of the last touch point to begin moving within that group. Simultaneously, the gesture response device extracts and compares the end times of all touch motion trajectories within the candidate collaborative trajectory group, selecting the minimum value among all end times as the earliest end time within that group. The earliest end time within a group refers to the earliest end time among all touch motion trajectories in that group, reflecting the stop time of the first touch point to finish moving within that group.

[0067] In one embodiment, assume a candidate collaborative trajectory group contains three touch motion trajectories: trajectory 1 starts at 100 milliseconds and ends at 800 milliseconds; trajectory 2 starts at 200 milliseconds and ends at 700 milliseconds; and trajectory 3 starts at 150 milliseconds and ends at 900 milliseconds. The gesture response device compares the start times of the three trajectories (100 milliseconds, 200 milliseconds, and 150 milliseconds) and selects the maximum value of 200 milliseconds as the latest start time within the group; it also compares the end times of the three trajectories (800 milliseconds, 700 milliseconds, and 900 milliseconds) and selects the minimum value of 700 milliseconds as the earliest end time within the group.

[0068] Step 205: Calculate the time difference based on the earliest termination time and the latest start time within the group to obtain the theoretical common overlap duration corresponding to the candidate cooperative trajectory group.

[0069] Optionally, the gesture response device calculates the time difference between the earliest termination time and the latest start time within each candidate cooperative trajectory group to obtain the theoretical common overlap duration for the candidate cooperative trajectory group. The theoretical common overlap duration refers to the theoretical length of time during which all touch motion trajectories within the candidate cooperative trajectory group are in motion together. It is calculated by subtracting the latest start time within the group from the earliest termination time, and the result is the theoretical common overlap duration. If the calculated time difference is positive, it means that all touch motion trajectories in the candidate collaborative trajectory group have a common motion time period; if the time difference is zero or negative, it means that all touch motion trajectories in the candidate collaborative trajectory group do not have a common motion time period, that is, the motion processes of each trajectory do not overlap. Continuing with the embodiment based on step 204, the latest start time within a candidate collaborative trajectory group is 200 milliseconds, and the earliest end time within the group is 700 milliseconds. The gesture response device calculates the time difference, subtracting the latest start time of 200 milliseconds from the earliest end time of 700 milliseconds within the group, to obtain the theoretical common overlap time of the candidate collaborative trajectory group as 500 milliseconds. This indicates that all touch motion trajectories within the group are in motion together during the time period from 200 milliseconds to 700 milliseconds.

[0070] Step 206: When the theoretical co-overlap duration is greater than zero, compare the theoretical co-overlap duration with the effective overlap determination threshold. When the theoretical co-overlap duration is greater than or equal to the effective overlap determination threshold, determine the candidate cooperative trajectory group as the trajectory group to be verified.

[0071] Optionally, the gesture response device judges the theoretical common overlap time of each candidate collaborative trajectory group. When the theoretical common overlap time is greater than zero, it indicates that all touch motion trajectories in the candidate collaborative trajectory group have a common motion time period and are worth further verification. When the theoretical common overlap time is less than or equal to zero, it indicates that all touch motion trajectories in the candidate collaborative trajectory group do not have a common motion time period and do not have a time basis for collaborative motion, so the candidate collaborative trajectory group is directly eliminated.

[0072] The effective overlap threshold is a critical value used to determine whether the common overlap duration of candidate cooperative trajectory groups meets the requirements of cooperative motion. It can be set according to the minimum effective duration of the actual gesture operation, for example, set to 200 milliseconds, to distinguish between invalid trajectory groups with short-term overlap and valid trajectory groups with stable overlap.

[0073] For candidate cooperative trajectory groups with a theoretical common overlap duration greater than zero, the gesture response device compares the theoretical common overlap duration with the effective overlap determination threshold. When the theoretical common overlap duration is greater than or equal to the effective overlap determination threshold, it indicates that the common overlap duration of the candidate cooperative trajectory group meets the time requirements of cooperative motion and has the characteristics of stable cooperative operation. The candidate cooperative trajectory group is then identified as a trajectory group to be verified. When the theoretical common overlap duration is less than the effective overlap determination threshold, it indicates that the common overlap duration of the candidate cooperative trajectory group is short and does not have the characteristics of stable cooperative operation. The candidate cooperative trajectory group is then directly eliminated.

[0074] Continuing with the embodiment based on step 205, the preset effective overlap determination threshold is 200 milliseconds. The theoretical common overlap duration of a certain candidate cooperative trajectory group is 500 milliseconds, which is greater than the effective overlap determination threshold of 200 milliseconds, and the theoretical common overlap duration is greater than zero. Therefore, this candidate cooperative trajectory group is determined as a trajectory group to be verified. If the theoretical common overlap duration of another candidate cooperative trajectory group is 150 milliseconds, although it is greater than zero, it is less than the effective overlap determination threshold of 200 milliseconds. Therefore, it is not determined as a trajectory group to be verified and is directly eliminated.

[0075] Step 207: Determine the trajectory survival based on the trajectory group to be verified to obtain the target cooperative trajectory group.

[0076] Optionally, for each trajectory group to be verified, the gesture response device determines the trajectory continuation based on the trajectory group to be verified to obtain the target cooperative trajectory group, as in steps 2071 to 2074.

[0077] This invention enables precise screening of candidate collaborative trajectory groups in terms of time dimension, focusing on eliminating trajectory groups with no common motion time, short common overlap duration, and unstable existence. This ensures that the target collaborative trajectory group has stable collaborative motion time characteristics, effectively avoiding misjudging collaborative trajectory groups generated by brief accidental touches as valid operation trajectory groups, improving the accuracy of collaborative trajectory recognition, and ensuring that only trajectory groups with stable collaborative time characteristics can enter the subsequent process, thus guaranteeing the accuracy of gesture response.

[0078] Optionally, the process of steps 2071 to 2074 includes: Step 2071: Based on the start and end times of the first touch motion trajectory in the trajectory group to be verified, as well as the latest start time and the earliest end time in the group, the time interval intersection calculation is performed to obtain the actual participation overlap time of the first touch motion trajectory within the theoretical common overlap time.

[0079] Optionally, each trajectory group to be verified contains at least one touch motion trajectory, and the start and end times of the first touch motion trajectory in the trajectory group to be verified are extracted. The first touch motion trajectory refers to the first touch motion trajectory selected in the trajectory group to be verified according to a preset order (such as the order in which the trajectories are generated), and the actual overlap duration refers to the length of time that the touch motion trajectory is actually in motion within the time interval corresponding to the theoretical common overlap duration. The gesture response device calculates the intersection of the time interval of the first touch motion trajectory and the time interval corresponding to the theoretical common overlap duration to obtain the actual participation overlap duration. The specific calculation process is as follows: determine the time interval corresponding to the theoretical common overlap duration, with the starting endpoint of the interval being the latest start time in the group and the ending endpoint being the earliest end time in the group; then determine the time interval of the first touch motion trajectory, with the starting endpoint of this interval being the start time of the first touch motion trajectory and the ending endpoint being the end time of the first touch motion trajectory; the intersection of the two time intervals is the actual participation overlap time interval of the first touch motion trajectory, and the time difference obtained by subtracting the starting endpoint from the ending endpoint of this intersection interval is the actual participation overlap duration of the first touch motion trajectory.

[0080] In one embodiment, assuming the latest start time within a certain trajectory group to be verified is 200 milliseconds and the earliest end time is 700 milliseconds, the theoretical overlap time corresponds to a time interval of 200 milliseconds to 700 milliseconds; the first touch motion trajectory in this trajectory group has a start time of 150 milliseconds and an end time of 800 milliseconds, with a time interval of 150 milliseconds to 800 milliseconds. The intersection of the two time intervals is 200 milliseconds to 700 milliseconds. The gesture response device calculates the time difference between the intersection intervals, subtracts 200 milliseconds from 700 milliseconds, and obtains the actual overlap time of the first touch motion trajectory as 500 milliseconds.

[0081] Step 2072: Calculate the ratio between the actual participation overlap time and the theoretical co-overlap time of the first touch motion trajectory to obtain the first single-track overlap contribution rate corresponding to the first touch motion trajectory. When the first single-track overlap contribution rate is greater than or equal to the preset contribution rate threshold, add the first touch motion trajectory to the initial collaborative trajectory group.

[0082] Optionally, the gesture response device calculates the first single-track overlap contribution rate corresponding to the first touch motion trajectory by comparing the actual overlap duration of the first touch motion trajectory with the theoretical common overlap duration of the trajectory group to be verified. The single-track overlap contribution rate refers to the proportion of the actual overlap duration of a single touch motion trajectory to the theoretical common overlap duration, which reflects the degree of participation of a single trajectory within the common overlap time period. It is calculated by dividing the actual overlap duration by the theoretical common overlap duration, and the result is the single-track overlap contribution rate, with a value range of 0 to 1.

[0083] The preset contribution rate threshold is a critical value used to determine whether a single touch motion trajectory effectively participates in the coordinated motion. It can be set according to the actual needs of the coordinated operation. For example, it can be set to 0.8, which means that the actual participation overlap time of a single trajectory must reach 80% or more of the theoretical common overlap time in order to be considered as effectively participating in the coordinated motion.

[0084] The gesture response device compares the first single-track overlap contribution rate with a preset contribution rate threshold. When the first single-track overlap contribution rate is greater than or equal to the preset contribution rate threshold, it indicates that the first touch motion trajectory effectively participates in the cooperative motion within the theoretically overlapping time period and has stable persistence characteristics. An initial cooperative trajectory group is created, and the first touch motion trajectory is added to the initial cooperative trajectory group. When the first single-track overlap contribution rate is less than the preset contribution rate threshold, it indicates that the first touch motion trajectory has insufficient participation within the theoretically overlapping time period and does not have stable persistence characteristics. It is not added to the initial cooperative trajectory group.

[0085] Continuing with the embodiment based on step 2071, the actual overlap duration of the first touch motion trajectory is 500 milliseconds, and the theoretical common overlap duration of the trajectory group to be verified is 500 milliseconds. The gesture response device performs a ratio calculation, dividing 500 milliseconds by 500 milliseconds to obtain the first single-track overlap contribution rate of 1. The preset contribution rate threshold is set to 0.8. Since 1 is greater than 0.8, the first touch motion trajectory is added to the initial collaborative trajectory group. At this time, the initial collaborative trajectory group only contains this touch motion trajectory.

[0086] Step 2073: Based on the start and end times of the remaining touch motion trajectories in the trajectory group to be verified, as well as the latest start time and the earliest end time in the group, perform time interval intersection calculation on the remaining touch motion trajectories one by one to obtain the remaining actual participation overlap time sequence corresponding to each of the remaining touch motion trajectories.

[0087] Optionally, the gesture response device extracts all touch motion trajectories from the trajectory group to be verified, excluding the first touch motion trajectory, i.e., the remaining touch motion trajectories. The number of remaining touch motion trajectories is determined according to the composition of the trajectory group to be verified, and may be one or more. For the remaining touch motion trajectories, the gesture response device uses the same method as in step 2071 to perform time interval intersection calculation operation on each remaining touch motion trajectory. Specifically, for each remaining touch motion trajectory, its own start time and end time are extracted. Combined with the latest start time and the earliest end time within the trajectory group to be verified, the time interval of the remaining touch motion trajectory and the time interval corresponding to the theoretical common overlap time are determined. The intersection of the two intervals is calculated, and the start endpoint is subtracted from the end endpoint of the intersection interval to obtain the actual overlap time of the remaining touch motion trajectory, i.e., the remaining actual overlap time.

[0088] The gesture response device arranges the remaining actual participation overlap durations corresponding to all remaining touch motion trajectories in a preset order (consistent with the selection order of the first touch motion trajectory), forming an ordered set that is the sequence of remaining actual participation overlap durations. Each value in this sequence corresponds to the remaining actual participation overlap duration of a remaining touch motion trajectory.

[0089] Continuing with the aforementioned embodiment, in addition to the first touch motion trajectory, the trajectory group to be verified has two remaining touch motion trajectories, namely Remaining Trajectory 1 and Remaining Trajectory 2. The latest start time within the trajectory group to be verified is 200 milliseconds, and the earliest end time within the group is 700 milliseconds. The theoretical common overlap time corresponds to a time interval of 200 milliseconds to 700 milliseconds. The start time of Remaining Trajectory 1 is 250 milliseconds, and the end time is 650 milliseconds. The intersection of its time interval and the theoretical common overlap interval is 250 milliseconds to 650 milliseconds, resulting in a calculated remaining actual overlap time of 400 milliseconds. The start time of Remaining Trajectory 2 is 180 milliseconds, and the end time is 600 milliseconds. The intersection of its time interval and the theoretical common overlap interval is 200 milliseconds to 600 milliseconds, resulting in a calculated remaining actual overlap time of 400 milliseconds. Arranging Remaining Trajectory 1 and Remaining Trajectory 2 in that order, the resulting sequence of remaining actual overlap times is 400, 400 milliseconds.

[0090] Step 2074: Calculate the sequential ratio of each remaining actual participation overlap duration and theoretical common overlap duration in the remaining actual participation overlap duration sequence to obtain the second single-track overlap contribution rate sequence corresponding to each remaining touch motion trajectory. For each second single-track overlap contribution rate in the second single-track overlap contribution rate sequence that is greater than or equal to a preset contribution rate threshold, append its corresponding touch motion trajectory to the end of the initial collaborative trajectory group in sequence. For each second single-track overlap contribution rate in the second single-track overlap contribution rate sequence that is less than a preset contribution rate threshold, delete its corresponding touch motion trajectory to obtain the target collaborative trajectory group.

[0091] Optionally, the gesture response device calculates the ratio of each remaining actual overlap duration in the remaining actual overlap duration sequence to the theoretical common overlap duration to obtain the single-track overlap contribution rate corresponding to each remaining touch motion trajectory. These contribution rates are then arranged in the order of the remaining actual overlap duration sequence to form the second single-track overlap contribution rate sequence.

[0092] The gesture response device compares each second single-track overlap contribution rate in the second single-track overlap contribution rate sequence with a preset contribution rate threshold. For each second single-track overlap contribution rate greater than or equal to the preset contribution rate threshold, it indicates that the corresponding remaining touch motion trajectory effectively participates in the cooperative motion within the theoretical common overlap time period and has stable persistence characteristics. This remaining touch motion trajectory is then added sequentially to the end of the initial cooperative trajectory group. For each second single-track overlap contribution rate less than the preset contribution rate threshold, it indicates that the corresponding remaining touch motion trajectory has insufficient participation within the theoretical common overlap time period and does not have stable persistence characteristics. This remaining touch motion trajectory is then directly deleted and not added to the initial cooperative trajectory group. The set of all touch motion trajectories retained in the initial cooperative trajectory group is the target cooperative trajectory group.

[0093] Continuing with the embodiment based on step 2073, the theoretical common overlap duration of the trajectory group to be verified is 500 milliseconds, and the remaining actual overlap duration sequences are 400 milliseconds and 400 milliseconds respectively. The ratios are calculated one by one: 400 milliseconds divided by 500 milliseconds equals 0.8, and 400 milliseconds divided by 500 milliseconds also equals 0.8. Therefore, the second single-track overlap contribution rate sequence is 0.8 and 0.8. The preset contribution rate threshold is 0.8. Since both contribution rates are equal to the preset threshold, the remaining trajectory 1 and remaining trajectory 2 are appended sequentially to the end of the initial collaborative trajectory group. At this point, the initial collaborative trajectory group contains the first touch motion trajectory, remaining trajectory 1, and remaining trajectory 2. This set is the target collaborative trajectory group. If the second single-track overlap contribution rate of a certain remaining touch motion trajectory is 0.7, which is less than the preset threshold of 0.8, then this trajectory is directly deleted and not appended to the initial collaborative trajectory group.

[0094] The embodiments of the present invention achieve precise screening of each touch motion trajectory within the trajectory group to be verified, ensuring that each trajectory within the target collaborative trajectory group can effectively participate in collaborative motion and possess stable persistence characteristics, thereby improving the accuracy of collaborative trajectory recognition and ensuring that only trajectory groups that stably participate in collaborative motion can enter the subsequent process, thus guaranteeing the accuracy and reliability of gesture response.

[0095] Optionally, the processes of steps 301 to 304 include: Step 301: Compare the trajectory arc length of the first touch motion trajectory in the target collaborative trajectory group with the lower limit of the trajectory arc length threshold. When the trajectory arc length is greater than or equal to the lower limit of the trajectory arc length threshold, add the first touch motion trajectory to the retention trajectory group to obtain the first retention trajectory group.

[0096] Optionally, each target collaborative trajectory group contains at least one touch motion trajectory, and the trajectory arc length in the spatial morphological characteristics of each touch motion trajectory in the target collaborative trajectory group is extracted. The trajectory arc length refers to the actual curve length of the touch motion trajectory, which is calculated as follows: the touch motion trajectory is divided into several tiny line segments according to the sampling time sequence, the length of each tiny line segment is calculated, and the lengths of all tiny line segments are added together. The sum is the trajectory arc length of the touch motion trajectory, and the unit is pixels.

[0097] The lower limit of the trajectory arc length threshold is a critical value used to determine whether the touch motion trajectory has a basic effective shape. It is set according to the minimum trajectory length requirement of the actual gesture operation, for example, it is set to 50 pixels. It is used to eliminate touch motion trajectories that are too short and have no practical operation meaning (such as short trajectories generated by slight fingertip tremors).

[0098] The gesture response device extracts the first touch motion trajectory from the target collaborative trajectory group. The first touch motion trajectory refers to the first touch motion trajectory selected in a preset order (such as the order in which the trajectories are generated) within the target collaborative trajectory group. The trajectory arc length of this trajectory is extracted and compared with a lower limit of the trajectory arc length threshold. When the trajectory arc length of the touch motion trajectory is greater than or equal to the lower limit of the trajectory arc length threshold, it indicates that the trajectory has a basic valid form and is worth further screening. A retention trajectory group is created, and the first touch motion trajectory is added to the retention trajectory group. The retention trajectory group formed at this time is the first retention trajectory group. When the trajectory arc length of the touch motion trajectory is less than the lower limit of the trajectory arc length threshold, it indicates that the trajectory is too short and is not added to the retention trajectory group for the time being. At this time, the first retention trajectory group is empty.

[0099] In one embodiment, suppose a target collaborative trajectory group contains 3 touch motion trajectories, and the lower limit of the trajectory arc length threshold is set to 50 pixels. The trajectory arc length of the first touch motion trajectory in this target collaborative trajectory group is 80 pixels. Since 80 pixels is greater than the lower limit of the trajectory arc length threshold of 50 pixels, the gesture response device creates a retention trajectory group and adds the first touch motion trajectory to it, resulting in a first retention trajectory group. At this time, the first retention trajectory group only contains this touch motion trajectory. If the trajectory arc length of the first touch motion trajectory is 40 pixels, which is less than the lower limit of the threshold of 50 pixels, then it is not added to the retention trajectory group, and the first retention trajectory group is empty.

[0100] Step 302: Based on the comparison between the trajectory arc length of each touch motion trajectory in the first retained trajectory group and the upper limit of the trajectory arc length threshold, the touch motion trajectory corresponding to the trajectory arc length greater than the upper limit of the trajectory arc length threshold is removed from the first retained trajectory group to obtain the second retained trajectory group.

[0101] Optionally, if the first retained trajectory group is empty, it is directly determined that there is no trajectory that meets the conditions. If the first retained trajectory group contains at least one touch motion trajectory, the trajectory arc length of each touch motion trajectory in the first retained trajectory group is extracted.

[0102] The upper limit of the trajectory arc length threshold is a critical value used to determine whether the touch motion trajectory exceeds the effective shape range. It is set according to the maximum reasonable trajectory length of the actual gesture operation, for example, it is set to 500 pixels. It is used to eliminate touch motion trajectories that are too long and exceed the normal gesture operation range (such as invalid long trajectories generated by large-scale palm swipes).

[0103] The gesture response device compares each touch motion trajectory in the first retained trajectory group one by one, comparing the arc length of each trajectory with the upper limit of the arc length threshold. For touch motion trajectories whose arc length is greater than the upper limit of the arc length threshold, it is considered that the trajectory is too long, exceeds the normal gesture operation range, and does not possess the morphological characteristics of a valid gesture trajectory, and is therefore removed from the first retained trajectory group. For touch motion trajectories whose arc length is less than or equal to the upper limit of the arc length threshold, it is considered that the length of the trajectory is within the normal gesture operation range, and is retained in the retained trajectory group. After the above removal operation, the set of remaining touch motion trajectories constitutes the second retained trajectory group.

[0104] Continuing with the embodiment based on step 301, the first retained trajectory group includes the first touch motion trajectory (trajectory arc length 80 pixels), and two additional trajectories are subsequently added (trajectory 2 arc length 550 pixels, trajectory 3 arc length 300 pixels), with the upper limit of the trajectory arc length threshold set to 500 pixels. The gesture response device compares the arc lengths of the three trajectories one by one: trajectory 1's 80 pixels is less than 500 pixels and is retained; trajectory 2's 550 pixels is greater than 500 pixels and is removed from the first retained trajectory group; trajectory 3's 300 pixels is less than 500 pixels and is retained. After removing trajectory 2, the set consisting of the remaining trajectory 1 and trajectory 3 in the first retained trajectory group is the second retained trajectory group.

[0105] Step 303: Based on the comparison between the trajectory envelope area and the lower limit of the trajectory envelope area threshold for each touch motion trajectory in the second retained trajectory group, the touch motion trajectory corresponding to the trajectory envelope area smaller than the lower limit of the trajectory envelope area threshold is removed from the second retained trajectory group to obtain the third retained trajectory group.

[0106] Optionally, if the second retained trajectory group is empty, it is directly determined that there is no trajectory that meets the conditions, and subsequent steps will not be executed; if the second retained trajectory group contains at least one touch motion trajectory, the trajectory envelope area in the spatial morphological characteristics of each touch motion trajectory in the second retained trajectory group is extracted. The trajectory envelope area refers to the area of ​​the region enclosed by the touch motion trajectory. It is calculated as follows: the coordinates of all sampling points of the touch motion trajectory are fitted to form a closed polygonal region, and the area of ​​the closed polygonal region is calculated, which is the trajectory envelope area of ​​the touch motion trajectory, in pixels squared.

[0107] The lower limit of the trajectory envelope area threshold is a critical value used to determine whether a touch motion trajectory possesses a valid operational form. It is set based on the minimum envelope area requirement of actual gesture operations, for example, 1000 pixels squared, to eliminate touch motion trajectories with excessively small envelope areas or no clear operational intent (such as narrow trajectories generated by slight fingertip swipes). The gesture response device compares each touch motion trajectory in the second retained trajectory group one by one, comparing the trajectory envelope area of ​​each trajectory with the lower limit of the trajectory envelope area threshold. For touch motion trajectories with a trajectory envelope area smaller than the lower limit of the trajectory envelope area threshold, it indicates that the trajectory's envelope area is too small, lacks a clear operational intent, and does not possess the morphological characteristics of a valid gesture trajectory; therefore, it is removed from the second retained trajectory group. For touch motion trajectories with a trajectory envelope area greater than or equal to the lower limit of the trajectory envelope area threshold, it indicates that the trajectory possesses a clear operational form and is retained in the retained trajectory group. After the above removal operation, the set of remaining touch motion trajectories constitutes the third retained trajectory group.

[0108] Continuing with the embodiment based on step 302, the second retained trajectory group includes trajectory 1 (trajectory arc length 80 pixels, trajectory envelope area 1200 pixels square) and trajectory 3 (trajectory arc length 300 pixels, trajectory envelope area 800 pixels square), with the lower limit of the trajectory envelope area threshold set to 1000 pixels square. The envelope areas of the two trajectories are compared one by one: trajectory 1's 1200 pixels square is greater than 1000 pixels square, so it is retained; trajectory 3's 800 pixels square is less than 1000 pixels square, so it is removed from the second retained trajectory group. After removing trajectory 3, only trajectory 1 remains in the second retained trajectory group, and the set formed is the third retained trajectory group.

[0109] Step 304: Based on the maximum curvature of each touch motion trajectory in the three-retention trajectory group, trajectory shape identification is performed to obtain the effective gesture trajectory group.

[0110] Optionally, if the third retained trajectory group is empty, it is determined that there is no valid gesture trajectory group. If the third retained trajectory group is not empty, the trajectory shape is identified based on the maximum curvature of each touch motion trajectory in the three retained trajectory groups to obtain a valid gesture trajectory group, as described in steps 3041 to 3044.

[0111] This invention eliminates meaningless and chaotic trajectories and trajectories that do not conform to the rules of gesture operation, ensuring that each trajectory in the effective gesture trajectory group is a valid trajectory generated by the user's active operation. This improves the accuracy of gesture recognition and avoids including invalid trajectories generated by fingertip tremors, palm mis-touches, etc., in the subsequent operation instruction execution process, thus ensuring the accuracy and reliability of the user's multi-point gesture operation interaction.

[0112] Optionally, the processes of steps 3041 to 3044 include: Step 3041: Based on the comparison of the maximum curvature and curvature smoothness tolerance of each touch motion trajectory in the third retained trajectory group, the touch motion trajectory corresponding to the maximum curvature that is greater than the curvature smoothness tolerance is removed from the third retained trajectory group to obtain the fourth retained trajectory group.

[0113] Optionally, the curvature smoothness tolerance is a critical value used to determine whether a touch motion trajectory has a smooth shape. It is set according to the smoothness requirements of actual effective gestures, for example, set to the reciprocal of 0.02 pixels, to eliminate touch motion trajectories with excessive curvature and chaotic trajectory shapes (such as irregular curved trajectories generated by disordered fingertip shaking). The gesture response device compares each touch motion trajectory in the third retained trajectory group one by one, comparing the maximum curvature of each trajectory with the curvature smoothness tolerance. For touch motion trajectories with a maximum curvature greater than the curvature smoothness tolerance, it indicates that the curvature of the trajectory exceeds the smoothness range, the shape is chaotic, and it does not have the smooth characteristics of an effective gesture trajectory, so it is removed from the third retained trajectory group; for touch motion trajectories with a maximum curvature less than or equal to the curvature smoothness tolerance, it indicates that the trajectory shape is smooth and meets the basic smoothness requirements of an effective gesture trajectory, so it is retained in the retained trajectory group. After the above removal operation, the set of remaining touch motion trajectories is the fourth retained trajectory group.

[0114] In one embodiment, assume that the third retained trajectory group contains three touch motion trajectories, and the curvature smoothness tolerance is set to the reciprocal of 0.02 pixels. Trajectory 1 has a maximum curvature of 0.01 pixels, which is less than the reciprocal of 0.02 pixels, and is retained. Trajectory 2 has a maximum curvature of 0.03 pixels, which is greater than the reciprocal of 0.02 pixels, and is removed from the third retained trajectory group. Trajectory 3 has a maximum curvature of 0.02 pixels, which is equal to the curvature smoothness tolerance, and is retained. After removing trajectory 2, the set consisting of the remaining trajectories 1 and 3 in the third retained trajectory group constitutes the fourth retained trajectory group.

[0115] Step 3042: Calculate the angle difference based on the starting tangent angle and ending tangent angle of each touch motion trajectory in the fourth retained trajectory group to obtain the trajectory direction change amount corresponding to each touch motion trajectory. Then, compare the trajectory direction change amount corresponding to each touch motion trajectory with the direction continuity span threshold. Remove the touch motion trajectory corresponding to the trajectory direction change amount that is greater than the direction continuity span threshold from the fourth retained trajectory group to obtain the fifth retained trajectory group.

[0116] Optionally, if the fourth retained trajectory group is empty, it is directly determined that there is no trajectory that meets the conditions; if the fourth retained trajectory group contains at least one touch motion trajectory, the starting tangent angle and the ending tangent angle of the spatial morphological characteristics of each touch motion trajectory in the fourth retained trajectory group are extracted. The starting tangent angle refers to the angle between the tangent at the starting point of the touch motion trajectory and the horizontal direction, and the ending tangent angle refers to the angle between the tangent at the ending point of the touch motion trajectory and the horizontal direction. The values ​​of both angles are in the range of 0 degrees to 360 degrees.

[0117] The gesture response device calculates the angle difference between the starting and ending tangent angles of each touch motion trajectory to obtain the trajectory direction change for each trajectory. The trajectory direction change refers to the magnitude of the directional change of the touch motion trajectory from the starting point to the ending point. It is calculated by subtracting the starting tangent angle from the ending tangent angle. If the calculation result is negative, the absolute value of the negative value is taken as the trajectory direction change, ensuring that the trajectory direction change is always non-negative. The value range is from 0 degrees to 180 degrees.

[0118] The directional continuity span threshold is a critical value used to determine whether the change in the direction of a touch motion trajectory conforms to the rules of a valid gesture. It is set according to the actual range of directional changes in a valid gesture, for example, 45 degrees, to eliminate touch motion trajectories with excessive directional changes or no clear direction of movement (such as directional abrupt changes caused by random turns). The gesture response device compares each touch motion trajectory in the fourth retained trajectory group one by one, comparing the amount of change in the trajectory direction of each trajectory with the directional continuity span threshold.

[0119] For touch motion trajectories where the change in trajectory direction exceeds the threshold of directional continuity, it indicates that the directional change of the trajectory is too large, there is no clear direction of movement, and it does not have the directional continuity characteristics of an effective gesture trajectory. Therefore, it is removed from the fourth group of retained trajectories.

[0120] For touch motion trajectories whose direction change is less than or equal to the direction continuity span threshold, it indicates that the direction change of the trajectory is gradual and has a clear direction of motion, and it is retained in the retained trajectory group. After the above removal operation, the set of remaining touch motion trajectories is the fifth retained trajectory group.

[0121] Continuing with the embodiment based on step 3041, the fourth retained trajectory group includes trajectory 1 and trajectory 3, with the directional continuity span threshold set to 45 degrees. Trajectory 1 has a starting tangent angle of 30 degrees and an ending tangent angle of 60 degrees. The angle difference is calculated as 60 degrees minus 30 degrees, resulting in a trajectory direction change of 30 degrees, which is less than 45 degrees, and is therefore retained. Trajectory 3 has a starting tangent angle of 20 degrees and an ending tangent angle of 70 degrees. The angle difference is calculated as 70 degrees minus 20 degrees, resulting in a trajectory direction change of 50 degrees, which is greater than 45 degrees, and is therefore removed from the fourth retained trajectory group. After removing trajectory 3, only trajectory 1 remains in the fourth retained trajectory group, forming the fifth retained trajectory group.

[0122] Step 3043: Calculate the ratio of the horizontal and vertical projection spans of each touch motion trajectory in the fifth retained trajectory group to obtain the trajectory projection aspect ratio corresponding to each touch motion trajectory. Then, perform an interval inclusion comparison based on the trajectory projection aspect ratio and the projection aspect ratio threshold range corresponding to each touch motion trajectory. Remove the touch motion trajectories with projection aspect ratios that are not within the projection aspect ratio threshold range from the fifth retained trajectory group to obtain the sixth retained trajectory group.

[0123] Optionally, if the fifth retained trajectory group is empty, it is directly determined that there is no trajectory that meets the conditions; if the fifth retained trajectory group contains at least one touch motion trajectory, the horizontal projection span and vertical projection span of the spatial morphological characteristics of each touch motion trajectory in the fifth retained trajectory group are extracted. The horizontal projection span refers to the maximum projection distance of the touch motion trajectory in the horizontal direction, and the vertical projection span refers to the maximum projection distance of the touch motion trajectory in the vertical direction. Both are in pixels.

[0124] The gesture response device calculates the ratio of the horizontal projection span to the vertical projection span of each touch motion trajectory to obtain the aspect ratio of the trajectory projection for each touch motion trajectory. The aspect ratio of the trajectory projection refers to the ratio of the horizontal projection span to the vertical projection span, which is used to reflect the extension ratio of the touch motion trajectory in the horizontal and vertical directions. It is calculated by dividing the horizontal projection span by the vertical projection span. If the vertical projection span is zero, the aspect ratio of the trajectory projection is determined to be unacceptable and is directly rejected.

[0125] The projection aspect ratio threshold range is a range used to determine whether the projection ratio of a touch motion trajectory conforms to the characteristics of a valid gesture. It is set according to the actual projection ratio requirements of a valid gesture, for example, between 0.8 and 1.2, to remove touch motion trajectories with unbalanced projection ratios or that do not conform to normal gesture operation patterns (such as excessively long or short trajectories). The gesture response device compares each touch motion trajectory in the fifth retained trajectory group one by one, comparing the projection aspect ratio of each trajectory with the projection aspect ratio threshold range. For touch motion trajectories whose projection aspect ratio is outside the threshold range, it indicates that the projection ratio of the trajectory is unbalanced and does not conform to the projection characteristics of a valid gesture trajectory, and it is removed from the fifth retained trajectory group. For touch motion trajectories whose projection aspect ratio is within the threshold range, it indicates that the projection ratio of the trajectory is reasonable and meets the projection requirements of a valid gesture trajectory, and it is retained in the retained trajectory group. After the above removal operation, the set of remaining touch motion trajectories constitutes the sixth retained trajectory group.

[0126] Continuing with the embodiment based on step 3042, the fifth retained trajectory group includes trajectory 1, with a projection aspect ratio threshold range set to 0.8 to 1.2. Trajectory 1 has a horizontal projection span of 100 pixels and a vertical projection span of 120 pixels. The ratio is calculated as 100 pixels divided by 120 pixels, resulting in a trajectory projection aspect ratio of approximately 0.83. This value falls within the threshold range of 0.8 to 1.2 and is retained. Therefore, the set of remaining trajectories 1 in the fifth retained trajectory group constitutes the sixth retained trajectory group. If a trajectory has a horizontal projection span of 80 pixels and a vertical projection span of 200 pixels, resulting in a trajectory projection aspect ratio of 0.4, which is outside the threshold range, it is removed from the fifth retained trajectory group.

[0127] Step 3044: Based on the minimum curvature of each touch motion trajectory in the sixth retained trajectory group and the preset non-zero curvature threshold, the touch motion trajectory corresponding to the minimum curvature less than the preset non-zero curvature threshold is removed from the sixth retained trajectory group to obtain the effective gesture trajectory group.

[0128] Optionally, if the sixth retained trajectory group is empty, it is determined that there is no valid gesture trajectory group. If the sixth retained trajectory group contains at least one touch motion trajectory, the minimum curvature in the spatial morphological characteristics of each touch motion trajectory in the sixth retained trajectory group is extracted.

[0129] Each touch motion trajectory in the sixth retained trajectory group is compared one by one, and the minimum curvature of each trajectory is compared with a preset non-zero curvature threshold. The preset non-zero curvature threshold is a critical value used to determine whether a touch motion trajectory possesses basic bending characteristics. It is set according to the bending requirements of actual effective gestures, for example, set to the reciprocal of 0.005 pixels, to remove touch motion trajectories that are almost without curvature, approximately straight, and lack a clear gesture intention (such as unconscious straight-line swipe trajectories). For touch motion trajectories with a minimum curvature less than the preset non-zero curvature threshold, it indicates that the trajectory is almost without curvature, approximately straight, lacks a clear gesture operation intention, and does not possess the bending characteristics of an effective gesture trajectory; therefore, it is removed from the sixth retained trajectory group. For touch motion trajectories with a minimum curvature greater than or equal to the preset non-zero curvature threshold, it indicates that the trajectory possesses basic bending characteristics, meets the requirements of an effective gesture trajectory, and is retained in the retained trajectory group. After the above removal operation, the set of remaining touch motion trajectories constitutes the effective gesture trajectory group.

[0130] Continuing with the embodiment based on step 3043, the sixth retained trajectory group includes trajectory 1, with a preset non-zero curvature threshold set to the reciprocal of 0.005 pixels. The minimum curvature of trajectory 1 is the reciprocal of 0.008 pixels, which is greater than the reciprocal of 0.005 pixels, and is therefore retained. Thus, the set of remaining trajectories 1 in the sixth retained trajectory group constitutes the effective gesture trajectory group. If the minimum curvature of a trajectory is the reciprocal of 0.003 pixels, which is less than the preset threshold, it is removed from the sixth retained trajectory group, and at this point, there is no effective gesture trajectory group.

[0131] The embodiments of the present invention ensure that each trajectory within the effective gesture trajectory group has a clear gesture operation form and intent, thereby improving the accuracy of gesture recognition, avoiding the inclusion of invalid trajectories generated by disordered shaking, unconscious swiping, etc. into the subsequent instruction execution process, strengthening the ability to eliminate accidental touch trajectories, and ensuring the accuracy and smoothness of users' multi-point gesture operation interaction.

[0132] Furthermore, the multi-touch display screen parsing and response device provided by the present invention will be described below. The multi-touch display screen parsing and response device described below can be referred to in correspondence with the multi-touch display screen parsing and response method described above.

[0133] Optional, refer to Figure 2 , Figure 2 This is a structural diagram of the multi-touch display screen multi-point gesture parsing and response device provided by the present invention. The multi-touch display screen multi-point gesture parsing and response device includes: The motion trajectory generation module 210 is used to generate multiple touch motion trajectories based on the displacement paths of each initial touch point in the initial touch point set generated on the touch display screen as time changes. The trajectory parsing module 220 is used to perform trajectory cooperative matching based on the relative positional change relationship between each touch motion trajectory to obtain a candidate cooperative trajectory group, and to determine the trajectory persistence based on the time duration characteristics of each touch motion trajectory in the candidate cooperative trajectory group to obtain a target cooperative trajectory group. The trajectory shape recognition module 230 is used to perform trajectory shape recognition based on the spatial shape characteristics of each touch motion trajectory in the target collaborative trajectory group to obtain an effective gesture trajectory group. The gesture response module 240 is used to drive the touch screen to perform an interface display ratio adjustment operation that matches the spacing evolution variable based on the spacing evolution variable of each touch motion trajectory in the effective gesture trajectory group.

[0134] This invention implements a zoom command response only when multi-finger collaboration is confirmed, fundamentally solving the problem of misjudging a touch as a false touch due to light pressure from a single finger or a temporary reduction in contact area caused by physiological characteristics, which leads to a sudden change in gesture semantics (two-finger zoom becomes single-finger drag). It achieves precise control from touch point acquisition to trajectory filtering and command execution, ensuring the accuracy of user interaction under multi-point gesture operation.

[0135] Please see Figure 3 , Figure 3 An embodiment diagram of an electronic device provided in accordance with the present invention. For example... Figure 3 As shown, an embodiment of the present invention provides an electronic device 300, including a memory 310, a processor 320, and a computer program 311 stored in the memory 310 and executable on the processor 320. When the processor 320 executes the computer program 311, it implements the processes of steps 10 to 40.

[0136] Please see Figure 4 , Figure 4 An embodiment diagram of a computer-readable storage medium provided in accordance with an embodiment of the present invention is shown. Figure 4 As shown, this embodiment provides a computer-readable storage medium 400 on which a computer program 311 is stored. When the computer program 311 is executed by a processor, it implements the processes of steps 10 to 40.

[0137] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer is able to execute the multi-point gesture parsing and response method for the touch screen provided by the above methods, which includes steps 10 to 40.

[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for parsing and responding to multi-point gestures on a touch display screen, characterized in that, include: Based on the displacement paths of each initial touch point in the initial touch point set generated on the touch display screen as time changes, multiple touch motion trajectories are generated. Trajectory coordination matching is performed based on the relative positional change relationship between each touch motion trajectory to obtain a candidate coordination trajectory group. Then, trajectory persistence is determined based on the time duration characteristics of each touch motion trajectory in the candidate coordination trajectory group to obtain a target coordination trajectory group. Based on the spatial morphological characteristics of each touch motion trajectory in the target collaborative trajectory group, trajectory morphology is identified to obtain an effective gesture trajectory group; Based on the spacing evolution of each touch motion trajectory in the effective gesture trajectory group, the touch screen is driven to perform an interface display ratio adjustment operation that matches the spacing evolution.

2. The multi-point gesture parsing and response method for a touch display screen according to claim 1, characterized in that, The spatial morphological characteristics include trajectory arc length, trajectory envelope area, and maximum curvature; The steps for obtaining the effective gesture trajectory set include: The trajectory arc length of the first touch motion trajectory in the target collaborative trajectory group is compared with the lower limit of the trajectory arc length threshold. When the trajectory arc length is greater than or equal to the lower limit of the trajectory arc length threshold, the first touch motion trajectory is added to the retention trajectory group to obtain the first retention trajectory group. The trajectory arc length of each touch motion trajectory in the first retained trajectory group is compared with the upper limit of the trajectory arc length threshold. The touch motion trajectory corresponding to the trajectory arc length that is greater than the upper limit of the trajectory arc length threshold is removed from the first retained trajectory group to obtain the second retained trajectory group. Based on the comparison between the trajectory envelope area and the lower limit of the trajectory envelope area threshold for each touch motion trajectory in the second retained trajectory group, the touch motion trajectory corresponding to the trajectory envelope area smaller than the lower limit of the trajectory envelope area threshold is removed from the second retained trajectory group to obtain the third retained trajectory group. Based on the maximum curvature of each touch motion trajectory in the three-retention trajectory group, the trajectory shape is identified to obtain the effective gesture trajectory group.

3. The multi-point gesture parsing and response method for a touch display screen according to claim 2, characterized in that, Spatial morphological characteristics also include: tangent angle, projection span, and minimum curvature; trajectory morphology is identified based on the maximum curvature of each touch motion trajectory in the three-retention trajectory group to obtain an effective gesture trajectory group, including: Based on the comparison of the maximum curvature and curvature smoothness tolerance of each touch motion trajectory in the third retained trajectory group, the touch motion trajectory corresponding to the maximum curvature that is greater than the curvature smoothness tolerance is removed from the third retained trajectory group to obtain the fourth retained trajectory group. The angle difference is calculated based on the starting tangent angle and the ending tangent angle of each touch motion trajectory in the fourth retention trajectory group to obtain the trajectory direction change amount corresponding to each touch motion trajectory. The trajectory direction change amount corresponding to each touch motion trajectory is compared with the direction continuity span threshold. The touch motion trajectory corresponding to the trajectory direction change amount that is greater than the direction continuity span threshold is removed from the fourth retention trajectory group to obtain the fifth retention trajectory group. The ratio of the horizontal and vertical projection spans of each touch motion trajectory in the fifth retention trajectory group is calculated to obtain the trajectory projection aspect ratio of each touch motion trajectory. Then, based on the trajectory projection aspect ratio and the projection aspect ratio threshold range of each touch motion trajectory, an interval inclusion comparison is performed. Touch motion trajectories with projection aspect ratios that are not within the projection aspect ratio threshold range are removed from the fifth retention trajectory group to obtain the sixth retention trajectory group. The minimum curvature of each touch motion trajectory in the sixth retained trajectory group is compared with a preset non-zero curvature threshold. Touch motion trajectories with minimum curvature less than the preset non-zero curvature threshold are removed from the sixth retained trajectory group to obtain the effective gesture trajectory group.

4. The multi-point gesture parsing and response method for a touch display screen according to claim 1, characterized in that, The determination of trajectory persistence based on the time duration characteristics of each touch motion trajectory in the candidate collaborative trajectory group to obtain the target collaborative trajectory group includes: The start time of each touch motion trajectory in the candidate collaborative trajectory group is compared, and the maximum value is selected as the latest start time in the group. The end time of each touch motion trajectory in the candidate collaborative trajectory group is compared, and the minimum value is selected as the earliest end time in the group. The theoretical common overlap duration of candidate cooperative trajectory groups is obtained by calculating the time difference between the earliest termination time and the latest start time within the group. When the theoretical co-overlap duration is greater than zero, a comparison is made between the theoretical co-overlap duration and the effective overlap determination threshold. When the theoretical co-overlap duration is greater than or equal to the effective overlap determination threshold, the candidate cooperative trajectory group is determined as the trajectory group to be verified. Based on the trajectory group to be verified, the trajectory survival is determined to obtain the target cooperative trajectory group.

5. The multi-point gesture parsing and response method for a touch display screen according to claim 4, characterized in that, The step of determining the continued existence of the trajectory based on the trajectory group to be verified, to obtain the target cooperative trajectory group, includes: Based on the start and end times of the first touch motion trajectory in the trajectory group to be verified, as well as the latest start time and the earliest end time in the group, the time interval intersection is calculated to obtain the actual overlap time of the first touch motion trajectory within the theoretical common overlap time. The ratio of the actual overlap time and the theoretical overlap time of the first touch motion trajectory is calculated to obtain the first single-track overlap contribution rate corresponding to the first touch motion trajectory. When the first single-track overlap contribution rate is greater than or equal to the preset contribution rate threshold, the first touch motion trajectory is added to the initial collaborative trajectory group. Based on the start and end times of the remaining touch motion trajectories in the trajectory group to be verified, as well as the latest start time and the earliest end time in the group, the intersection of the remaining touch motion trajectories in time intervals is calculated one by one to obtain the remaining actual participation overlap time sequence corresponding to each of the remaining touch motion trajectories. Based on the sequential ratio calculation of each remaining actual participation overlap duration and theoretical co-overlap duration in the remaining actual participation overlap duration sequence, the second single-track overlap contribution rate sequence corresponding to each remaining touch motion trajectory is obtained. For each second single-track overlap contribution rate in the second single-track overlap contribution rate sequence that is greater than or equal to a preset contribution rate threshold, its corresponding touch motion trajectory is appended to the end of the initial collaborative trajectory group in sequence. For each second single-track overlap contribution rate in the second single-track overlap contribution rate sequence that is less than a preset contribution rate threshold, its corresponding touch motion trajectory is deleted to obtain the target collaborative trajectory group.

6. The multi-point gesture parsing and response method for a touch display screen according to claim 1, characterized in that, The trajectory coordination matching based on the relative positional changes between each touch motion trajectory yields a candidate coordination trajectory group, including: For each pair of touch motion trajectories, spatial distance is calculated based on the first and second coordinate positions generated at the start time of the first initial touch point and the second initial touch point in the trajectory pair, respectively, and the third and fourth coordinate positions generated at the end time, respectively, to obtain the initial spacing value corresponding to the start time and the termination spacing value corresponding to the termination time of each trajectory pair. Based on the coordinate position sequence generated by the first initial touch point from the start time to the end time, a direction vector is calculated to obtain the first motion direction vector of the first initial touch point. Based on the coordinate position sequence generated by the second initial touch point from the start time to the end time, a direction vector is calculated to obtain the second motion direction vector of the second initial touch point. The candidate cooperative trajectory group is determined based on the first and second coordinate positions of each trajectory pair, as well as the first and second motion direction vectors.

7. The multi-point gesture parsing and response method for a touch display screen according to claim 6, characterized in that, The step of determining the candidate cooperative trajectory group based on the first and second coordinate positions of each trajectory pair, as well as the first and second motion direction vectors, includes: The difference is calculated based on the initial spacing value and the termination spacing value to obtain the spacing change of each trajectory pair during the time period from the start time to the termination time. The angle between the first motion direction vector and the second motion direction vector is calculated to obtain the angle value between the first motion direction vector and the second motion direction vector. Based on the spacing change and the cooperative spacing threshold, it is determined whether the trajectory pair meets the spacing cooperation condition, and based on the direction angle value and the cooperative direction threshold, it is determined whether the trajectory pair meets the direction cooperation condition. The candidate cooperative trajectory group is obtained by combining trajectory pairs that satisfy both the spacing and direction coordination conditions.

8. A multi-point gesture parsing and response device for a touch display screen, characterized in that, The multi-point gesture parsing and response device for the touch display screen includes a motion trajectory generation module, a trajectory parsing module, a trajectory shape recognition module, and a gesture response module; it is used to implement the multi-point gesture parsing and response method for the touch display screen as described in any one of claims 1 to 7.

9. An electronic device, comprising: Memory, used to store computer software programs; A processor for reading and executing the computer software program, characterized in that, when the processor executes the computer software program, it implements the multi-point gesture parsing and response method for a touch display screen as described in any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium, wherein a computer software program is stored therein, characterized in that, When the computer software program is executed by the processor, it implements the multi-point gesture parsing and response method for the touch display screen as described in any one of claims 1 to 7.

Images