A method for realizing touch interaction and a touch interaction device

Abstract

The present invention relates to the field of data processing technology, and specifically discloses a method and a touch interaction device for realizing touch interaction, which are used to solve the problem that most of the existing touch filtering and anti-mistouch algorithms are based on adult usage data, lack special optimization for child user behavior characteristics, and have a high frequency of mistouch, which affects children's operating experience. The present invention obtains real-time image data of children operating a children's interactive screen within a monitoring period, obtains trajectory attribute characteristics and behavior attribute characteristics of children's fingers based on real-time image data analysis, and constructs an actual touch analysis strategy to predict the actual touch points of the fingers and eliminate mistouch points. The touch recognition accuracy is dynamically adjusted according to the first touch parameter of the finger through adaptive area recognition, and a touch error tolerance range is set to automatically identify and correct touch deviations, which can effectively improve the accuracy of touch and user experience.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and more specifically, to a method and a touch interaction device for implementing touch interaction. Background Art

[0002] As smart devices for children, existing children's interactive screens usually use touch technology as the main interactive method, combined with rich multimedia content, to provide children with intuitive and vivid learning and entertainment experiences. However, the design and development of existing children's interactive screens are mainly based on traditional adult touch screen technology, which exposes a series of problems and limitations in the child user group. Existing children's interactive screens mainly rely on capacitive or infrared touch technology. Children have small fingers and relatively weak fine motor control ability, and inaccurate clicks or sliding movements often occur during operation. The design of traditional touch screens assumes that users can perform precise operations, but this assumption does not apply to children. When children use touch screens, their finger movements are prone to jitter, instability, and accidental touches. These behavioral characteristics often cause the touch screen to incorrectly identify the finger's movement trajectory or touch point, thereby causing false touches or wrong operations. At the same time, existing touch technologies (such as capacitive and infrared touch) have limited accuracy when identifying small touch areas or fast, irregular movements, which further exacerbates the problem of false touches. Existing touch filtering and anti-mistouch algorithms are mostly based on adult usage data and lack special optimization for children's user behavior characteristics. Therefore, mistouch occurs more frequently, affecting children's operating experience and learning effect. In order to solve the above problems, a technical solution is now provided. Summary of the invention

[0003] In order to overcome the above-mentioned defects of the prior art, the present invention provides a method and a touch interaction device for realizing touch interaction, which obtains the trajectory attribute characteristics and behavior attribute characteristics of children's fingers according to real-time image data analysis, and constructs an actual touch analysis strategy to predict the actual touch points of the fingers and eliminate false touch points. The touch recognition accuracy is dynamically adjusted according to the first touch parameter of the finger through adaptive area recognition, and the touch error tolerance range is set to automatically identify and correct touch deviations, which can effectively improve the touch accuracy and user experience to solve the problems raised in the above-mentioned background technology.

[0004] To achieve the above object, the present invention provides the following technical solutions:

[0005] A method for implementing touch interaction comprises the following steps:

[0006] Step 1, obtaining real-time image data of a child operating a child interactive screen during a monitoring period, and obtaining trajectory attribute characteristics and behavior attribute characteristics of the child's fingers based on real-time image data analysis;

[0007] Step 2: construct an actual touch analysis strategy based on the trajectory attribute characteristics and behavior attribute characteristics, predict the actual touch point of the finger, and eliminate the false touch point;

[0008] Step 3, dynamically adjust the touch recognition accuracy according to the first touch parameter of the finger through adaptive area recognition, set the touch error tolerance range, and automatically identify and correct the touch deviation; wherein the first touch parameter includes the first touch area, the first touch pressure and the first touch duration; obtain the child interaction screen image, divide the child interaction screen image into several interaction sub-modules, obtain the first touch area, the first touch pressure and the first touch duration of the interaction sub-module within the monitoring period, construct an adaptive touch recognition accuracy model, and calculate the touch recognition accuracy. The formula of the adaptive touch recognition accuracy model is:

[0009] ;

[0010] Where: For touch recognition accuracy, is the second touch characteristic coefficient, is the first touch characteristic coefficient, is the first touch area at time point p+1 within the first touch duration, is the first touch area at time point p within the first touch duration, is the average value of the first touch area within the first touch duration, is the first touch pressure at time point p+1 within the first touch duration, is the first touch pressure at time point p within the first touch duration, is the average value of the first touch pressure within the first touch duration, It is the number of time points within the first touch duration.

[0011] As a further solution of the present invention, in step 2, an actual touch analysis strategy is constructed according to the trajectory attribute characteristics and the behavior attribute characteristics to predict the actual touch point of the finger and eliminate the wrong touch point, specifically:

[0012] Step 21, obtaining a child interaction screen image, dividing the child interaction screen image into a plurality of interaction submodules, and obtaining trajectory attribute features and behavior attribute features at the same time point in each interaction submodule;

[0013] Step 22, determining a first touch feature coefficient of a finger according to the trajectory attribute characteristics at the same time point in each interaction submodule;

[0014] Step 23, determining a second touch characteristic coefficient of the finger according to the behavior attribute characteristics at the same time point in each interaction submodule;

[0015] Step 24, determining an actual touch analysis strategy according to the first touch characteristic coefficient and the second touch characteristic coefficient, and making a preliminary prediction of the actual touch point of the finger.

[0016] As a further solution of the present invention, in step 22, the first touch feature coefficient of the finger is determined according to the trajectory attribute characteristics at the same time point in each interaction submodule, and the determination formula of the first touch feature coefficient is:

[0017] ;

[0018] Where: is the first touch characteristic coefficient, is the number of data items of the finger's moving trajectory curvature feature, moving trajectory speed feature, and moving trajectory acceleration feature, is the i-th item of the curvature feature, velocity feature and acceleration feature of the finger's moving trajectory at time point t, is the mean of the i-th item in the finger's movement trajectory curvature feature, movement trajectory velocity feature, and movement trajectory acceleration feature.

[0019] As a further solution of the present invention, in step 23, the second touch characteristic coefficient of the finger is determined according to the behavior attribute characteristics at the same time point in each interaction submodule, and the determination formula of the second touch characteristic coefficient is:

[0020] ;

[0021] Where: is the second touch characteristic coefficient, is the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature at time point t, is the mean of the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature. is the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration frequency of the pinch zoom and rotation detection features at time point t, is the mean of the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration frequency of the pinch zoom and rotation detection features, The number of data items for the duration of the click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature at a point in time.

[0022] As a further solution of the present invention, in step 24, an actual touch analysis strategy is determined according to the first touch characteristic coefficient and the second touch characteristic coefficient to perform a preliminary prediction of the actual touch point of the finger:

[0023] If the first touch feature coefficient is less than the preset first touch feature threshold, and the second touch feature coefficient is less than the preset second touch feature threshold, it is preliminarily determined that the actual touch point of the finger of the interaction sub-module meets the requirements at time point t, and there is no false touch point; otherwise, it is preliminarily determined that the actual touch point of the finger of the interaction sub-module does not meet the requirements at time point t, and there is a false touch point.

[0024] As a further solution of the present invention, in step 1, real-time image data of a child operating a child interactive screen during a monitoring period is obtained, and trajectory attribute characteristics and behavior attribute characteristics of the child's finger are obtained according to the real-time image data analysis, specifically including:

[0025] Real-time image data of children operating the children's interactive screen during the monitoring period is obtained, and trajectory attribute characteristics of children's fingers are extracted. The trajectory attribute characteristics include the speed characteristics of the fingers moving on the children's interactive screen, the acceleration characteristics of the moving trajectory, and the curvature characteristics of the moving trajectory; the behavior attribute characteristics include the click detection characteristics, slide detection characteristics, two-finger zoom and rotation detection characteristics, and behavior time detection characteristics of the fingers on the children's interactive screen; among them, the behavior time detection characteristics are the duration and frequency of the click detection characteristics, slide detection characteristics, two-finger zoom and rotation detection characteristics.

[0026] As a further solution of the present invention, a touch interaction device includes: an image acquisition module, a processor, a memory and a bus, the image acquisition module is used to acquire real-time image data of a child operating a child interaction screen within a monitoring period, and acquire trajectory attribute characteristics and behavior attribute characteristics of the child's fingers based on real-time image data analysis; the processor is used to construct an actual touch analysis strategy based on the trajectory attribute characteristics and behavior attribute characteristics, predict the actual touch points of the fingers, and eliminate false touch points, and then dynamically adjust the touch recognition accuracy according to the first touch parameters of the fingers through adaptive area recognition, and set the touch error tolerance range to automatically identify and correct touch deviations; wherein the first touch parameters include a first touch area, a first touch pressure and a first touch duration; the memory stores machine-readable instructions executable by the processor, and when the touch interaction device is running, the processor communicates with the memory through a bus, and the processor communicates with the image acquisition module through a bus to execute the method for realizing touch interaction as described above.

[0027] The present invention provides a method and a touch interaction device for realizing touch interaction, and has the following technical effects and advantages: the present invention obtains real-time image data of a child operating a child interaction screen within a monitoring period, obtains trajectory attribute characteristics and behavior attribute characteristics of the child's fingers based on real-time image data analysis, and constructs an actual touch analysis strategy to predict the actual touch points of the fingers and eliminate false touch points. By predicting the actual touch points of the fingers, effective touch operations are accurately identified, false touch points are filtered out, system misjudgments are reduced, and the accuracy and effectiveness of touch interaction are improved. The touch recognition accuracy is dynamically adjusted according to the first touch parameter of the finger through adaptive area recognition, and the touch error tolerance range is set to automatically identify and correct touch deviations, which can effectively improve the accuracy of touch and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic flow chart of a method for implementing touch interaction provided in Embodiment 1 of the present invention;

[0029] Figure 2 A schematic diagram of a flow chart of step 2 in a method for realizing touch interaction provided by the present invention;

[0030] Figure 3 This is a schematic diagram of the structure of a touch interaction device provided by the present invention. DETAILED DESCRIPTION

[0031] The following will be combined with the accompanying drawings in the present invention to clearly and completely describe the technical solution in the present invention. Obviously, the described technical solution is only a part of the present invention, not all of it. Based on the technical solution in the present invention, all other technical solutions obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0032] Figure 1 FIG. 1 is a flow chart of a method for implementing touch interaction provided by Embodiment 1 of the present invention. Figure 1 As shown, a method for implementing touch interaction in this embodiment includes the following steps:

[0033] Step 1, obtaining real-time image data of a child operating a child interactive screen during a monitoring period, and obtaining trajectory attribute characteristics and behavior attribute characteristics of the child's fingers based on real-time image data analysis;

[0034] Step 2: construct an actual touch analysis strategy based on the trajectory attribute characteristics and behavior attribute characteristics, predict the actual touch point of the finger, and eliminate the false touch point;

[0035] Step 3, dynamically adjust the touch recognition accuracy according to the first touch parameter of the finger through adaptive area recognition, set the touch error tolerance range, and automatically identify and correct the touch deviation; wherein the first touch parameter includes a first touch area, a first touch pressure and a first touch duration.

[0036] Specifically, in step 1, real-time image data of a child operating the child interactive screen during the monitoring period is obtained, and trajectory attribute characteristics and behavior attribute characteristics of the child's fingers are obtained based on real-time image data analysis, specifically including:

[0037] Acquire real-time image data of children operating the children's interactive screen during the monitoring period, and extract the trajectory attribute features of the children's fingers, the trajectory attribute features include the speed features of the fingers moving on the children's interactive screen, the acceleration features of the moving track, and the curvature features of the moving track; the behavior attribute features include the click detection features, slide detection features, two-finger zoom and rotation detection features, and behavior time detection features of the fingers on the children's interactive screen; among them, the behavior time detection features are the duration and frequency of the click detection features, slide detection features, two-finger zoom and rotation detection features;

[0038] The trajectory attribute features include the velocity feature, acceleration feature and curvature feature of the moving trajectory of the finger on the children's interactive screen. The calculation formula of the moving trajectory velocity feature is:

[0039] ;

[0040] Where: is the velocity characteristic of the finger movement trajectory at time point t, is the time difference between time point t and time point t-1, is the coordinate position of the finger on the children's interactive screen at time t, is the coordinate position of the finger on the children's interactive screen at time t-1;

[0041] The calculation formula of the moving trajectory acceleration characteristic is:

[0042] ;

[0043] Where: is the velocity characteristic of the finger movement trajectory at time point t, is the velocity characteristic of the finger movement trajectory at time point t-1, is the acceleration characteristic of the finger's moving trajectory at time point t;

[0044] The calculation formula of the moving trajectory curvature characteristic is:

[0045] ;

[0046] Where: is the curvature characteristic of the finger's moving trajectory at time point t, is the coordinate position of the finger on the children's interactive screen at time t, is the rate of change of the finger in the x direction at time t, is the rate of change of the finger in the y direction at time t, is the acceleration of the finger in the x direction at time t, is the acceleration of the finger in the y direction at time t.

[0047] The moving trajectory velocity feature refers to the moving speed of the finger on the screen, and the moving trajectory acceleration feature is the rate of change of the moving trajectory velocity feature, that is, the change of the moving trajectory velocity feature over time. The moving trajectory velocity feature and the moving trajectory acceleration feature are directly related. The change of the moving trajectory velocity feature will lead to the change of the moving trajectory acceleration feature; the moving trajectory curvature feature describes the curvature of the finger's motion trajectory. The relationship between the moving trajectory velocity feature and the moving trajectory curvature feature can reveal the smoothness of the motion. For example, when the finger moves along a curved path at a constant speed, the moving trajectory curvature feature value may be high, but the speed is stable. When the moving trajectory velocity feature and the moving trajectory acceleration feature change drastically, the moving trajectory curvature feature value may increase sharply, indicating irregular touch behavior or jitter.

[0048] Through the calculation formula of the moving trajectory speed feature and the acceleration feature, the movement speed and acceleration of the finger on the touch screen are accurately calculated, so that the system can detect slight changes in children's operations, such as fast sliding, slow movement or sudden shaking of the finger, so as to accurately judge the type and effectiveness of the operation; through the moving trajectory curvature feature, the curvature of the finger movement trajectory can be judged, which is used to identify complex gesture operations (such as two-finger rotation, arc sliding, etc.). At the same time, the curvature feature helps to distinguish normal sliding from irregular mis-touch behaviors (such as shaking or sudden change of direction), thereby improving the accuracy of touch recognition. By using the extracted trajectory and behavior attribute features, the accuracy and error tolerance range of touch recognition are dynamically adjusted according to different operation scenarios and finger states (such as finger size, strength, touch time), which can better adapt to children's different operation habits and touch styles, reduce misoperation, and improve the accuracy of operation; it can not only detect single-finger clicks and slides, but also support complex gestures such as two-finger zooming and rotation. Through the analysis of behavior attribute features (such as two-finger zooming and rotation detection features, behavior time detection features), the duration and frequency of various gestures can be distinguished, and the various intentions of child users can be accurately identified.

[0049] Specifically, Figure 2 In step 2 shown, an actual touch analysis strategy is constructed based on the trajectory attribute characteristics and the behavior attribute characteristics to predict the actual touch point of the finger and eliminate the false touch point, specifically:

[0050] Step 21, obtaining a child interaction screen image, dividing the child interaction screen image into a plurality of interaction submodules, and obtaining trajectory attribute features and behavior attribute features at the same time point in each interaction submodule;

[0051] Step 22, determining a first touch feature coefficient of a finger according to the trajectory attribute characteristics at the same time point in each interaction submodule;

[0052] Step 23, determining a second touch characteristic coefficient of the finger according to the behavior attribute characteristics at the same time point in each interaction submodule;

[0053] Step 24, determining an actual touch analysis strategy according to the first touch characteristic coefficient and the second touch characteristic coefficient, and making a preliminary prediction of the actual touch point of the finger.

[0054] The children's interactive screen image is divided into several interactive sub-modules so that each sub-module can be processed independently, and the touch behavior can be analyzed and optimized in a smaller local range, thereby reducing the complexity of global calculations and error accumulation, and improving the accuracy and efficiency of touch recognition; the trajectory attribute characteristics (such as speed, acceleration, curvature) and behavior attribute characteristics (such as click, slide, zoom, etc.) are obtained in each interactive sub-module to make the data more refined and accurate, capture the finger movement characteristics in each sub-area, and facilitate subsequent feature analysis and false touch filtering; the first touch feature coefficient of the finger is calculated through the trajectory attribute characteristics (such as speed, acceleration, curvature, etc.), and the dynamic motion information of the finger can be obtained, such as the smoothness of the motion trajectory and the speed change trend, which is helpful to identify the movement pattern of the child's finger and determine whether it is a normal operation or a potential false touch; the second touch feature coefficient of the finger is calculated through the behavior attribute characteristics (such as click, slide, zoom and rotation detection features) to identify the user's operation intention, such as single-finger click, multi-finger zoom or rotation, and the feature coefficients of these operation modes are calculated and quantified.

[0055] Specifically, in step 22, the first touch feature coefficient of the finger is determined according to the trajectory attribute characteristics at the same time point in each interaction submodule. The formula for determining the first touch feature coefficient is:

[0056] ;

[0057] Where: is the first touch characteristic coefficient, is the number of data items of the finger's moving trajectory curvature feature, moving trajectory speed feature, and moving trajectory acceleration feature, is the i-th item of the curvature feature, velocity feature and acceleration feature of the finger's moving trajectory at time point t, is the mean of the i-th item in the finger's movement trajectory curvature feature, movement trajectory velocity feature, and movement trajectory acceleration feature.

[0058] The curvature characteristics, speed characteristics and acceleration characteristics of the finger movement trajectory are taken into consideration instead of the influence of a single feature. The curvature, speed and acceleration represent the shape, speed and change trend of the finger touch trajectory respectively, and more comprehensively describe the behavior pattern of finger touch. The first touch feature coefficient effectively integrates the discreteness and deviation of the data by summing and normalizing the absolute difference and square difference of each feature at each time point. The numerator (the cumulative sum of the absolute difference) in the formula reflects the degree of deviation of each feature value from the mean, and reflects the change amplitude of the finger touch trajectory. The denominator (the square root of the square difference) can reflect the stability of the finger trajectory. If the trajectory is stable and the feature changes little, the value of the first touch feature coefficient will be smaller; if the trajectory changes greatly, the coefficient value will be larger.

[0059] Specifically, in step 23, the second touch characteristic coefficient of the finger is determined according to the behavior attribute characteristics at the same time point in each interaction submodule, and the formula for determining the second touch characteristic coefficient is:

[0060] ;

[0061] Where: is the second touch characteristic coefficient, is the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature at time point t, is the mean of the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature. is the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration frequency of the pinch zoom and rotation detection features at time point t, is the mean of the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration frequency of the pinch zoom and rotation detection features, The number of data items for the duration of the click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature at a point in time.

[0062] The second touch characteristic coefficient formula combines the duration (click, slide, zoom) and duration frequency of finger touch behaviors. By calculating the deviation degree and mutual relationship of these features, it can fully reflect the characteristics of different touch behaviors. It not only focuses on single behavior features, but also considers the correlation and mutual influence between them, so as to more accurately describe touch behaviors; different touch behaviors (such as click, slide, pinch zoom, rotation, etc.) often have different duration and frequency patterns. By combining the mean and deviation of these features, the second touch characteristic coefficient can effectively distinguish these behavior types and identify complex and multiple combination patterns of touch behaviors, which is very useful for the recognition of multi-finger touch or complex gesture operations; the product and square terms in the formula not only help to describe the change amplitude of the behavior characteristics, but also eliminate unnecessary data redundancy and noise interference. For example, abnormal changes in finger touch frequency and duration may be noise or false touch. This characteristic coefficient smoothes data fluctuations by combining these features, enhancing the recognition ability of truly effective touch behaviors.

[0063] Specifically, in step 24, the actual touch analysis strategy is determined according to the first touch characteristic coefficient and the second touch characteristic coefficient, and a preliminary prediction of the actual touch point of the finger is performed:

[0064] If the first touch feature coefficient is less than the preset first touch feature threshold, and the second touch feature coefficient is less than the preset second touch feature threshold, it is preliminarily determined that the actual touch point of the finger of the interaction sub-module meets the requirements at time point t, and there is no false touch point; otherwise, it is preliminarily determined that the actual touch point of the finger of the interaction sub-module does not meet the requirements at time point t, and there is a false touch point.

[0065] By combining the dual conditions of the first touch feature coefficient (based on trajectory attributes, such as speed, acceleration, curvature) and the second touch feature coefficient (based on behavior attributes, such as click, slide, zoom, rotation), the touch behavior of the finger can be analyzed more comprehensively. Only when both feature coefficients are less than the preset threshold can it be judged as a valid touch, which reduces the misjudgment rate caused by single feature judgment and improves the accuracy of filtering false touches; different thresholds are set according to different scenarios and user characteristics, and the false touch judgment criteria are flexibly adjusted. The touch point judgment criteria can be adaptively adjusted to ensure high accuracy of touch recognition; if any feature coefficient exceeds the preset threshold, it indicates that the touch point has irregular behavior (jitter, accidental touch), and the system will preliminarily identify it as a false touch point and exclude it, reducing the misjudgment of children during operation, avoiding unnecessary operation feedback due to false touch, effectively improving the accuracy of false touch filtering, reducing misjudgment, improving user experience, and enhancing the intelligence and adaptability of the device.

[0066] Specifically, in step 3, the touch recognition accuracy is dynamically adjusted according to the first touch parameter of the finger through adaptive area recognition, specifically:

[0067] The first touch parameter of each interactive submodule is obtained, and the first touch parameter is denoised and standardized; the first touch area, the first touch pressure and the first touch duration of the interactive submodule within the monitoring period are obtained, and an adaptive touch recognition accuracy model is constructed to calculate the touch recognition accuracy. The formula of the adaptive touch recognition accuracy model is:

[0068] ;

[0069] Where: For touch recognition accuracy, is the second touch characteristic coefficient, is the first touch characteristic coefficient, is the first touch area at time point p+1 within the first touch duration, is the first touch area at time point p within the first touch duration, is the average value of the first touch area within the first touch duration, is the first touch pressure at time point p+1 within the first touch duration, is the first touch pressure at time point p within the first touch duration, is the average value of the first touch pressure within the first touch duration, It is the number of time points within the first touch duration.

[0070] The accuracy of touch recognition is dynamically adjusted according to the user's current touch behavior characteristics (such as area, pressure, and duration). The adaptive adjustment can adapt to the operational needs of different users and environments, thereby improving the response accuracy of the touch system and the user experience in various situations. The first touch characteristic coefficient and the second touch characteristic coefficient, as well as the touch area change rate and the touch pressure change rate, through comprehensive consideration of multiple features, enhance the model's adaptability and robustness to different touch behavior modes (such as clicking, sliding, zooming, etc.). By calculating the change rate of the touch area and pressure, and combining the average of the touch duration, abnormal touch behaviors (such as false touches, rapid jitters, etc.) can be effectively identified, which helps to reduce the occurrence of false touches and improve the system's recognition accuracy of actual touches.

[0071] Specifically, in step 3, the touch error tolerance range is set to automatically identify and correct the touch deviation, and the center position of the interactive submodule is obtained. , extract the first position of the first touch area farthest from the center position and the second position closest to the center position in the interaction submodule, calculate the first range data based on the first position and the center position, calculate the second range data based on the second position and the center position, and determine the touch error tolerance range based on the first range data and the second range data.

[0072] like Figure 3A touch interaction device shown includes: an image acquisition module, a processor, a memory and a bus, wherein the image acquisition module is used to acquire real-time image data of a child operating a child interaction screen within a monitoring period, and acquire trajectory attribute characteristics and behavior attribute characteristics of the child's finger based on real-time image data analysis; the processor is used to construct an actual touch analysis strategy based on the trajectory attribute characteristics and behavior attribute characteristics, predict the actual touch point of the finger, and eliminate the false touch point, and then dynamically adjust the touch recognition accuracy according to the first touch parameter of the finger through adaptive area recognition, and set the touch error tolerance range, and automatically identify and correct the touch deviation; wherein the first touch parameter includes a first touch area, a first touch pressure and a first touch duration; the memory stores machine-readable instructions executable by the processor, and when the touch interaction device is running, the processor communicates with the memory through a bus, and the processor communicates with the image acquisition module through a bus to execute the method for realizing touch interaction as described above.

[0073] The embodiment of the present invention obtains real-time image data of children operating the children's interactive screen within a monitoring period, obtains trajectory attribute characteristics and behavior attribute characteristics of the children's fingers based on real-time image data analysis, and constructs an actual touch analysis strategy to predict the actual touch points of the fingers and eliminate false touch points. By predicting the actual touch points of the fingers, effective touch operations are accurately identified, and false touch points are filtered out to reduce system misjudgments and improve the accuracy and effectiveness of touch interaction. The touch recognition accuracy is dynamically adjusted according to the first touch parameter of the finger through adaptive area recognition, and the touch error tolerance range is set to automatically identify and correct touch deviations, which can effectively improve the touch accuracy and user experience.

[0074] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0075] Finally: The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for realizing touch interaction, characterized in that: The steps include: Step 1, obtaining real-time image data of a child operating a child interactive screen during a monitoring period, and obtaining trajectory attribute characteristics and behavior attribute characteristics of the child's fingers based on real-time image data analysis; Step 2: construct an actual touch analysis strategy based on the trajectory attribute characteristics and behavior attribute characteristics, predict the actual touch point of the finger, and eliminate the false touch point; Step 3, dynamically adjust the touch recognition accuracy according to the first touch parameter of the finger through adaptive area recognition, set the touch error tolerance range, and automatically identify and correct the touch deviation; wherein the first touch parameter includes the first touch area, the first touch pressure and the first touch duration; obtain the child interaction screen image, divide the child interaction screen image into several interaction sub-modules, obtain the first touch area, the first touch pressure and the first touch duration of the interaction sub-module within the monitoring period, construct an adaptive touch recognition accuracy model, and calculate the touch recognition accuracy. The formula of the adaptive touch recognition accuracy model is: ； Where: For touch recognition accuracy, is the second touch characteristic coefficient, is the first touch characteristic coefficient, is the first touch area at time point p+1 within the first touch duration, is the first touch area at time point p within the first touch duration, is the average value of the first touch area within the first touch duration, is the first touch pressure at time point p+1 within the first touch duration, is the first touch pressure at time point p within the first touch duration, is the average value of the first touch pressure within the first touch duration, It is the number of time points within the first touch duration.

2. A method for realizing touch interaction according to claim 1, characterized in that: In step 2, an actual touch analysis strategy is constructed based on the trajectory attribute characteristics and the behavior attribute characteristics to predict the actual touch point of the finger and eliminate the false touch point. Specifically: Step 21, obtaining a child interaction screen image, dividing the child interaction screen image into a plurality of interaction submodules, and obtaining trajectory attribute features and behavior attribute features at the same time point in each interaction submodule; Step 22, determining a first touch feature coefficient of a finger according to the trajectory attribute characteristics at the same time point in each interaction submodule; Step 23, determining a second touch characteristic coefficient of the finger according to the behavior attribute characteristics at the same time point in each interaction submodule; Step 24, determining an actual touch analysis strategy according to the first touch characteristic coefficient and the second touch characteristic coefficient, and making a preliminary prediction of the actual touch point of the finger.

3. A method for realizing touch interaction according to claim 2, characterized in that: In step 22, the first touch characteristic coefficient of the finger is determined according to the trajectory attribute characteristics at the same time point in each interaction submodule. The formula for determining the first touch characteristic coefficient is: ； Where: is the first touch characteristic coefficient, is the number of data items of the finger's moving trajectory curvature feature, moving trajectory speed feature, and moving trajectory acceleration feature, is the i-th item of the curvature feature, velocity feature and acceleration feature of the finger's moving trajectory at time point t, is the mean of the i-th item in the finger's movement trajectory curvature feature, movement trajectory velocity feature, and movement trajectory acceleration feature.

4. A method for realizing touch interaction according to claim 2, characterized in that: In step 23, the second touch characteristic coefficient of the finger is determined according to the behavior attribute characteristics at the same time point in each interaction submodule. The formula for determining the second touch characteristic coefficient is: ； Where: is the second touch characteristic coefficient, is the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature at time point t, is the mean of the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration of the pinch zoom and rotation detection feature. is the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration frequency of the pinch zoom and rotation detection features at time point t, is the mean of the jth item among the duration of the finger click detection feature, the duration of the slide detection feature, and the duration frequency of the pinch zoom and rotation detection features, The number of data items for the duration of the click detection feature, the duration of the slide detection feature, and the duration of the pinch-to-zoom and rotation detection feature at a point in time.

5. The method for realizing touch interaction according to claim 2, characterized in that: In step 24, the actual touch analysis strategy is determined according to the first touch characteristic coefficient and the second touch characteristic coefficient, and a preliminary prediction of the actual touch point of the finger is performed: If the first touch feature coefficient is less than the preset first touch feature threshold, and the second touch feature coefficient is less than the preset second touch feature threshold, it is preliminarily determined that the actual touch point of the finger meets the requirements at time point t of the interaction submodule, and there is no false touch point; Otherwise, it is preliminarily determined that the actual touch point of the finger of the interaction submodule does not meet the requirements at time point t, and there is an incorrect touch point.

6. A method for realizing touch interaction according to claim 1, characterized in that: In step 1, real-time image data of a child operating a child interactive screen during a monitoring period is obtained, and trajectory attribute characteristics and behavior attribute characteristics of the child's fingers are obtained based on real-time image data analysis, specifically including: Real-time image data of children operating the children's interactive screen during the monitoring period is obtained, and trajectory attribute characteristics of children's fingers are extracted. The trajectory attribute characteristics include the speed characteristics of the fingers moving on the children's interactive screen, the acceleration characteristics of the moving trajectory, and the curvature characteristics of the moving trajectory; the behavior attribute characteristics include the click detection characteristics, slide detection characteristics, two-finger zoom and rotation detection characteristics, and behavior time detection characteristics of the fingers on the children's interactive screen; among them, the behavior time detection characteristics are the duration and frequency of the click detection characteristics, slide detection characteristics, two-finger zoom and rotation detection characteristics.

7. A touch interactive device, characterized in that: include: An image acquisition module, a processor, a memory and a bus, wherein the image acquisition module is used to acquire real-time image data of a child operating the child interactive screen during a monitoring period, and acquire trajectory attribute characteristics and behavior attribute characteristics of the child's fingers based on real-time image data analysis; The processor is used to construct an actual touch analysis strategy based on trajectory attribute characteristics and behavior attribute characteristics, predict the actual touch point of the finger, and eliminate false touch points, and then dynamically adjust the touch recognition accuracy according to the first touch parameter of the finger through adaptive area recognition, and set the touch error tolerance range to automatically identify and correct touch deviations; wherein the first touch parameter includes a first touch area, a first touch pressure and a first touch duration; the memory stores machine-readable instructions executable by the processor, and when the touch interaction device is running, the processor communicates with the image acquisition module through a bus, and the processor communicates with the memory through a bus to execute the method for realizing touch interaction as described in any one of claims 1 to 6.

Images