A smart stylus interaction method

Through a variety of sensors and wireless transmission technologies, intelligently analyze and adjust the interactive parameters of the smart stylus, and realize accurate recognition and diversified interactive control of user gestures, solving the existing smart stylus gesture recognition and interactive control functions. A single question provides a more natural and smooth interactive experience.

CN118394229BActive Publication Date: 2024-11-29SHENZHEN ZUOMU TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410479334.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-22
Publication Date
2024-11-29
Estimated Expiration
2044-04-22

AI Technical Summary

Technical Problem

The gesture recognition of existing smart stylus is not accurate enough, and the interaction control function is single, making it difficult to meet the diverse interaction needs of users.

Method used

Data is collected through pressure sensors, mobile sensors, gyroscope sensors, touch screen light sensors and touch screen distance sensors, and the interactive distance and sensitivity of the smart stylus are analyzed and adjusted in real time, combining wireless transmission technology and gesture recognition interactive processors, Achieve accurate recognition and diversified interactive control of user gestures.

Benefits of technology

It improves the interactive accuracy and flexibility of the smart stylus, provides a more natural and smooth touch screen interactive experience, and meets the diverse interaction needs of users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118394229B_ABST
    Figure CN118394229B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of intelligent interactive control technology, and in particular to an intelligent stylus interaction method. The method comprises the following steps: performing real-time data acquisition and processing and posture movement trajectory simulation analysis on the intelligent stylus to obtain the intelligent stylus posture movement simulation trajectory; performing touch screen change data acquisition and touch screen sensitivity interval adjustment analysis on the touch screen use process of the intelligent stylus to obtain the dynamic change interval of the touch screen sensitivity of the intelligent stylus tip; performing interactive distance response update and posture sensitivity interaction correction on the intelligent stylus based on the dynamic change interval of the touch screen sensitivity of the intelligent stylus tip to obtain the intelligent stylus posture movement sensitive interaction correction trajectory; performing gesture trajectory pattern matching and interactive command response processing on the intelligent stylus posture movement sensitive interaction correction trajectory, generating intelligent stylus interaction commands, and executing corresponding intelligent stylus interaction operations. The present invention can realize the intelligent interactive control of the stylus.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent interactive control technology, and in particular to an intelligent touch pen interaction method. Background Art

[0002] Traditional styluses are mainly used for writing or drawing on electronic devices, and their interactive functions are limited and lack intelligence. Although some smart styluses already exist, they also combine computer processing technologies such as machine learning and human-computer interaction to achieve a more intelligent and flexible interactive experience. However, their smart stylus interaction methods still have some limitations, such as the lack of accurate gesture recognition of the stylus and the single interactive control function. Summary of the invention

[0003] Based on this, it is necessary for the present invention to provide a smart stylus interaction method to solve at least one of the above technical problems.

[0004] To achieve the above object, a smart stylus pen interaction method comprises the following steps:

[0005] Step S1: real-time data collection and processing of the touch screen use process of the smart stylus pen is performed through the pressure sensor and the motion sensor to obtain the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen; the posture movement trajectory simulation analysis is performed on the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen using the gyroscope sensor to obtain the posture movement simulation trajectory of the smart stylus pen;

[0006] Step S2: collecting and processing the touch screen change data of the touch screen use process of the smart stylus through the touch screen light sensor and the touch screen distance sensor to obtain the touch screen light change data of the smart stylus tip and the touch screen distance change data of the smart stylus tip; adjusting and analyzing the touch screen sensitivity interval of the smart stylus based on the touch screen light change data of the smart stylus tip and the touch screen distance change data of the smart stylus tip to obtain the touch screen sensitivity dynamic change interval of the smart stylus tip;

[0007] Step S3: updating the interactive distance response of the smart stylus based on the dynamic change interval of the smart stylus pen tip touching the screen to obtain the interactive distance dynamically updated by the smart stylus pen; performing posture sensitive interactive correction on the simulated trajectory of the posture movement of the smart stylus based on the interactive distance dynamically updated by the smart stylus pen to obtain the posture sensitive interactive correction trajectory of the posture movement of the smart stylus;

[0008] Step S4: transmitting the intelligent stylus posture sensitive interactive correction trajectory to the gesture recognition interaction processor through wireless transmission technology; performing gesture trajectory pattern matching on the intelligent stylus posture sensitive interactive correction trajectory through the gesture trajectory template preset in the gesture recognition interaction processor to obtain the intelligent stylus gesture trajectory matching result; performing interactive command response processing on the intelligent stylus according to the intelligent stylus gesture trajectory matching result to generate the intelligent stylus interactive command to execute the corresponding intelligent stylus interactive operation.

[0009] The present invention firstly uses pressure sensors and motion sensors to collect and process real-time data of the touch screen use process of the smart stylus, thereby obtaining real-time data on the pressure status of the smart stylus tip and information such as the position and movement speed of the smart stylus. These real-time data can reflect the changes in the pressure of the smart stylus tip and the changes in the movement of the smart stylus when the user writes or draws on the touch screen device, thereby providing basic data guarantee for the subsequent posture movement trajectory analysis. At the same time, by using a gyroscope sensor to simulate the posture movement trajectory analysis of the real-time pressure data of the smart stylus tip and the real-time movement position change data of the smart stylus, the posture movement trajectory or movement change of the smart stylus in a three-axis manner during the writing or drawing process on the touch screen device can be simulated. These simulated trajectory data can accurately reflect the user's writing or drawing actions, thereby providing a more realistic and intelligent interactive experience for the application of the smart stylus. Secondly, by using the touch screen light sensor and the touch screen distance sensor to collect the change data of the smart stylus on the touch screen, including the light sense and distance changes of the pen tip, and by analyzing these data to adjust the sensitive interval of the touch screen, the dynamic change interval of the touch screen sensitivity of the pen tip of the smart stylus is obtained. The key to this step is to be able to comprehensively consider the changes in light intensity control and the changes in touch screen distance, and dynamically adjust the touch screen sensitivity of the smart stylus to ensure that the sensitivity under different operating conditions can be effectively maintained and adjusted. Through the analysis of sensitive interval adjustment, the adaptability and user experience of the smart stylus in different usage scenarios can be improved, thereby providing users with a more comfortable and convenient touch screen interactive operation experience. Then, by combining the dynamic change interval of the touch screen sensitivity of the smart stylus tip to update the interactive distance response of the smart stylus, the dynamic response of the smart stylus can be realized, so that it can be adjusted in real time according to the user's operating habits and environmental changes, thereby providing a more flexible and accurate interactive experience. The key to this step is to use the data of the sensitive dynamic change interval to update the response mechanism of the stylus to adapt to the operation requirements at different distances, thereby improving the user's interactive operation comfort and efficiency. Subsequently, the interactive response of the simulated trajectory of the intelligent stylus gesture movement is corrected by combining the dynamic response of the intelligent stylus to update the interactive distance. The purpose of this step is to effectively correct the user's gesture movement trajectory according to the interactive distance of the intelligent stylus on the touch screen operation and environmental changes, so as to ensure the response sensitivity and accuracy of the stylus in different interactive scenarios. By generating a sensitive interactive correction trajectory for gesture movement, the stylus can achieve optimized response in various interactive environments, thereby providing a smoother and more natural interactive experience.Finally, by using wireless transmission technology to transmit the posture movement sensitive interactive correction trajectory of the smart stylus to the gesture recognition interactive processor, seamless communication between the corresponding sensor of the smart stylus and the gesture recognition interactive processor can be achieved. The key to this step is to transmit the posture movement correction trajectory recorded by the stylus sensor to the processor through wireless transmission technology, which provides the necessary data basis for subsequent gesture recognition and interactive instruction generation, thereby enhancing the interactive function and flexibility of the smart stylus. In addition, the gesture trajectory pattern of the posture movement sensitive interactive correction trajectory of the smart stylus is matched by using the gesture trajectory template preset in the gesture recognition interactive processor. The key to this step is to match the gesture pattern recorded by the stylus with the preset template by analyzing the similarity measurement degree between the gesture trajectory template and the gesture trajectory pattern of the posture movement sensitive interactive correction trajectory of the smart stylus, so as to accurately identify the actual gesture behavior of the user and provide an accurate basis for the subsequent interactive instruction generation and execution, thereby realizing the precise interactive function of the smart stylus. By processing the interactive command response of the smart stylus according to the gesture trajectory matching results of the smart stylus, the purpose of this step is to perform real-time interactive command response processing on the stylus according to the gesture matching results, generate corresponding operation instructions to meet the user's interactive needs, and realize the execution of diversified interactive control functions of the smart stylus, thereby providing users with a more convenient and intelligent interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments thereof made with reference to the following drawings:

[0011] Figure 1 A schematic diagram of the steps of the smart stylus interaction method of the present invention;

[0012] Figure 2 for Figure 1 Detailed step flow diagram of step S1;

[0013] Figure 3 for Figure 2 Detailed step flow chart of step S14 in FIG. DETAILED DESCRIPTION

[0014] The following is a clear and complete description of the technical method of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by technicians in this field without creative work are within the scope of protection of the present invention.

[0015] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. The functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor methods and / or microcontroller methods.

[0016] It should be understood that, although the terms "first", "second", etc. may be used herein to describe various units, these units should not be limited by these terms. These terms are used only to distinguish one unit from another unit. For example, without departing from the scope of the exemplary embodiments, the first unit may be referred to as the second unit, and similarly the second unit may be referred to as the first unit. The term "and / or" used herein includes any and all combinations of one or more of the listed associated items.

[0017] To achieve this, please refer to Figures 1 to 3 The present invention provides a smart stylus interaction method, the method comprising the following steps:

[0018] Step S1: real-time data collection and processing of the touch screen use process of the smart stylus pen is performed through the pressure sensor and the motion sensor to obtain the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen; the posture movement trajectory simulation analysis is performed on the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen using the gyroscope sensor to obtain the posture movement simulation trajectory of the smart stylus pen;

[0019] Step S2: collecting and processing the touch screen change data of the touch screen use process of the smart stylus through the touch screen light sensor and the touch screen distance sensor to obtain the touch screen light change data of the smart stylus tip and the touch screen distance change data of the smart stylus tip; adjusting and analyzing the touch screen sensitivity interval of the smart stylus based on the touch screen light change data of the smart stylus tip and the touch screen distance change data of the smart stylus tip to obtain the touch screen sensitivity dynamic change interval of the smart stylus tip;

[0020] Step S3: updating the interactive distance response of the smart stylus based on the dynamic change interval of the smart stylus pen tip touching the screen to obtain the interactive distance dynamically updated by the smart stylus pen; performing posture sensitive interactive correction on the simulated trajectory of the posture movement of the smart stylus based on the interactive distance dynamically updated by the smart stylus pen to obtain the posture sensitive interactive correction trajectory of the posture movement of the smart stylus;

[0021] Step S4: transmitting the intelligent stylus posture sensitive interactive correction trajectory to the gesture recognition interaction processor through wireless transmission technology; performing gesture trajectory pattern matching on the intelligent stylus posture sensitive interactive correction trajectory through the gesture trajectory template preset in the gesture recognition interaction processor to obtain the intelligent stylus gesture trajectory matching result; performing interactive command response processing on the intelligent stylus according to the intelligent stylus gesture trajectory matching result to generate the intelligent stylus interactive command to execute the corresponding intelligent stylus interactive operation.

[0022] In the embodiment of the present invention, please refer to Figure 1 FIG. 1 is a schematic diagram of a flow chart of the steps of the smart stylus pen interaction method of the present invention. In this example, the steps of the smart stylus pen interaction method include:

[0023] Step S1: real-time data collection and processing of the touch screen use process of the smart stylus pen is performed through the pressure sensor and the motion sensor to obtain the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen; the posture movement trajectory simulation analysis is performed on the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen using the gyroscope sensor to obtain the posture movement simulation trajectory of the smart stylus pen;

[0024] The embodiment of the present invention uses a pressure sensor and a motion sensor to collect real-time data on the touch screen usage process of the smart stylus pen, so as to collect real-time pressure changes and real-time movement conditions of the smart stylus pen tip when writing or drawing on the touch screen device (including information such as the moving position, moving angle and moving speed of the smart stylus pen), thereby obtaining real-time pressure sensing data of the smart stylus pen tip and real-time movement status data of the smart stylus pen. At the same time, the position change and angle change data of the smart stylus are extracted from the real-time movement status data of the smart stylus. Secondly, the real-time pressure data of the smart stylus tip and the position change and angle change data of the smart stylus are processed respectively by using a time synchronization algorithm, so as to time-series align the pressure data and the moving position change data or the moving angle change data obtained by real-time monitoring to ensure that they are at the same timestamp, and the pressure data, the moving position change data and the moving angle change data at the same timestamp are processed respectively by using a gyroscope sensor to capture the moving position change trend and the moving angle change trend of the pressure data of the smart stylus tip in three directions (including pitch, yaw and roll) in three-dimensional space, and perform analytical calculations on them, so as to obtain the initial situation of the moving position change and the moving angle change of the smart stylus tip in three directions (including X-axis, Y-axis and Z-axis) in three-dimensional space, and then, the abnormality detection algorithm is used for processing to detect the moving position change and the moving angle change trend of the pressure data of the smart stylus tip. The abnormal changes existing in the initial conditions of the mobile position change and the mobile angle change are detected, and the detected abnormal changes are filtered to effectively filter out abnormal data points caused by factors such as environmental interference or equipment failure, and the error is calculated by combining the filtered abnormal changes with the normal changes in the initial conditions of the mobile position change and the mobile angle change to calculate the error value of the abnormal change in the position of the smart stylus pen tip pressure sense in the three coordinate axis directions, and the calculated error value is used to perform corresponding error compensation for the mobile position change and the initial conditions of the mobile angle change of the smart stylus pen tip pressure sense in the three-axis directions, so as to effectively correct the position deviation caused by the abnormal data, and finally, the posture movement of the smart stylus is simulated and analyzed by combining the mobile position change and mobile angle change data obtained after compensation, so as to simulate the posture movement trajectory of the smart stylus during writing or painting on the touch screen device, and finally obtain the simulated trajectory of the posture movement of the smart stylus.

[0025] Step S2: collecting and processing the touch screen change data of the touch screen use process of the smart stylus through the touch screen light sensor and the touch screen distance sensor to obtain the touch screen light change data of the smart stylus tip and the touch screen distance change data of the smart stylus tip; adjusting and analyzing the touch screen sensitivity interval of the smart stylus based on the touch screen light change data of the smart stylus tip and the touch screen distance change data of the smart stylus tip to obtain the touch screen sensitivity dynamic change interval of the smart stylus tip;

[0026] The embodiment of the present invention uses a touch screen light sensor and a touch screen distance sensor to monitor the touch screen usage process of the smart stylus in real time, so as to monitor the light sensitivity change and distance change of the smart stylus on the touch screen device, thereby obtaining the light sensitivity change data of the smart stylus tip touching the screen and the touch screen distance change data of the smart stylus tip touching the screen. Secondly, mathematical statistical methods are used to perform statistical analysis on the touch screen light sensitivity change data of the smart stylus pen tip, so as to statistically analyze and deeply understand the light sensitivity intensity of the smart stylus pen tip at different positions, including the average light sensitivity intensity, change range, frequency distribution, etc., and the touch screen aperture of the smart stylus is processed according to the real-time change of light sensitivity intensity obtained by statistical analysis to adjust the aperture control size of the smart stylus and ensure that it can adapt to touch screen operations under different light sensitivity intensities. Then, the touch screen sensitivity range of the smart stylus is adjusted and analyzed by combining the smart stylus pen aperture adjusted by dynamic control and the touch screen distance change data of the smart stylus pen tip, so as to dynamically adjust the touch screen sensitivity range by comprehensively considering the influence of aperture control and distance change on the interactive sensitivity performance of the stylus, so as to adapt to different aperture control and distance change conditions, and finally obtain the dynamic change range of touch screen sensitivity of the smart stylus pen tip.

[0027] Step S3: updating the interactive distance response of the smart stylus based on the dynamic change interval of the smart stylus pen tip touching the screen to obtain the interactive distance dynamically updated by the smart stylus pen; performing posture sensitive interactive correction on the simulated trajectory of the posture movement of the smart stylus based on the interactive distance dynamically updated by the smart stylus pen to obtain the posture sensitive interactive correction trajectory of the posture movement of the smart stylus;

[0028] The embodiment of the present invention monitors and analyzes the touch screen sensitivity dynamic change interval of the smart stylus pen tip to monitor the touch screen sensitivity area range interval of the smart stylus pen tip in real time, and dynamically responds and updates the interaction distance of the smart stylus according to the monitoring results to ensure that it can accurately respond to the operation of the smart stylus, thereby obtaining the smart stylus dynamic response update interaction distance. Secondly, the specific movement process of the smart stylus posture movement simulation trajectory is monitored by using a trajectory change monitoring algorithm to monitor and obtain the real-time movement trajectory changes of the user when using the smart stylus, and the dynamic change trajectory of the smart stylus posture movement is divided into interaction areas according to the constantly changing smart stylus dynamic response update interaction distance, so as to divide the posture movement trajectory into different interaction areas by considering the size and position of the interaction area, and then, the sensitivity of each movement trajectory interaction area is statistically calculated to statistically calculate the sensitivity of each movement trajectory interaction area, and judged according to the preset sensitivity standard threshold to judge. An insensitive interaction area in the mobile trajectory interaction area is calculated by using a mathematical statistical method to perform sensitive interaction correction calculation on the insensitive interaction area, so as to effectively adjust the interaction sensitivity of the interaction area according to the characteristics of the interaction area and the user's operating habits, thereby determining the sensitivity correction threshold of the corresponding interaction area, and using the calculated sensitivity correction threshold of the mobile trajectory interaction area to perform response correction on the corresponding insensitive interaction area in the intelligent stylus gesture movement simulation trajectory, so as to correct the interaction sensitivity and interaction response speed of the adjustment trajectory, and ensure the accuracy and fluency of the user's operation, and finally obtain the intelligent stylus gesture movement sensitive interaction correction trajectory.

[0029] Step S4: transmitting the intelligent stylus posture sensitive interactive correction trajectory to the gesture recognition interaction processor through wireless transmission technology; performing gesture trajectory pattern matching on the intelligent stylus posture sensitive interactive correction trajectory through the gesture trajectory template preset in the gesture recognition interaction processor to obtain the intelligent stylus gesture trajectory matching result; performing interactive command response processing on the intelligent stylus according to the intelligent stylus gesture trajectory matching result to generate the intelligent stylus interactive command to execute the corresponding intelligent stylus interactive operation.

[0030] The embodiment of the present invention establishes a corresponding data transmission channel by using corresponding wireless transmission technology (such as Wi-Fi, Bluetooth, etc.) and ensures the stability and reliability of the transmission channel, and then uses the established data transmission channel to package and transmit the corrected smart stylus gesture movement sensitive interaction correction trajectory in a predetermined format, so as to transmit it to the gesture recognition interaction processor. Secondly, the received smart stylus gesture movement sensitive interaction correction trajectory is parsed and pattern analyzed by the gesture recognition interaction processor to convert the smart stylus gesture movement sensitive interaction correction trajectory into a recognizable gesture trajectory pattern, including gesture shape, speed, direction and other pattern information, and the gesture trajectory pattern corresponding to the smart stylus gesture trajectory pattern data is statistically calculated with the gesture trajectory template preset in the gesture recognition interaction processor by using corresponding mathematical statistical methods (such as cosine similarity or dynamic time warping, etc.) to evaluate and determine the similarity between the user's gesture trajectory pattern and the preset gesture trajectory template, and then, a matching analysis is performed based on the similarity between the smart stylus gesture trajectory pattern and the gesture trajectory template to determine the similarity between the user's gesture trajectory pattern and the preset gesture trajectory template. A preset similarity measurement threshold is used to compare and judge them. If the corresponding similarity measurement degrees are greater than or equal to the preset similarity measurement threshold and the corresponding similarity degree is the maximum, the corresponding gesture trajectory pattern in the gesture trajectory template is determined as the user's actual gesture behavior, and it is determined to be a successful match, otherwise it is determined to be a failed match. At the same time, the matching result generated by the judgment and analysis matching is generated, and the corresponding interactive command response is performed through the smart stylus based on the judgment result to generate corresponding interactive control instructions (including vibration prompt interaction instructions (that is, gesture matching is successful) and gesture operation interaction instructions (that is, gesture matching fails)), so as to execute corresponding smart stylus interactive operations, such as triggering the vibration prompt function, clicking, double-clicking, long pressing, sliding and other interactive operations.

[0031] The present invention firstly uses pressure sensors and motion sensors to collect and process real-time data of the touch screen use process of the smart stylus, thereby obtaining real-time data on the pressure status of the smart stylus tip and information such as the position and movement speed of the smart stylus. These real-time data can reflect the changes in the pressure of the smart stylus tip and the changes in the movement of the smart stylus when the user writes or draws on the touch screen device, thereby providing basic data guarantee for the subsequent posture movement trajectory analysis. At the same time, by using a gyroscope sensor to simulate the posture movement trajectory analysis of the real-time pressure data of the smart stylus tip and the real-time movement position change data of the smart stylus, the posture movement trajectory or movement change of the smart stylus in a three-axis manner during the writing or drawing process on the touch screen device can be simulated. These simulated trajectory data can accurately reflect the user's writing or drawing actions, thereby providing a more realistic and intelligent interactive experience for the application of the smart stylus. Secondly, by using the touch screen light sensor and the touch screen distance sensor to collect the change data of the smart stylus on the touch screen, including the light sense and distance changes of the pen tip, and by analyzing these data to adjust the sensitive interval of the touch screen, the dynamic change interval of the touch screen sensitivity of the pen tip of the smart stylus is obtained. The key to this step is to be able to comprehensively consider the changes in light intensity control and the changes in touch screen distance, and dynamically adjust the touch screen sensitivity of the smart stylus to ensure that the sensitivity under different operating conditions can be effectively maintained and adjusted. Through the analysis of sensitive interval adjustment, the adaptability and user experience of the smart stylus in different usage scenarios can be improved, thereby providing users with a more comfortable and convenient touch screen interactive operation experience. Then, by combining the dynamic change interval of the touch screen sensitivity of the smart stylus tip to update the interactive distance response of the smart stylus, the dynamic response of the smart stylus can be realized, so that it can be adjusted in real time according to the user's operating habits and environmental changes, thereby providing a more flexible and accurate interactive experience. The key to this step is to use the data of the sensitive dynamic change interval to update the response mechanism of the stylus to adapt to the operation requirements at different distances, thereby improving the user's interactive operation comfort and efficiency. Subsequently, the interactive response of the simulated trajectory of the intelligent stylus gesture movement is corrected by combining the dynamic response of the intelligent stylus to update the interactive distance. The purpose of this step is to effectively correct the user's gesture movement trajectory according to the interactive distance of the intelligent stylus on the touch screen operation and environmental changes, so as to ensure the response sensitivity and accuracy of the stylus in different interactive scenarios. By generating a sensitive interactive correction trajectory for gesture movement, the stylus can achieve optimized response in various interactive environments, thereby providing a smoother and more natural interactive experience.Finally, by using wireless transmission technology to transmit the posture movement sensitive interactive correction trajectory of the smart stylus to the gesture recognition interactive processor, seamless communication between the corresponding sensor of the smart stylus and the gesture recognition interactive processor can be achieved. The key to this step is to transmit the posture movement correction trajectory recorded by the stylus sensor to the processor through wireless transmission technology, which provides the necessary data basis for subsequent gesture recognition and interactive instruction generation, thereby enhancing the interactive function and flexibility of the smart stylus. In addition, the gesture trajectory pattern of the posture movement sensitive interactive correction trajectory of the smart stylus is matched by using the gesture trajectory template preset in the gesture recognition interactive processor. The key to this step is to match the gesture pattern recorded by the stylus with the preset template by analyzing the similarity measurement degree between the gesture trajectory template and the gesture trajectory pattern of the posture movement sensitive interactive correction trajectory of the smart stylus, so as to accurately identify the actual gesture behavior of the user and provide an accurate basis for the subsequent interactive instruction generation and execution, thereby realizing the precise interactive function of the smart stylus. By processing the interactive command response of the smart stylus according to the gesture trajectory matching results of the smart stylus, the purpose of this step is to perform real-time interactive command response processing on the stylus according to the gesture matching results, generate corresponding operation instructions to meet the user's interactive needs, and realize the execution of diversified interactive control functions of the smart stylus, thereby providing users with a more convenient and intelligent interactive experience.

[0032] Preferably, step S1 comprises the following steps:

[0033] Step S11: using a pressure sensor to collect the pen tip pressure data in real time during the touch screen use process of the smart stylus pen, so as to obtain the real-time pressure data of the pen tip of the smart stylus pen;

[0034] Step S12: collecting the movement status data of the smart stylus pen during the touch screen use process in real time through the mobile sensor to obtain the real-time movement status data of the smart stylus pen;

[0035] Step S13: extracting and processing the moving position and angle change data of the real-time moving status data of the smart stylus pen to obtain the real-time moving position change data of the smart stylus pen and the real-time moving angle change data of the smart stylus pen;

[0036] Step S14: using a gyroscope sensor to perform three-axis movement position change detection on the real-time pressure sensing data of the smart stylus pen tip and the real-time movement position change data of the smart stylus pen, to obtain the pressure sensing three-axis movement position change data of the smart stylus pen tip;

[0037] Step S15: using a gyroscope sensor to perform three-axis movement angle change detection on the real-time pressure sensing data of the smart stylus pen tip and the real-time movement angle change data of the smart stylus pen, to obtain the three-axis movement angle change data of the smart stylus pen tip pressure sensing;

[0038] Step S16: performing posture movement trajectory simulation analysis on the smart stylus pen tip pressure-sensitive three-axis movement position change data and the smart stylus pen tip pressure-sensitive three-axis movement angle change data to obtain the smart stylus pen posture movement simulation trajectory.

[0039] As an embodiment of the present invention, refer to Figure 2 As shown, Figure 1 Detailed step flow diagram of step S1 in FIG. 1 , in this embodiment, step S1 includes the following steps:

[0040] Step S11: using a pressure sensor to collect the pen tip pressure data in real time during the touch screen use process of the smart stylus pen, so as to obtain the real-time pressure data of the pen tip of the smart stylus pen;

[0041] The embodiment of the present invention uses a pressure sensor to collect the pressure sense of the pen tip in real time during the touch screen use process of the smart stylus, so as to collect the pressure changes of the pen tip of the smart stylus when writing or drawing on the touch screen device in real time, and accurately capture the user's writing or drawing behavior in terms of pressure sense, and finally obtain the real-time pressure sense data of the smart stylus pen tip.

[0042] Step S12: collecting the movement status data of the smart stylus pen during the touch screen use process in real time through the mobile sensor to obtain the real-time movement status data of the smart stylus pen;

[0043] The embodiment of the present invention uses a mobile sensor to monitor the movement status of the smart stylus in real time during the touch screen use process, so as to collect the real-time movement status of the smart stylus, including information such as the moving position, moving angle and moving speed of the smart stylus, and accurately record the user's writing or drawing movement actions on the touch screen device, and finally obtain the real-time movement status data of the smart stylus.

[0044] Step S13: extracting and processing the moving position and angle change data of the real-time moving status data of the smart stylus pen to obtain the real-time moving position change data of the smart stylus pen and the real-time moving angle change data of the smart stylus pen;

[0045] The embodiment of the present invention extracts corresponding change data of the real-time movement status data of the smart stylus to extract the position change and angle change data of the smart stylus, and enables it to reflect information such as the movement position and tilt angle change of the smart stylus when the user writes or draws on the touch screen device, and finally obtains the real-time movement position change data of the smart stylus and the real-time movement angle change data of the smart stylus.

[0046] Step S14: using a gyroscope sensor to perform three-axis movement position change detection on the real-time pressure sensing data of the smart stylus pen tip and the real-time movement position change data of the smart stylus pen, to obtain the pressure sensing three-axis movement position change data of the smart stylus pen tip;

[0047] The embodiment of the present invention processes the real-time pressure sensing data of the smart stylus pen tip and the real-time mobile position change data of the smart stylus pen by using a time synchronization algorithm, so as to perform time sequence alignment on the pressure sensing data and the mobile position change data obtained by real-time monitoring, and ensure that they are at the same timestamp, thereby achieving accurate matching and consistency of the pressure sensing data and the mobile position change data in time sequence, and processes the pressure sensing data and the mobile position change data at the same timestamp by using a gyroscope sensor, so as to capture the mobile position change trend of the pressure sensing data of the smart stylus pen tip in three directions (including pitch, yaw and roll) in three-dimensional space, and performs analytical calculation on the data, so as to obtain the initial mobile position change of the smart stylus pen tip in three directions (including X-axis, Y-axis and Z-axis) in three-dimensional space. Initial situation, secondly, by using an abnormality detection algorithm for processing, to detect abnormal changes in the initial situation of mobile position change, and filtering the detected abnormal changes to effectively filter out abnormal data points caused by factors such as environmental interference or equipment failure, and then, by combining the filtered abnormal changes with the normal changes in the initial situation of mobile position change, error accounting is performed to calculate the error value of the abnormal change in the position of the smart stylus pen tip pressure sensitivity in the three coordinate axis directions, and by using the calculated error value, the initial situation of the mobile position change of the smart stylus pen tip pressure sensitivity in the three-axis directions is compensated for the corresponding error, so as to effectively correct the position deviation caused by the abnormal data, and finally the three-axis mobile position change data of the smart stylus pen tip pressure sensitivity is obtained.

[0048] Step S15: using a gyroscope sensor to perform three-axis movement angle change detection on the real-time pressure sensing data of the smart stylus pen tip and the real-time movement angle change data of the smart stylus pen, to obtain the three-axis movement angle change data of the smart stylus pen tip pressure sensing;

[0049] The embodiment of the present invention processes the real-time pressure sensing data of the smart stylus pen tip and the real-time movement angle change data of the smart stylus pen by using a time synchronization algorithm, so as to perform time sequence alignment on the pressure sensing data and the movement angle change data obtained by real-time monitoring, and ensure that they are at the same timestamp, thereby achieving accurate matching and consistency of the pressure sensing data and the movement angle change data in time sequence, and processes the pressure sensing data and the movement angle change data at the same timestamp by using a gyroscope sensor, so as to capture the movement angle change trend of the pressure sensing data of the smart stylus pen tip in three directions (including pitch, yaw and roll) in three-dimensional space, and performs analytical calculation on the data, so as to obtain the initial movement angle change of the smart stylus pen tip in three directions (including X-axis, Y-axis and Z-axis) in three-dimensional space. Initial situation, secondly, by using an abnormality detection algorithm for processing, to detect abnormal changes in the initial situation of the movement angle change, and filtering the detected abnormal changes, so as to effectively filter out abnormal data points caused by factors such as environmental interference or equipment failure, and then, by combining the filtered abnormal changes with the normal changes in the initial situation of the movement angle change, error accounting is performed to calculate the error value of the abnormal change in the angle of the smart stylus pen tip pressure sensitivity in the three coordinate axis directions, and by using the calculated error value, the initial situation of the movement angle change of the smart stylus pen tip pressure sensitivity in the three-axis directions is compensated for the corresponding error, so as to effectively correct the angle deviation caused by the abnormal data, and finally the three-axis movement angle change data of the smart stylus pen tip pressure sensitivity is obtained.

[0050] Step S16: performing posture movement trajectory simulation analysis on the smart stylus pen tip pressure-sensitive three-axis movement position change data and the smart stylus pen tip pressure-sensitive three-axis movement angle change data to obtain the smart stylus pen posture movement simulation trajectory.

[0051] The embodiment of the present invention simulates and analyzes the posture movement of the smart stylus by combining the pressure-sensitive three-axis movement position change data of the smart stylus tip and the pressure-sensitive three-axis movement angle change data of the smart stylus tip, so as to simulate the posture movement trajectory of the smart stylus during writing or drawing on the touch screen device, and finally obtain the simulated posture movement trajectory of the smart stylus.

[0052] The present invention firstly collects the pen tip pressure data of the touch screen use process of the smart stylus in real time by using a pressure sensor, so as to obtain real-time smart stylus pen tip pressure status data, which can reflect the change of the pen tip pressure of the smart stylus when the user writes or draws on the touch screen device. These real-time data are helpful to accurately capture the user's writing or drawing behavior in terms of pressure, thereby providing basic data guarantee for the subsequent posture movement trajectory analysis. At the same time, by using a mobile sensor to collect the mobile status data of the touch screen use process of the smart stylus in real time, including information such as the position and movement speed of the smart stylus, these real-time data can accurately record the user's writing or painting movement on the touch screen device, thereby providing key data support for the subsequent posture movement trajectory simulation. Secondly, by extracting and processing the mobile position and angle change data of the real-time mobile status data of the smart stylus, the position change and angle change data of the smart stylus are extracted, which can reflect the mobile position and tilt angle change of the pen when the user writes or draws on the touch screen device, thereby providing a more detailed and accurate data basis for the subsequent posture movement trajectory analysis. Then, by using the gyroscope sensor to perform three-axis movement position change detection on the real-time pressure data of the smart stylus pen tip and the real-time movement position change data of the smart stylus pen, the movement position change of the pen tip pressure in three directions in three-dimensional space can be obtained. These data can more comprehensively describe the movement position change of the pen when the user writes or draws on the touch screen device, thereby providing more detailed data support for the simulation analysis of the posture movement trajectory. Next, by using the gyroscope sensor to perform three-axis movement angle change detection on the real-time pressure data of the smart stylus pen tip and the real-time movement angle change data of the smart stylus pen tip, the angle change data of the pen tip pressure in three directions in three-dimensional space can be obtained. These data can more comprehensively describe the change of the tilt angle of the pen when the user writes or draws on the touch screen device, thereby providing more accurate data support for the simulation analysis of the posture movement trajectory. Finally, by simulating and analyzing the posture movement trajectory of the smart stylus pen tip pressure-sensitive three-axis movement position change data and the smart stylus pen tip pressure-sensitive three-axis movement angle change data, the posture movement trajectory of the smart stylus pen during writing or drawing on the touch screen device can be simulated. These simulated trajectory data can accurately reflect the user's writing or drawing movements, thereby providing a more realistic and intelligent interactive experience for the application of the smart stylus pen.

[0053] Preferably, step S14 comprises the following steps:

[0054] Step S141: performing timing synchronization alignment processing on the real-time pressure sensing data of the smart stylus pen tip and the real-time moving position change data of the smart stylus pen to obtain the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus moving position change timing synchronization data;

[0055] Step S142: using a gyroscope sensor to perform three-axis position change analysis and calculation on the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus pen movement position change timing synchronization data, to obtain the smart stylus pen tip pressure sensing three-axis position initial change data;

[0056] Step S143: performing abnormal change filtering processing on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip;

[0057] Step S144: performing abnormal error calculation on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip based on the abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain an abnormal change error value of the pressure-sensitive three-axis position of the smart stylus pen tip;

[0058] Step S145: performing error compensation on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip according to the abnormal change error value of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain the pressure-sensitive three-axis movement position change data of the smart stylus pen tip.

[0059] As an embodiment of the present invention, refer to Figure 3 As shown, Figure 2 Detailed step flow diagram of step S14 in the embodiment, step S14 includes the following steps:

[0060] Step S141: performing timing synchronization alignment processing on the real-time pressure sensing data of the smart stylus pen tip and the real-time moving position change data of the smart stylus pen to obtain the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus moving position change timing synchronization data;

[0061] The embodiment of the present invention processes the real-time pressure-sensing data of the smart stylus pen tip and the real-time moving position change data of the smart stylus pen by using a time synchronization algorithm, so as to perform time alignment on the pressure-sensing data and the moving position change data obtained by real-time monitoring, and ensure that they are at the same timestamp, thereby achieving accurate matching and consistency of the pressure-sensing data and the moving position change data in time sequence, and finally obtaining the smart stylus pen tip pressure-sensing timing synchronization data and the smart stylus moving position change timing synchronization data.

[0062] Step S142: using a gyroscope sensor to perform three-axis position change analysis and calculation on the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus pen movement position change timing synchronization data, to obtain the smart stylus pen tip pressure sensing three-axis position initial change data;

[0063] The embodiment of the present invention processes the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus pen movement position change timing synchronization data by using a gyroscope sensor to capture the movement position change trend of the smart stylus pen tip pressure sensing data in three directions (including pitch, yaw and roll) in three-dimensional space, and performs analytical calculations on the data, thereby obtaining the movement position change of the smart stylus pen tip in three directions (including X-axis, Y-axis and Z-axis) in three-dimensional space, and finally obtaining the initial change data of the smart stylus pen tip pressure sensing three-axis position.

[0064] Step S143: performing abnormal change filtering processing on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip;

[0065] The embodiment of the present invention processes the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip by using an abnormality detection algorithm to detect abnormal changes in the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip, and filters the detected abnormal changes to effectively filter out abnormal data points caused by factors such as environmental interference or equipment failure, and finally obtains the abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip.

[0066] Step S144: performing abnormal error calculation on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip based on the abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain an abnormal change error value of the pressure-sensitive three-axis position of the smart stylus pen tip;

[0067] The embodiment of the present invention performs error calculation by combining the abnormal change data of the three-axis position of the pressure sensitivity of the smart stylus pen tip with the normal change in the initial change data of the three-axis position of the pressure sensitivity of the smart stylus pen tip to calculate the error value of the abnormal change in the position of the pressure sensitivity of the smart stylus pen tip in the three coordinate axis directions, thereby evaluating the impact of the abnormal change on its position change data, and finally obtaining the error value of the abnormal change in the three-axis position of the pressure sensitivity of the smart stylus pen tip.

[0068] Step S145: performing error compensation on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip according to the abnormal change error value of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain the pressure-sensitive three-axis movement position change data of the smart stylus pen tip.

[0069] The embodiment of the present invention uses the calculated abnormal change error value of the pressure-sensitive three-axis position of the smart stylus pen tip to perform corresponding error compensation on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip, so as to effectively correct the position deviation caused by the abnormal data and enable it to more accurately perceive the user's writing or drawing actions, and finally obtain the pressure-sensitive three-axis movement position change data of the smart stylus pen tip.

[0070] The present invention firstly performs time-series synchronization and alignment processing on the real-time pressure sensing data of the smart stylus pen tip and the real-time moving position change data of the smart stylus pen, so as to achieve accurate matching and consistency of the data in time sequence. The key of this step is to ensure that the information of different data sources can completely correspond in time, so as to provide reliable basic data guarantee for subsequent data processing and analysis. By realizing the time-series synchronization of the pressure sensing and moving position data of the smart stylus pen tip, accurate time marking can be provided for subsequent data analysis and exception handling, thereby improving the overall performance and user experience of the smart stylus pen. Secondly, by using a gyroscope sensor to perform three-axis position change analysis and calculation on the smart stylus pen tip pressure sensing time-series synchronization data and the smart stylus moving position change time-series synchronization data, it is possible to achieve accurate tracking and positioning of the pen tip pressure sensing position change, and can also accurately capture the pen tip in three directions in three-dimensional space. The moving position change provides an important basis for subsequent data processing and analysis. The realization of this step enables the smart stylus to more accurately perceive the user's writing or painting actions, and improves the accuracy and fluency of writing and painting. Then, by performing abnormal change filtering processing on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip, it is possible to effectively filter and process the abnormal changes that occur in the pressure-sensitive three-axis position change situation, thereby improving the reliability and stability of the data. The abnormal change filtering processing can effectively filter out abnormal data points caused by factors such as environmental interference or equipment failure, thereby ensuring the accuracy and reliability of the data, thereby improving the use stability and reliability of the smart stylus during the three-axis position change monitoring. Next, by combining the abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip with the abnormal error calculation of the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip, the abnormal change error value is obtained. The key to this step is that by calculating the error between the abnormal change data and the normal change in the initial change data, the degree of influence of the abnormal change on the data can be accurately evaluated, providing an important basis for subsequent error compensation. By calculating the abnormal error, the abnormal data can be processed more accurately, thereby improving the accuracy and efficiency of data processing. Finally, by using the error value of the abnormal change of the pressure-sensitive three-axis position of the smart stylus tip to compensate for the error of the initial change data of the pressure-sensitive three-axis position of the smart stylus tip, the implementation of this step enables the smart stylus to more accurately perceive the user's writing or drawing movements, improving the accuracy and fluency of writing and drawing. Through error compensation, the position deviation caused by abnormal data can be effectively corrected, thereby improving the overall performance and user experience of the smart stylus.

[0071] Preferably, step S142 includes the following steps:

[0072] Using a gyroscope sensor to perform three-axis spatial coordinate system mapping processing on the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus movement position change timing synchronization data, to obtain the smart stylus pen tip pressure sensing three-axis position change spatial coordinate system;

[0073] The embodiment of the present invention uses a gyroscope sensor to map the smart stylus pen tip pressure sensitivity timing synchronization data and the smart stylus pen movement position change timing synchronization data at the same timestamp, so as to map the corresponding pressure sensitivity change data and movement position change data to a unified spatial coordinate system, and ensure that the position change of the pen tip pressure sensitivity can be captured more accurately, and finally obtain the smart stylus pen tip pressure sensitivity three-axis position change spatial coordinate system.

[0074] Preferably, the pitch position change detection is performed on the pressure-sensitive three-axis position change space coordinate system of the smart stylus pen tip to obtain the pressure-sensitive pitch position change data of the smart stylus pen tip;

[0075] The embodiment of the present invention detects the pitch position change of the pressure sensitivity of the smart stylus pen tip in the spatial coordinate system by rotating the data points in the three-axis position change of the smart stylus pen tip around the pitch direction (i.e., the X-axis) to detect the pitch position change of the pressure sensitivity of the smart stylus pen tip in the spatial coordinate system, and accurately captures the moving position change trend of the pressure sensitivity of the smart stylus pen tip in the Z-axis direction, thereby obtaining the position change of the smart stylus pen when writing or drawing at the pitch angle, and finally obtaining the pitch position change data of the pressure sensitivity of the smart stylus pen tip.

[0076] Preferably, the yaw position change detection is performed on the pressure-sensitive three-axis position change space coordinate system of the smart stylus pen tip to obtain the pressure-sensitive yaw position change data of the smart stylus pen tip;

[0077] The embodiment of the present invention detects the yaw position change of the pressure sensitivity of the smart stylus pen tip in the spatial coordinate system by rotating the data points in the three-axis position change of the smart stylus pen tip around the yaw direction (i.e., the Y-axis) to detect the yaw position change of the pressure sensitivity of the smart stylus pen tip in the spatial coordinate system, and accurately captures the movement position change trend of the pressure sensitivity of the smart stylus pen tip in the X-axis direction, thereby obtaining the position change of the smart stylus pen when writing or drawing at the yaw angle, and finally obtaining the yaw position change data of the pressure sensitivity of the smart stylus pen tip.

[0078] Preferably, a rolling position change detection is performed on the pressure-sensitive three-axis position change space coordinate system of the smart stylus pen tip to obtain the pressure-sensitive rolling position change data of the smart stylus pen tip;

[0079] The embodiment of the present invention detects the rolling position change of the pressure sensitivity of the smart stylus pen tip in the spatial coordinate system by rotating the data points in the three-axis position change of the smart stylus pen tip around the rolling direction (i.e., the Z-axis) to detect the rolling position change of the pressure sensitivity of the smart stylus pen tip in the spatial coordinate system, and accurately captures the moving position change trend of the pressure sensitivity of the smart stylus pen tip in the Y-axis direction, thereby obtaining the position change of the smart stylus pen when writing or drawing at the rolling angle, and finally obtaining the rolling position change data of the pressure sensitivity of the smart stylus pen tip.

[0080] Preferably, three-axis position change analysis and calculation are performed on the pressure-sensitive pitch position change data of the smart stylus pen tip, the pressure-sensitive roll position change data of the smart stylus pen tip and the pressure-sensitive yaw position change data of the smart stylus pen tip respectively to obtain the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip.

[0081] The embodiment of the present invention analyzes and calculates the detected pressure-sensitive pitch position change data of the smart stylus pen tip, the pressure-sensitive roll position change data of the smart stylus pen tip, and the pressure-sensitive yaw position change data of the smart stylus pen tip, so as to analyze and capture the movement position change of the smart stylus pen tip in three directions in three-dimensional space, and finally obtain the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip.

[0082] The present invention first uses a gyroscope sensor to perform three-axis spatial coordinate system mapping processing on the smart stylus pen tip pressure sense timing synchronization data and the smart stylus movement position change timing synchronization data, so as to realize the mapping of the corresponding data to a unified spatial coordinate system. This processing process can ensure that the data from different data sources can be accurately aligned in space, providing an accurate basis for subsequent data analysis and processing. By mapping the data to a unified spatial coordinate system, the position change of the pen tip pressure sense can be captured more accurately, thereby providing a reliable basis for subsequent data analysis and processing. Secondly, by detecting the pitch position change of the smart stylus pen tip pressure sense three-axis position change spatial coordinate system, the pen tip pressure sense pitch position change data can be obtained. By detecting the pitch position change of the pen tip pressure sense in the spatial coordinate system, the change trend of the pen tip pressure sense in the vertical direction can be accurately captured. The implementation of this step can obtain the position change of the smart stylus pen when writing or drawing at the pitch angle, thereby providing important information for subsequent data processing and analysis. Then, the yaw position change detection is performed on the three-axis position change of the pressure-sensitive pen tip of the smart stylus to obtain the yaw position change data of the pressure-sensitive pen tip. By detecting the yaw position change of the pressure-sensitive pen tip in the spatial coordinate system, the change trend of the pen tip in the horizontal direction can be accurately captured. The implementation of this step can obtain the position change of the smart stylus when writing or drawing in the yaw direction, thereby providing important information for subsequent data processing and analysis. Next, the roll position change detection is performed on the three-axis position change of the pressure-sensitive pen tip of the smart stylus to obtain the roll position change data of the pressure-sensitive pen tip. By detecting the roll position change of the pen tip in the spatial coordinate system, the rotation change trend of the pen tip in the horizontal direction can be accurately captured. The implementation of this step can obtain the position change of the smart stylus when writing or drawing at the roll angle, thereby providing important information for subsequent data processing and analysis. Finally, by performing three-axis position change analysis and calculation on the position change data of the smart stylus pen tip in the pitch, yaw and roll directions, the initial three-axis position change data of the pen tip pressure sensitivity can be obtained. The implementation of this step can accurately analyze and calculate the position change of the pen tip in space, and can also accurately capture the movement position changes of the pen tip in three directions in three-dimensional space, thereby providing an important foundation for subsequent data processing and analysis.

[0083] Preferably, step S16 comprises the following steps:

[0084] Step S161: performing a moving position characteristic analysis on the pressure-sensitive three-axis moving position change data of the smart stylus pen tip to obtain the pressure-sensitive three-axis moving position characteristic data of the smart stylus pen tip;

[0085] The embodiment of the present invention analyzes the three-axis movement position change data of the pressure sensitivity of the smart stylus pen tip by using a position feature analysis method to analyze the movement distance, speed, acceleration and other characteristics of the pressure sensitivity of the smart stylus pen tip in the three-axis directions, and combines the above features to deeply understand the pressure sensitivity changes of the smart stylus pen tip at different positions, thereby revealing the characteristics of the pen tip during movement, such as the change trend, peak value and valley value of the pressure sensitivity, and finally obtaining the three-axis movement position feature data of the pressure sensitivity of the smart stylus pen tip.

[0086] Step S162: performing feature point set sampling processing on the pressure-sensitive three-axis moving position feature data of the smart stylus pen tip to obtain a pressure-sensitive three-axis moving position feature point set of the smart stylus pen tip;

[0087] The embodiment of the present invention processes the pressure-sensitive three-axis movement position feature data of the smart stylus pen tip by using a corresponding feature point set sampling method (including sliding windows, clustering algorithms and other technologies) to extract representative feature points from the original data, and compose them into a feature point set, thereby finally obtaining the pressure-sensitive three-axis movement position feature point set of the smart stylus pen tip.

[0088] Step S163: performing movement angle characteristic analysis on the pressure-sensitive three-axis movement angle change data of the smart stylus pen tip to obtain the pressure-sensitive three-axis movement angle characteristic data of the smart stylus pen tip;

[0089] The embodiment of the present invention analyzes the three-axis movement angle change data of the pressure-sensitive pen tip of the smart stylus by using an angle feature analysis method to analyze the rotation angle, angular velocity, angular acceleration and other characteristics of the pressure-sensitive pen tip of the smart stylus in the three-axis directions, and combines the above features to deeply understand the angle changes of the smart stylus pen tip at different positions, such as the change trends of the pitch, yaw and roll angles, and finally obtains the three-axis movement angle feature data of the pressure-sensitive pen tip of the smart stylus.

[0090] Step S164: performing feature point set sampling processing on the pressure-sensitive three-axis movement angle feature data of the smart stylus pen tip to obtain a feature point set of the pressure-sensitive three-axis movement angle of the smart stylus pen tip;

[0091] The embodiment of the present invention processes the pressure-sensitive three-axis movement angle feature data of the smart stylus pen tip by using a corresponding feature point set sampling method (including sliding windows, clustering algorithms and other technologies) to extract representative feature points from the original data, and compose them into a feature point set, thereby finally obtaining the pressure-sensitive three-axis movement angle feature point set of the smart stylus pen tip.

[0092] Step S165: performing posture movement trajectory simulation analysis based on the smart stylus pen tip pressure-sensitive three-axis movement position feature point set and the smart stylus pen tip pressure-sensitive three-axis movement angle feature point set to obtain the smart stylus pen posture movement simulation trajectory.

[0093] The embodiment of the present invention performs simulation analysis by combining the position feature point set of the pressure-sensitive three-axis movement of the smart stylus pen tip and the angle feature point set of the pressure-sensitive three-axis movement of the smart stylus pen tip to combine the position feature points and the angle feature points, and simulates the movement trajectory of the smart stylus in the three-dimensional simulation space through interpolation, fitting and other methods, and finally obtains the simulated trajectory of the smart stylus posture movement.

[0094] The present invention firstly analyzes the moving position characteristics of the pressure-sensitive three-axis moving position change data of the smart stylus pen tip, and can deeply understand the pressure-sensitive changes of the pen tip at different positions. This analysis can reveal the characteristics of the pen tip during movement, such as the pressure-sensitive change trend, peak and valley values, etc., and provides important information for subsequent data processing and simulation analysis. By obtaining the pressure-sensitive three-axis moving position characteristic data of the smart stylus pen tip, the user's writing or painting actions can be simulated more accurately, and the authenticity and accuracy of the simulation results are improved. Secondly, based on the moving position characteristic analysis, the pressure-sensitive three-axis moving position characteristic data is sampled and processed by a feature point set. The key to this step is that the most representative feature points can be extracted from a large amount of data through the sampling processing of the feature point set, thereby providing simplification and optimization for subsequent data analysis and simulation processing. By obtaining the feature point set, the moving characteristics of the smart stylus at different positions can be more effectively described, thereby improving the accuracy and efficiency of the posture movement trajectory simulation. Then, by performing a moving angle feature analysis on the pressure-sensitive three-axis moving angle change data of the smart stylus tip, the pressure-sensitive three-axis moving angle feature data of the pen tip is obtained. This analysis process can provide an in-depth understanding of the angle changes of the pen tip during movement, such as the changing trends of pitch, yaw, and roll angles, and can provide an important reference for subsequent data processing and simulation analysis. By obtaining the moving angle feature data, the posture changes of the smart stylus during movement can be more comprehensively described, thereby improving the authenticity and accuracy of the simulation results. Next, based on the moving angle feature analysis, the pressure-sensitive three-axis moving angle feature data is sampled and processed with a feature point set. The key to this step is that through the sampling and processing of the feature point set, the most representative feature points can be extracted from the complex angle change data, which provides simplification and optimization for subsequent data analysis and simulation processing. By obtaining the feature point set, the moving characteristics of the smart stylus at different angles can be more effectively described, thereby improving the accuracy and efficiency of the posture movement trajectory simulation. Finally, by combining the smart stylus pen tip pressure-sensitive three-axis movement position feature point set and the movement angle feature point set to perform posture movement trajectory simulation analysis, the movement trajectory of the smart stylus pen at different positions and angles can be generated, providing users with a more realistic and accurate simulation experience. The implementation of this step enables the smart stylus pen to more accurately simulate the user's actual writing or drawing movements, thereby improving the authenticity and accuracy of the simulation results.

[0095] Preferably, step S2 comprises the following steps:

[0096] Step S21: monitoring the touch screen light sensitivity change during the touch screen use process of the smart stylus pen through the touch screen light sensitivity sensor to obtain the touch screen light sensitivity change data of the smart stylus pen tip;

[0097] The embodiment of the present invention uses a touch screen light sensor to monitor the touch screen usage process of the smart stylus in real time to monitor the light sensitivity changes of the smart stylus on the touch screen device, so that it can better understand the user's operating behavior on the touch screen device, and finally obtain the light sensitivity change data of the smart stylus pen tip on the touch screen.

[0098] Step S22: monitoring the touch screen distance change during the touch screen use process of the smart stylus pen through the touch screen distance sensor to obtain the touch screen distance change data of the smart stylus pen tip;

[0099] The embodiment of the present invention uses a touch screen distance sensor to monitor the touch screen usage process of the smart stylus in real time, so as to monitor and record the change of the distance between the smart stylus and the touch screen device in real time, understand the user's operating posture on the touch screen device, and finally obtain the change data of the touch screen distance of the smart stylus tip.

[0100] Step S23: performing light intensity statistical analysis on the light intensity change data of the smart stylus pen tip touching the screen, to obtain light intensity status data of the smart stylus pen tip touching the screen;

[0101] The embodiment of the present invention uses mathematical statistical methods to perform statistical analysis on the light sensitivity change data of the smart stylus pen tip touching the screen, so as to statistically analyze and deeply understand the light sensitivity intensity of the smart stylus pen tip at different positions, including the average light sensitivity intensity, variation range, frequency distribution, etc., and finally obtain the light sensitivity intensity status data of the smart stylus pen tip touching the screen.

[0102] Step S24: performing touch screen aperture control processing on the smart stylus according to the light intensity status data of the smart stylus pen tip touching the screen, so as to obtain a dynamic control aperture of the smart stylus pen tip touching the screen;

[0103] The embodiment of the present invention processes the touch screen aperture of the smart stylus according to the real-time changes in the light intensity of the touch screen light intensity status data of the smart stylus pen tip, so as to adjust the aperture control size of the smart stylus and ensure that it can adapt to the touch screen operation under different light intensity conditions, and finally obtain the dynamic control aperture of the touch screen of the smart stylus pen tip.

[0104] Step S25: Based on the data of the dynamic control of the aperture of the smart stylus pen tip touching the screen and the change of the distance of the smart stylus pen tip touching the screen, the touch screen sensitivity interval of the smart stylus pen is adjusted and analyzed to obtain the dynamic change interval of the touch screen sensitivity of the smart stylus pen tip.

[0105] The embodiment of the present invention adjusts and analyzes the touch screen sensitivity range of the smart stylus by combining the smart stylus pen tip's touch screen dynamic control aperture and the smart stylus pen tip's touch screen distance change data, so as to dynamically adjust the touch screen sensitivity range by comprehensively considering the impact of aperture control and distance change on the stylus pen's interactive sensitivity performance to adapt to different aperture control and distance change conditions, and finally obtain the smart stylus pen tip's touch screen sensitivity dynamic change range.

[0106] The present invention first monitors the touch screen light sensitivity changes of the smart touch pen during the touch screen use process by using a touch screen light sensor, and can obtain the light sensitivity of the smart touch pen tip at different positions. The key to this step is to monitor the light sensitivity changes of the pen tip in real time through the touch screen light sensor, so as to understand the user's operation on the touch screen and provide basic data for subsequent data analysis and processing. By obtaining the touch screen light sensitivity change data, the user's operation behavior on the touch screen can be better understood, thereby providing an important basis for the sensitivity adjustment of the smart touch pen. Secondly, by using a touch screen distance sensor to monitor the distance change of the smart touch pen on the touch screen, the distance between the smart touch pen tip and the touch screen can be obtained. The key to this step is to monitor the distance change between the pen tip and the touch screen in real time, so as to understand the user's operation posture on the touch screen, and provide important information for subsequent data processing and analysis. By obtaining the touch screen distance change data, the user's interaction with the touch screen can be better grasped, providing basic data support for the sensitivity adjustment of the smart touch pen. Then, by performing a statistical analysis of the light intensity of the touch screen light intensity change data of the smart stylus pen tip, the light intensity status data of the touch screen of the pen tip is obtained. This analysis can provide an in-depth understanding of the light intensity of the pen tip at different positions, providing an important reference for the subsequent aperture control processing. Through the statistical analysis of light intensity, we can better understand the user's operation method on the touch screen, providing an effective basis for the sensitivity adjustment of the smart stylus. Next, by performing touch screen aperture control processing on the smart stylus according to the light intensity status data of the touch screen of the smart stylus pen tip, the dynamic control aperture of the touch screen of the smart stylus pen tip is obtained. The key to this step is to dynamically adjust the aperture size of the smart stylus according to the light intensity data to adapt to the touch screen operation under different light intensities. Through aperture control processing, the sensitivity and accuracy of the smart stylus on the touch screen can be improved, thereby improving the user's operating experience. Finally, the touch screen sensitivity interval adjustment analysis of the smart stylus is performed based on the dynamic control of the aperture and the touch screen distance change data of the smart stylus tip touching the screen, so as to obtain the dynamic change interval of the touch screen sensitivity of the smart stylus tip. The key to this step is to comprehensively consider the aperture control and the touch screen distance change, and dynamically adjust the touch screen sensitivity of the smart stylus to ensure that the sensitivity can be effectively maintained and adjusted under different operating conditions. Through the sensitivity interval adjustment analysis, the adaptability and user experience of the smart stylus in different usage scenarios can be improved, thereby providing users with a more comfortable and convenient touch screen interactive operation experience.

[0107] Preferably, step S25 comprises the following steps:

[0108] Step S251: performing correlation analysis on the data of the dynamic control of the aperture of the smart stylus pen tip touching the screen and the distance change of the smart stylus pen tip touching the screen, to obtain correlation relationship data between the aperture control of the smart stylus pen tip touching the screen and the distance change;

[0109] The embodiment of the present invention first collects relevant data of the dynamic control of the aperture by the smart stylus pen tip touching the screen (including the opening and closing degree of the aperture, the change speed, etc.), and collects data of the change of the distance of the smart stylus pen tip touching the screen (including the change of the distance between the smart stylus pen and the touch-screen device). Then, the collected data is analyzed by using an association rule mining algorithm or a correlation analysis method to explore the correlation relationship between the aperture control and the distance change between the smart stylus pen tip and the touch-screen device, and finally obtains the correlation relationship data between the aperture control and the distance change of the smart stylus pen tip touching the screen.

[0110] Step S252: monitoring the touch screen sensitivity range of the smart stylus pen to obtain the touch screen sensitivity range of the smart stylus pen tip;

[0111] The embodiment of the present invention monitors the touch screen sensitivity range of the smart stylus by using a sensitivity monitoring method, so as to monitor and measure the sensitivity range of the smart stylus on the touch screen device, that is, the effective interactive working area when the tip of the smart stylus touches the screen, and understand the sensitivity performance of the smart stylus at different positions and distances, and finally obtain the touch screen sensitivity range interval of the tip of the smart stylus.

[0112] Step S253: Based on the correlation data between the touch screen aperture control and the distance change of the smart stylus pen tip, the touch screen sensitivity range of the smart stylus pen tip is adjusted and analyzed to obtain the touch screen sensitivity dynamic change range of the smart stylus pen tip.

[0113] The embodiment of the present invention firstly performs an impact assessment analysis on the touch screen sensitivity of the smart stylus pen tip by combining the correlation data between the touch screen aperture control and distance change of the smart stylus pen tip, so as to evaluate the impact correlation relationship between the touch screen aperture control and distance change and the touch screen sensitivity, and dynamically adjusts the touch screen sensitivity range by comprehensively considering the impact of aperture control and distance change on the interactive sensitivity performance of the stylus to adapt to different aperture control and distance change conditions, and finally obtains the dynamic change range of the touch screen sensitivity of the smart stylus pen tip.

[0114] The present invention firstly performs correlation analysis on the dynamic control aperture of the smart stylus pen tip touching the screen and the change data of the distance of the smart stylus pen tip touching the screen, so as to deeply understand the correlation between aperture control and distance change on the performance of the stylus. This analysis process can reveal the correlation pattern between the aperture size and the touch screen distance, thereby providing an important reference for the subsequent touch screen sensitivity adjustment. By performing correlation analysis on the aperture control and distance change data, the performance of the stylus in different usage scenarios can be more accurately grasped, providing an effective basis for improving the user experience. Then, by monitoring the touch screen sensitivity range of the smart stylus, the sensitive range interval of the pen tip on the touch screen can be determined. The key to this step is to understand the sensitivity performance of the stylus at different positions and distances, and provide basic data support for the subsequent sensitivity interval adjustment. By monitoring the touch screen sensitivity range, the working range of the stylus can be better grasped, thereby providing users with a more accurate and reliable touch screen interactive operation experience. Finally, the touch screen sensitivity range of the stylus is dynamically adjusted and analyzed based on the correlation data between aperture control and distance change to obtain the dynamic sensitivity change range of the stylus in different usage situations. The key to this step is to comprehensively consider the impact of aperture control and distance change on the interactive sensitivity performance of the stylus, and dynamically adjust the touch screen sensitivity range to ensure the best touch experience in different usage scenarios. Through the sensitivity range adjustment analysis, the performance of the stylus can be better optimized, and its adaptability and user satisfaction in different scenarios can be improved.

[0115] Preferably, step S3 comprises the following steps:

[0116] Step S31: updating the interactive distance response of the smart stylus based on the dynamic change interval of the smart stylus pen tip touching the screen, so as to obtain the dynamic response updated interactive distance of the smart stylus pen;

[0117] The embodiment of the present invention monitors and analyzes the dynamic change range of the touch screen sensitivity of the smart stylus pen tip to monitor the touch screen sensitivity area range of the smart stylus pen tip in real time, and dynamically responds and updates the interaction distance of the smart stylus according to the monitoring results, ensuring that it can accurately respond to the operation of the smart stylus pen, and finally obtains the dynamic response update interaction distance of the smart stylus.

[0118] Step S32: monitoring the dynamic changes of the simulated trajectory of the intelligent stylus pen posture movement to obtain the dynamic change trajectory of the intelligent stylus pen posture movement;

[0119] The embodiment of the present invention uses a trajectory change monitoring algorithm to monitor the specific movement process of the intelligent stylus pen posture movement simulation trajectory, so as to monitor and obtain the real-time movement trajectory changes of the user when using the intelligent stylus pen, and finally obtain the dynamic change trajectory of the intelligent stylus pen posture movement.

[0120] Step S33: performing interactive area division processing on the dynamic change trajectory of the smart stylus posture movement based on the dynamic response update interactive distance of the smart stylus to obtain the interactive area of ​​the smart stylus posture movement trajectory;

[0121] The embodiment of the present invention divides the interactive area of ​​the dynamic change trajectory of the smart stylus gesture movement by updating the interactive distance according to the constantly changing dynamic response of the smart stylus, so as to divide the gesture movement trajectory into different interactive areas by considering the size and position of the interactive area, and ensure that the user can perform interactive operations accurately, and finally obtain the interactive area of ​​the smart stylus gesture movement trajectory.

[0122] Step S34: performing sensitive interaction correction calculation on the interactive area of ​​the movement trajectory of the smart stylus posture to obtain a sensitive interaction correction threshold of the movement trajectory interactive area;

[0123] The embodiment of the present invention firstly performs statistical calculation of the sensitivity of each intelligent stylus pen posture movement trajectory interaction area to statistically calculate the sensitivity of each intelligent stylus pen posture movement trajectory interaction area, and makes a judgment according to a preset sensitivity standard threshold to determine the insensitive interaction area in the intelligent stylus pen posture movement trajectory interaction area, and at the same time performs a sensitive interaction correction calculation on the insensitive interaction area by using a mathematical statistical method to effectively adjust the interaction sensitivity according to the characteristics of the interaction area and the user's operating habits, thereby determining the sensitivity correction threshold of the corresponding interaction area, and finally obtaining the sensitive interaction correction threshold of the movement trajectory interaction area.

[0124] Step S35: performing trajectory interaction response correction on the intelligent stylus gesture movement simulation trajectory according to the sensitive interaction correction threshold of the movement trajectory interaction area to obtain the intelligent stylus gesture movement sensitive interaction correction trajectory.

[0125] The embodiment of the present invention uses the calculated sensitive interaction correction threshold of the interactive area of ​​the moving trajectory to perform response correction on the corresponding insensitive interaction area in the intelligent stylus gesture movement simulation trajectory, so as to correct the interaction sensitivity and interaction response speed of the adjustment trajectory and ensure the accuracy and smoothness of the user's operation, and finally obtain the sensitive interaction correction trajectory of the intelligent stylus gesture movement.

[0126] The present invention firstly updates the interactive distance response of the smart stylus by combining the sensitive dynamic change interval of the smart stylus tip touching the screen, so as to realize the dynamic response of the smart stylus, so that it can be adjusted in real time according to the user's operating habits and environmental changes, thereby providing a more flexible and accurate interactive experience. The key to this step is to use the data of the sensitive dynamic change interval to update the response mechanism of the stylus to adapt to the operating requirements at different distances, thereby improving the user's interactive operation comfort and efficiency. Secondly, by dynamically monitoring the changes in the simulated trajectory of the smart stylus posture movement, the real-time movement trajectory data of the user when using the stylus can be obtained. The importance of this step is that it can accurately capture the user's posture movement behavior and provide an accurate data basis for the subsequent interactive area division and correction. By monitoring the dynamic changes of the posture movement trajectory, the user's operating intention can be better understood, thereby laying the foundation for providing a personalized and accurate interactive experience. Then, by performing interactive area division processing on the dynamic change trajectory of posture movement based on the dynamic response update interaction distance of the smart stylus, the posture movement trajectory can be effectively divided into different interactive areas for subsequent sensitive interaction correction calculation and trajectory response correction. The purpose of this step is to effectively partition the user's posture movement behavior according to the dynamic response mechanism of the stylus, thereby providing an accurate data basis for refined interaction correction. Next, by performing sensitive interaction correction calculation on the interactive area of ​​the posture movement trajectory, the sensitivity correction threshold of each interactive area can be determined. The key to this step is to effectively adjust the sensitivity according to the characteristics of the interactive area and the user's operating habits to improve the response accuracy and accuracy of the stylus in different interactive areas. Through sensitive interaction correction calculation, the interactive performance of the stylus can be better optimized, and the user's operating experience and satisfaction can be improved. Finally, by using the interactive area sensitive interaction correction threshold to perform trajectory interaction response correction on the posture movement simulation trajectory, the purpose of this step is to effectively correct the user's posture movement trajectory according to the sensitivity correction threshold of the interactive area to ensure the response sensitivity and accuracy of the stylus in different interactive scenarios. By generating posture-movement-sensitive interaction correction trajectories, the stylus can achieve optimized response in various interaction environments, thereby providing a smoother and more natural interaction experience.

[0127] Preferably, step S4 comprises the following steps:

[0128] Step S41: transmitting the intelligent stylus gesture movement sensitive interaction correction trajectory to the gesture recognition interaction processor through wireless transmission technology;

[0129] The embodiment of the present invention establishes a corresponding data transmission channel by using corresponding wireless transmission technologies (such as Wi-Fi, Bluetooth, etc.) and ensures the stability and reliability of the transmission channel, and then uses the established data transmission channel to package and transmit the corrected smart stylus gesture movement sensitive interaction correction trajectory in a predetermined format according to a predetermined format, and finally transmits it to the gesture recognition interaction processor.

[0130] Step S42: performing gesture trajectory pattern analysis on the smart stylus gesture movement sensitive interaction correction trajectory to obtain smart stylus gesture trajectory pattern data;

[0131] The embodiment of the present invention uses a gesture recognition interaction processor to parse and pattern analyze the received stylus gesture movement sensitive interaction correction trajectory, so as to convert the stylus gesture movement sensitive interaction correction trajectory into a recognizable gesture trajectory pattern, including gesture shape, speed, direction and other pattern information, thereby acquiring the gesture behavior pattern of the stylus user and finally obtaining the smart stylus gesture trajectory pattern data.

[0132] Step S43: performing similarity measurement analysis on the smart stylus pen gesture trajectory pattern data through the gesture trajectory template preset in the gesture recognition interaction processor to obtain similarity measurement degree data between the smart stylus pen gesture trajectory pattern and the gesture trajectory template;

[0133] The embodiment of the present invention uses corresponding mathematical statistical methods (such as cosine similarity or dynamic time warping, etc.) to perform statistical calculations on the gesture trajectory pattern corresponding to the smart stylus gesture trajectory pattern data and the gesture trajectory template preset in the gesture recognition interaction processor to evaluate and determine the degree of similarity between the user's gesture trajectory pattern and the preset gesture trajectory template, and finally obtains the similarity measurement degree data between the smart stylus gesture trajectory pattern and the gesture trajectory template.

[0134] Step S44: performing gesture trajectory pattern matching based on the similarity measurement degree data between the smart stylus pen gesture trajectory pattern and the gesture trajectory template to obtain a smart stylus pen gesture trajectory matching result;

[0135] The embodiment of the present invention performs matching analysis based on the similarity measure data between the smart stylus gesture trajectory pattern and the gesture trajectory template, and compares and judges them according to a preset similarity measure threshold. If the corresponding similarity measures are greater than or equal to the preset similarity measure threshold and the corresponding similarity measure is the maximum, the corresponding gesture trajectory pattern in the gesture trajectory template is determined to be the user's actual gesture behavior, and it is determined to be a successful match. Otherwise, it is determined to be a failed match, and finally the smart stylus gesture trajectory matching result is obtained.

[0136] Step S45: performing interactive instruction response processing on the smart stylus according to the smart stylus gesture trajectory matching result, generating a smart stylus interactive instruction to execute a corresponding smart stylus interactive operation.

[0137] The embodiment of the present invention judges and analyzes the matching result of the smart stylus gesture trajectory generated, and responds to the corresponding interaction instructions through the smart stylus based on the judgment result to generate corresponding interaction control instructions (including vibration prompt interaction instructions and gesture operation interaction instructions), thereby executing the corresponding smart stylus interaction operation work, such as triggering the vibration prompt function, clicking, double-clicking, long pressing, sliding and other interaction operations.

[0138] The present invention firstly transmits the intelligent stylus posture movement sensitive interaction correction trajectory to the gesture recognition interaction processor by using wireless transmission technology, which can realize seamless communication between the corresponding sensor of the intelligent stylus and the gesture recognition interaction processor. The key of this step is to transmit the posture movement correction trajectory recorded by the stylus sensor to the processor by wireless transmission technology, which provides the necessary data basis for subsequent gesture recognition and interaction instruction generation, thereby enhancing the interaction function and flexibility of the intelligent stylus. Secondly, the intelligent stylus posture movement sensitive interaction correction trajectory is analyzed by using the gesture recognition interaction processor. The purpose of this step is to parse and analyze the sensitive interaction correction trajectory recorded by the stylus to obtain the gesture behavior pattern of the stylus user, and provide data support for subsequent gesture recognition and matching, thereby realizing a more intelligent and personalized interaction experience. Then, by using the preset gesture trajectory template in the gesture recognition interaction processor to perform similarity measurement analysis on the smart stylus gesture trajectory pattern data, the similarity measurement degree data between the smart stylus gesture trajectory pattern and the gesture trajectory template is obtained. The importance of this step lies in using the preset gesture template to perform similarity measurement analysis on the gesture trajectory recorded by the stylus to determine the degree of match between the user gesture and the preset template, thereby providing an accurate data basis for subsequent gesture recognition and interaction instruction generation. Next, by matching the gesture trajectory pattern according to the similarity measurement degree data between the smart stylus gesture trajectory pattern and the gesture trajectory template, the key to this step is to match the gesture pattern recorded by the stylus with the preset template according to the similarity measurement degree data, thereby determining the user's actual gesture behavior, providing an accurate basis for the subsequent generation and execution of interaction instructions, and realizing the precise interaction function of the smart stylus. Finally, the smart stylus is processed for interactive command response based on the gesture trajectory matching results. The purpose of this step is to process the interactive command response of the stylus in real time based on the gesture matching results, generate corresponding operation instructions to meet the user's interactive needs, and realize automatic control and function execution of the smart stylus, thereby providing users with a more convenient and intelligent interactive experience.

[0139] Preferably, step S45 includes the following steps:

[0140] Step S451: performing matching result judgment processing on the smart stylus gesture trajectory matching result. If the smart stylus gesture trajectory matching result is a matching failure, performing vibration prompt instruction response processing on the smart stylus to generate a smart stylus vibration prompt interaction instruction to execute the corresponding smart stylus vibration prompt interaction operation;

[0141] The embodiment of the present invention first performs a matching result judgment process on the smart stylus gesture trajectory matching result. If it is judged that the smart stylus gesture trajectory matching result is a matching failure, the smart stylus will trigger a vibration prompt instruction response processing process, thereby generating a smart stylus vibration prompt interaction instruction, so that the smart stylus will issue a vibration warning prompt, and finally execute the corresponding smart stylus vibration prompt interaction operation, including reminding the user that the gesture matching fails and notifying the user to readjust the writing posture.

[0142] Step S452: if the smart stylus pen gesture trajectory matching result is a successful match, then performing gesture interaction intention recognition analysis on the smart stylus pen gesture trajectory matching result to obtain smart stylus pen gesture interaction intention information data;

[0143] If the embodiment of the present invention determines that the smart stylus gesture trajectory matching result is a successful match, the smart stylus will perform gesture interaction intention recognition analysis on the smart stylus gesture trajectory matching result to identify the user's specific interaction intention, such as click, double-click, long press, slide and other interaction intention information, and finally obtain the smart stylus gesture interaction intention information data.

[0144] Step S453: performing gesture interaction instruction response processing on the smart stylus according to the smart stylus gesture interaction intention information data, generating a smart stylus gesture operation interaction instruction to execute a corresponding smart stylus gesture interaction operation.

[0145] The embodiment of the present invention uses a smart stylus to respond to corresponding gesture interaction instructions based on the smart stylus gesture interaction intention information data obtained by analysis, so as to convert the corresponding interaction intention response into specific interaction operation instructions, including interaction control instructions such as click, double-click, long press, and slide, thereby generating smart stylus gesture operation interaction instructions, and ensuring that the instructions can accurately convey the user's interaction intentions, and finally execute the corresponding smart stylus gesture interaction operation work (including click, double-click, long press, slide, etc.).

[0146] The present invention firstly judges the matching result of the smart stylus gesture trajectory. If the matching result of the smart stylus gesture trajectory is judged to be a match failure, the smart stylus generates a smart stylus vibration prompt interaction instruction by means of a vibration prompt, so that the user can perceive the matching failure and improve the timeliness and accuracy of the user interaction experience. The importance of this step is to timely feedback the matching failure information to help the user adjust the posture or re-operate, thereby reducing the occurrence of erroneous operations and improving the usability and user satisfaction of the smart stylus. If it is judged that the smart stylus gesture trajectory is matched successfully, the smart stylus will perform gesture interaction intention recognition and analysis on the matching result to obtain the user's actual interaction intention information. The key to this step is to identify the user's interaction intention by analyzing the successfully matched gesture trajectory, thereby providing an accurate basis for the subsequent generation and execution of interaction instructions, realizing the intelligent interaction function of the smart stylus, and enhancing the personalization and customization of the user experience. Finally, the smart stylus performs gesture interaction instruction response processing based on the smart stylus gesture interaction intention information data to generate corresponding gesture operation interaction instructions, thereby executing the corresponding interactive operation work. The purpose of this step is to generate corresponding operation instructions based on the user's gesture interaction intention, realize the customized interactive function of the smart stylus, provide users with a more intelligent and personalized interactive experience, meet users' diverse operational needs, and thus improve the practicality and user satisfaction of the smart stylus.

[0147] Therefore, the embodiments should be regarded as illustrative and non-restrictive from all points, and the scope of the present invention is limited by the appended claims rather than the above description, and it is therefore intended that all changes falling within the meaning and range of equivalent elements of the application documents are included in the present invention.

[0148] The above description is only a specific embodiment of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but should conform to the widest scope consistent with the principles and novel features invented herein.

Claims

1. A smart stylus interaction method, characterized in that: Applied to a smart stylus, wherein the smart stylus has a pressure sensor, a motion sensor, a gyroscope sensor, a touch screen light sensor, a touch screen distance sensor, and a gesture recognition interaction processor integrated therein, and the smart stylus interaction method comprises the following steps: Step S1: real-time data collection and processing of the touch screen use process of the smart stylus pen is performed through the pressure sensor and the motion sensor to obtain the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen; the posture movement trajectory simulation analysis is performed on the real-time pressure data of the smart stylus pen tip and the real-time motion status data of the smart stylus pen using the gyroscope sensor to obtain the posture movement simulation trajectory of the smart stylus pen; Step S2: collecting and processing the touch screen change data of the touch screen use process of the smart stylus through the touch screen light sensor and the touch screen distance sensor to obtain the touch screen light change data of the smart stylus pen tip and the touch screen distance change data of the smart stylus pen tip; adjusting and analyzing the touch screen sensitivity interval of the smart stylus based on the touch screen light change data of the smart stylus pen tip and the touch screen distance change data of the smart stylus pen tip to obtain the touch screen sensitivity dynamic change interval of the smart stylus pen tip; wherein step S2 includes the following steps: Step S21: monitoring the touch screen light sensitivity change during the touch screen use process of the smart stylus pen through the touch screen light sensitivity sensor to obtain the touch screen light sensitivity change data of the smart stylus pen tip; Step S22: monitoring the touch screen distance change during the touch screen use process of the smart stylus pen through the touch screen distance sensor to obtain the touch screen distance change data of the smart stylus pen tip; Step S23: performing light intensity statistical analysis on the light intensity change data of the smart stylus pen tip touching the screen, to obtain light intensity status data of the smart stylus pen tip touching the screen; Step S24: performing touch screen aperture control processing on the smart stylus according to the light intensity status data of the smart stylus pen tip touching the screen, so as to obtain a dynamic control aperture of the smart stylus pen tip touching the screen; Step S25: Based on the dynamic control aperture of the smart stylus pen tip touching the screen and the change data of the distance of the smart stylus pen tip touching the screen, the smart stylus pen is adjusted and analyzed to obtain the dynamic change range of the smart stylus pen tip touching the screen; Step S3: updating the interactive distance response of the smart stylus based on the dynamic change interval of the smart stylus pen tip touching the screen to obtain the interactive distance updated by the dynamic response of the smart stylus; performing posture sensitive interactive correction on the simulated trajectory of the posture movement of the smart stylus based on the dynamic response updated interactive distance of the smart stylus to obtain the posture sensitive interactive correction trajectory of the smart stylus; wherein step S3 includes the following steps: Step S31: updating the interactive distance response of the smart stylus based on the dynamic change interval of the smart stylus pen tip touching the screen, so as to obtain the dynamic response updated interactive distance of the smart stylus pen; Step S32: monitoring the dynamic changes of the simulated trajectory of the intelligent stylus pen posture movement to obtain the dynamic change trajectory of the intelligent stylus pen posture movement; Step S33: performing interactive area division processing on the dynamic change trajectory of the smart stylus posture movement based on the dynamic response update interactive distance of the smart stylus to obtain the interactive area of ​​the smart stylus posture movement trajectory; Step S34: performing sensitive interaction correction calculation on the interactive area of ​​the movement trajectory of the smart stylus posture to obtain a sensitive interaction correction threshold of the movement trajectory interactive area; Step S35: performing trajectory interaction response correction on the intelligent stylus gesture movement simulation trajectory according to the sensitive interaction correction threshold of the movement trajectory interaction area to obtain the intelligent stylus gesture movement sensitive interaction correction trajectory; Step S4: transmitting the intelligent stylus posture sensitive interactive correction trajectory to the gesture recognition interaction processor through wireless transmission technology; performing gesture trajectory pattern matching on the intelligent stylus posture sensitive interactive correction trajectory through the gesture trajectory template preset in the gesture recognition interaction processor to obtain the intelligent stylus gesture trajectory matching result; performing interactive command response processing on the intelligent stylus according to the intelligent stylus gesture trajectory matching result to generate the intelligent stylus interactive command to execute the corresponding intelligent stylus interactive operation.

2. The smart stylus interaction method according to claim 1, characterized in that: Step S1 includes the following steps: Step S11: using a pressure sensor to collect the pen tip pressure data in real time during the touch screen use process of the smart stylus pen, so as to obtain the real-time pressure data of the pen tip of the smart stylus pen; Step S12: collecting the movement status data of the smart stylus pen during the touch screen use process in real time through the mobile sensor to obtain the real-time movement status data of the smart stylus pen; Step S13: extracting and processing the moving position and angle change data of the real-time moving status data of the smart stylus pen to obtain the real-time moving position change data of the smart stylus pen and the real-time moving angle change data of the smart stylus pen; Step S14: using a gyroscope sensor to perform three-axis movement position change detection on the real-time pressure sensing data of the smart stylus pen tip and the real-time movement position change data of the smart stylus pen, to obtain the pressure sensing three-axis movement position change data of the smart stylus pen tip; Step S15: using a gyroscope sensor to perform three-axis movement angle change detection on the real-time pressure sensing data of the smart stylus pen tip and the real-time movement angle change data of the smart stylus pen, to obtain the three-axis movement angle change data of the smart stylus pen tip pressure sensing; Step S16: performing posture movement trajectory simulation analysis on the smart stylus pen tip pressure-sensitive three-axis movement position change data and the smart stylus pen tip pressure-sensitive three-axis movement angle change data to obtain the smart stylus pen posture movement simulation trajectory.

3. The smart stylus interaction method according to claim 2, characterized in that: Step S14 includes the following steps: Step S141: performing timing synchronization alignment processing on the real-time pressure sensing data of the smart stylus pen tip and the real-time moving position change data of the smart stylus pen to obtain the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus moving position change timing synchronization data; Step S142: using a gyroscope sensor to perform three-axis position change analysis and calculation on the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus pen movement position change timing synchronization data, to obtain the smart stylus pen tip pressure sensing three-axis position initial change data; Step S143: performing abnormal change filtering processing on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip; Step S144: performing abnormal error calculation on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip based on the abnormal change data of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain an abnormal change error value of the pressure-sensitive three-axis position of the smart stylus pen tip; Step S145: performing error compensation on the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip according to the abnormal change error value of the pressure-sensitive three-axis position of the smart stylus pen tip to obtain the pressure-sensitive three-axis movement position change data of the smart stylus pen tip.

4. The smart stylus pen interaction method according to claim 3, characterized in that: Step S142 includes the following steps: Using a gyroscope sensor to perform three-axis spatial coordinate system mapping processing on the smart stylus pen tip pressure sensing timing synchronization data and the smart stylus movement position change timing synchronization data, to obtain the smart stylus pen tip pressure sensing three-axis position change spatial coordinate system; Performing pitch position change detection on the three-axis position change space coordinate system of the smart stylus pen tip pressure sensitivity to obtain the smart stylus pen tip pressure sensitivity pitch position change data; Detecting the yaw position change of the three-axis position change space coordinate system of the smart stylus pen tip pressure sensitivity to obtain the yaw position change data of the smart stylus pen tip pressure sensitivity; Performing roll position change detection on the three-axis position change space coordinate system of the smart stylus pen tip pressure sensitivity to obtain the smart stylus pen tip pressure sensitivity roll position change data; The three-axis position change analysis and calculation are performed on the pressure-sensitive pitch position change data of the smart stylus pen tip, the pressure-sensitive roll position change data of the smart stylus pen tip, and the pressure-sensitive yaw position change data of the smart stylus pen tip to obtain the initial change data of the pressure-sensitive three-axis position of the smart stylus pen tip.

5. The smart stylus pen interaction method according to claim 2, characterized in that: Step S16 includes the following steps: Step S161: performing a moving position characteristic analysis on the pressure-sensitive three-axis moving position change data of the smart stylus pen tip to obtain the pressure-sensitive three-axis moving position characteristic data of the smart stylus pen tip; Step S162: performing feature point set sampling processing on the pressure-sensitive three-axis moving position feature data of the smart stylus pen tip to obtain a pressure-sensitive three-axis moving position feature point set of the smart stylus pen tip; Step S163: performing movement angle characteristic analysis on the pressure-sensitive three-axis movement angle change data of the smart stylus pen tip to obtain the pressure-sensitive three-axis movement angle characteristic data of the smart stylus pen tip; Step S164: performing feature point set sampling processing on the pressure-sensitive three-axis movement angle feature data of the smart stylus pen tip to obtain a feature point set of the pressure-sensitive three-axis movement angle of the smart stylus pen tip; Step S165: performing posture movement trajectory simulation analysis based on the smart stylus pen tip pressure-sensitive three-axis movement position feature point set and the smart stylus pen tip pressure-sensitive three-axis movement angle feature point set to obtain the smart stylus pen posture movement simulation trajectory.

6. The smart stylus pen interaction method according to claim 1, characterized in that: Step S25 includes the following steps: Step S251: performing correlation analysis on the data of the dynamic control of the aperture of the smart stylus pen tip touching the screen and the distance change of the smart stylus pen tip touching the screen, to obtain correlation relationship data between the aperture control of the smart stylus pen tip touching the screen and the distance change; Step S252: monitoring the touch screen sensitivity range of the smart stylus pen to obtain the touch screen sensitivity range of the smart stylus pen tip; Step S253: Based on the correlation data between the touch screen aperture control and the distance change of the smart stylus pen tip, the touch screen sensitivity range of the smart stylus pen tip is adjusted and analyzed to obtain the touch screen sensitivity dynamic change range of the smart stylus pen tip.

7. The smart stylus interaction method according to claim 1, characterized in that: Step S4 includes the following steps: Step S41: transmitting the intelligent stylus gesture movement sensitive interaction correction trajectory to the gesture recognition interaction processor through wireless transmission technology; Step S42: performing gesture trajectory pattern analysis on the smart stylus gesture movement sensitive interaction correction trajectory to obtain smart stylus gesture trajectory pattern data; Step S43: performing similarity measurement analysis on the smart stylus pen gesture trajectory pattern data through the gesture trajectory template preset in the gesture recognition interaction processor to obtain similarity measurement degree data between the smart stylus pen gesture trajectory pattern and the gesture trajectory template; Step S44: performing gesture trajectory pattern matching based on the similarity measurement degree data between the smart stylus pen gesture trajectory pattern and the gesture trajectory template to obtain a smart stylus pen gesture trajectory matching result; Step S45: performing interactive instruction response processing on the smart stylus according to the smart stylus gesture trajectory matching result, generating a smart stylus interactive instruction to execute a corresponding smart stylus interactive operation.

8. The smart stylus pen interaction method according to claim 7, characterized in that: Step S45 includes the following steps: Step S451: performing matching result judgment processing on the smart stylus gesture trajectory matching result. If the smart stylus gesture trajectory matching result is a matching failure, performing vibration prompt instruction response processing on the smart stylus to generate a smart stylus vibration prompt interaction instruction to execute the corresponding smart stylus vibration prompt interaction operation; Step S452: if the smart stylus pen gesture trajectory matching result is a successful match, then performing gesture interaction intention recognition analysis on the smart stylus pen gesture trajectory matching result to obtain smart stylus pen gesture interaction intention information data; Step S453: performing gesture interaction instruction response processing on the smart stylus according to the smart stylus gesture interaction intention information data, generating a smart stylus gesture operation interaction instruction to execute a corresponding smart stylus gesture interaction operation.

Citation Information

Patent Citations

  • Electronic pen with writing touch sense and an implementation method

    CN109491526A

  • Control method and device based on touch pen

    CN113238649A