Stylus Drawn-Point Prediction for Hand-Following Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The latency in processing touch input with a stylus on a tablet computer leads to a discrepancy between the displayed point and the actual writing location, affecting user experience in terms of hand-following and handwriting.
Innovation Solution
A reported point prediction model is constructed based on historical stylus points to predict future points, ensuring the displayed point is closer to the actual touch point, using second-order Taylor expansion and adjusting the number of predicted points based on movement speed and error.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the stylus touch input is processed and calculated by the device, then the drawing function is achieved, but latency is introduced causing the displayed point to deviate from the actual writing location
Solution Approach 1:
The patent applies preliminary action by predicting future touch points before they are actually reported by the device. The prediction model calculates where the stylus will next touch based on historical touch point data, and draws at these predicted locations in advance. This eliminates the latency delay by performing the drawing action before the actual touch input is processed, making the displayed point coincide with the actual writing location.
2Ease of operation
If the displayed point is updated in real-time, then the hand-following experience is improved, but processing complexity increases
Solution Approach 1:
The patent introduces an intermediary prediction model that acts as a mediator between the raw touch input data and the display output. Instead of directly updating the display based on actual touch points (which would require complex real-time processing), the prediction model generates intermediate predicted touch points that are then used for drawing. This intermediary layer simplifies the processing by providing pre-calculated coordinates that naturally achieve good hand-following experience.
3Measurement precision
If more historical touch points are used for prediction, then prediction accuracy is improved, but computational load increases
Solution Approach 1:
The patent applies partial action by using a limited number of historical touch points (specifically the last 3-5 points) rather than all available historical data for prediction. This partial use of historical information is sufficient to achieve accurate prediction of the next touch point while significantly reducing the computational load compared to using extensive historical data or complex prediction algorithms.
Data Source
AI summary
A method for predicting a drawn point of a stylus includes obtaining a plurality of reported points of a stylus, determining a reported point prediction model based on the reported points, performing prediction using the reported point prediction model to obtain at least one predicted point, and drawing the at least one predicted point and displaying the drawn predicted point.