Synthetic Touch Event Generation for Smooth Image Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile device screens face challenges in processing touch events to produce smooth, accurate, and continuous image movements due to variations in touch event data handling and display refresh rates, leading to jerky movements.
Innovation Solution
The system generates synthetic touch event positions based on detected touch events, calculated to coincide with predicted times relative to the display refresh rate, using estimation, interpolation, and error correction to improve the smoothness and accuracy of image rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If touch events are processed at varying rates to match user interaction speed, then responsiveness to user input is improved, but image movements appear jerky and discontinuous
Solution Approach 1:
The system generates synthetic touch event positions in advance to fill gaps between actual touch events and display refresh cycles. By proactively creating intermediate position data based on motion trajectories, the system ensures continuous smooth rendering without waiting for actual touch events, thus resolving the jerkiness caused by variable processing rates.
Solution Approach 2:
Synthetic touch event positions act as an intermediary between actual touch events and display refresh requirements. These generated positions serve as bridge data that smooths the transition between discrete user inputs and continuous display updates, eliminating the jerky movements while preserving responsiveness to actual user actions.
2Use of energy by moving object
If touch events are sampled at lower rates to reduce processing load, then energy consumption and computational complexity are reduced, but positional accuracy and smoothness of image tracking deteriorate
Solution Approach 1:
The system creates synthetic copies of touch event positions through interpolation and trajectory prediction. These copied position data points fill in the gaps left by lower sampling rates, maintaining the appearance of high-precision tracking without requiring continuous high-rate sampling, thus reducing energy consumption while preserving positional accuracy.
Solution Approach 2:
The system uses feedback from motion trajectories and velocity calculations to generate accurate synthetic positions. By continuously analyzing the direction and speed of touch movements, the system can predict future positions with high accuracy even when actual touch events are sampled at lower rates, maintaining tracking precision while reducing processing load.
3Adaptability or versatility
If touch events are processed asynchronously without synchronization to display refresh rates, then processing flexibility and responsiveness are improved, but image rendering becomes misaligned and jerky
Solution Approach 1:
The system performs preliminary generation of synthetic touch event positions that are specifically timed to coincide with display refresh cycles. By pre-calculating these positions before the refresh occurs, the system maintains asynchronous processing flexibility while ensuring precise alignment with the display timing, eliminating rendering misalignment and jerkiness.
Data Source
AI summary
Certain implementations of the disclosed technology may include systems and methods for improving image tracking based on touch events. A method is provided for outputting an image for presentation using an electronic device, the electronic device having a display refresh rate. The method includes detecting one or more touch events received via a touch sensitive surface screen associated with the electronic device, each touch event having a touch event position. The method also includes generating, by the electronic device, a synthetic touch event position based on the one or more touch event positions, the synthetic touch event position calculated to coincide in time with a predicted time, the predicted time being within an offset relative to a display refresh time corresponding to the display refresh rate. The method also includes outputting data based at least in part one or more of the synthetic touch event position or a touch event position associated with the one or more touch events.