Touch Gesture Recording via Interception and Chunking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current software solutions for recording user-driven events in applications are limited, making it difficult to reproduce bugs accurately, especially in touch-enabled applications where manual testing is complex due to the need for precise sequence recall of touch gestures.
Innovation Solution
A system and method for recording touch gestures within a computing system that intercepts and groups touch information into chunks, preserving intra-chunk timings to accurately reproduce user interactions, allowing for enhanced manual testing of touch-enabled applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If touch gestures are recorded for manual testing, then debugging efficiency is improved, but the complexity of recording and reproducing precise touch sequences increases
Solution Approach 1:
The system performs preliminary recording of touch gestures during normal application usage, capturing touch information before debugging is needed. This allows the complete sequence of user interactions to be stored in advance, eliminating the need for manual recall of bug reproduction steps and improving debugging efficiency without adding operational complexity
Solution Approach 2:
The system creates accurate copies of original touch gestures by intercepting and recording touch information, then reproducing these copied gestures during debugging sessions. This copying mechanism preserves the exact sequence and timing of user interactions, enabling precise bug reproduction while automating what would otherwise be a complex manual process
2Measurement precision
If touch information is intercepted and recorded, then gesture reproduction accuracy is improved, but processing time and potential delays increase
Solution Approach 1:
Touch information is intercepted and recorded in advance during normal application operation, before any debugging or reproduction is needed. This preliminary capture stores the complete gesture data with precise timing information, allowing accurate reproduction without real-time processing delays when debugging is required
Solution Approach 2:
The system replaces manual gesture reproduction with automated digital recording and playback. By substituting the mechanical process of manual gesture repetition with an automated digital system that reads pre-recorded touch information, the solution achieves high reproduction accuracy while minimizing time loss through efficient data retrieval and execution
3Reliability
If complete touch sequences are recorded for bug reproduction, then bug reproduction capability is improved, but the difficulty of conveying and recalling event sequences increases
Solution Approach 1:
The system creates a complete digital copy of the touch gesture sequence that caused the bug, storing all interaction details including timing and sequence. This copied record eliminates the need for users to manually recall and convey event sequences, as the accurate reproduction is automatically generated from the recorded data, improving reliability while easing operation
Solution Approach 2:
The complete touch sequence is recorded in advance during normal application use, capturing the exact series of gestures that triggered the bug. This preliminary recording preserves the full event sequence without requiring later manual reconstruction, making bug reproduction reliable and eliminating the difficulty of conveying complex event sequences between users and developers
Data Source
AI summary
A method of recording user-driven events within a computing system includes receiving at a motion-sensitive display surface at least one user-performed gesture, which includes user movement of an object over the surface that recognizes such user interaction therewith. Touch information is generated corresponding to the at least one user-performed gesture. The touch information is configured to be provided to an application. The touch information is intercepted and recorded before it is provided to the application. The intercepted touch information is grouped into at least one chunk, and the at least one chunk is output to the application.