Cloud-Based Gesture Testing via TouchTest Agent
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The proliferation of mobile applications across various devices and platforms has made functional testing challenging due to the complexity of touch and gesture-based user interfaces, leading to a labor-intensive and error-prone process, with many apps being released without proper testing, and existing automation methods relying on fragile optical recognition techniques and jailbreaking.
Innovation Solution
A cloud-based testing platform that enables precision capture and playback of touch gestures on mobile devices, eliminating the need for tethering or jailbreaking by using a TouchTest agent and driver library to record and validate gestures within the mobile app, allowing for real-time, automated testing across multiple devices and geographies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual testing is used, then testing accuracy can be maintained, but testing time and labor cost increase significantly
Solution Approach 1:
The system enables automated self-testing of mobile applications through the TouchTest agent that records and validates gestures automatically. The testing system performs functional testing without requiring manual intervention, allowing the application to be tested against predefined test cases that automatically execute gesture sequences and validate results.
Solution Approach 2:
The patent replaces manual mechanical gesture input with automated digital gesture simulation. The TouchTest agent captures touch coordinates, gesture sequences, and validation criteria, then automatically executes these test cases across multiple devices, eliminating the need for manual physical interaction while maintaining testing accuracy.
2Extent of automation
If optical recognition techniques are used for automation, then testing automation is achieved, but system reliability decreases due to fragility
Solution Approach 1:
The TouchTest agent acts as an intermediary between the testing system and the mobile application. Instead of using fragile optical recognition to detect screen elements, the agent directly interacts with the application's gesture recognition system, capturing touch events and validating gestures through the application's own coordinate system, thereby eliminating the fragility of optical recognition.
Solution Approach 2:
The system creates a digital copy of the gesture test sequence through the TouchTest agent, which records the exact touch coordinates, sequence, and validation criteria. This digital copy can be automatically executed and validated without relying on fragile optical recognition, maintaining reliability while achieving automation.
3Extent of automation
If jailbreaking is performed to enable automation, then automation capability is achieved, but device security and stability are compromised
Solution Approach 1:
The TouchTest agent operates within the application's existing environment without requiring jailbreaking or root access. The agent leverages the application's own gesture recognition capabilities and coordinate systems, allowing automated testing to be performed through legitimate means without compromising device security or stability.
Solution Approach 2:
The TouchTest agent serves as a legitimate intermediary that bridges the testing system and mobile application without requiring unauthorized modifications to the device or operating system. The agent communicates through standard application interfaces, eliminating the need for jailbreaking while enabling automation.
4Adaptability or versatility
If comprehensive testing across multiple devices is performed, then testing coverage improves, but testing complexity increases
Solution Approach 1:
The TouchTest agent and testing framework are designed with universality, allowing the same automated testing system to execute across multiple mobile devices and applications. The agent adapts to different devices by capturing their specific coordinate systems and gesture implementations, enabling comprehensive multi-device testing through a single unified framework without increasing operational complexity.
Data Source
AI summary
A method for cloud-based functional testing of a mobile application includes running a functional test program on a server. The functional test program provides a graphical user interface (GUI) that allows a user to select a mobile application and a mobile computing device having a touch-sensitive display screen for receiving user input. The mobile computing device is located remote to the server. The functional test program launches the mobile application on the mobile computing device via a wireless network connection. The server receives precision elements of each gesture-based input on the touch-sensitive display screen, the precision elements being captured and transmitted from the mobile computing device to the server during execution of the mobile application. The precision elements of each gesture-based input are then recorded in a test clip.