Automated Touch Input Testing via Event Recording and Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current automated testing systems for communication devices are inadequate for touch input environments, as they lack the ability to simulate graphical button interactions and navigate touch screens, and are not independent of the operating system or easily modifiable for touch input interfaces.
Innovation Solution
A method and apparatus that capture and record sequences of touch events on communication devices, allowing these sequences to be played back on other devices for automated testing, independent of the operating system, enabling efficient and reliable testing of touch input interfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If existing automated test systems use keyboard paradigm for navigation and simulated user input, then testing can be automated, but the systems cannot simulate graphical button interactions or navigate touch screens
Solution Approach 1:
The patent replaces the mechanical keyboard paradigm with a touch screen interface paradigm. Instead of using physical keys and AT commands, the system uses graphical user interface elements (buttons, icons, touch areas) that can be automatically detected and interacted with through image processing and coordinate-based navigation, enabling automation adapted to touch input devices
Solution Approach 2:
The patent introduces an intermediary layer consisting of image capture and analysis components that mediate between the automated test system and the touch screen interface. This intermediary captures screenshots, identifies graphical elements through image processing, and translates high-level test commands into precise touch coordinates, bridging the gap between automation software and touch interface
2Ease of manufacture
If existing test systems are based on fixed keypad paradigm with specific keys for input, then testing can be performed, but the systems are not easily modifiable for touch input interfaces or independent of operating system
Solution Approach 1:
The patent creates a universal testing framework that can operate across different operating systems and device types. By using operating system-agnostic techniques such as image capture, coordinate-based navigation, and graphical element identification, the system achieves multi-functionality that allows the same test scripts to run on various platforms without modification, making it easily adaptable to touch input interfaces
Solution Approach 2:
The patent uses screenshot capture and image processing to create a visual copy of the device interface. This copied representation allows the test system to analyze and interact with the interface without relying on operating system-specific commands or APIs, enabling cross-platform compatibility and ease of modification for different input types
Data Source
AI summary
An apparatus for facilitating automated testing of one or more communication devices may include a processor and memory storing executable computer code causing the apparatus to at least perform operations including capturing one or more recorded sequences of events in which at least one of the events corresponds to a detection of a touch input. The recorded sequences correspond to at least one designated test. The computer program code may further cause the apparatus to enable provision of the recorded sequences of events to one or more communication devices. The computer program code may further cause the apparatus to facilitate sending of one or more generated commands to at least one of the communication devices instructing the communication device to perform the recorded sequences. Corresponding methods and computer program products are also provided.