Virtual Grid Test System for Mobile App Automation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current automated testing of mobile applications faces challenges due to closed operating systems with limited APIs, resulting in low test accuracy and efficiency.
Innovation Solution
A test method and system that generates a virtual test grid, extracts coordinate data, acquires configuration files, and tests controls based on preset rules to produce a test report, improving accuracy and efficiency without relying on available APIs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If automated testing is performed using available APIs on closed operating systems, then testing can be conducted, but test accuracy and efficiency are low due to limited API availability
Solution Approach 1:
The patent introduces an image recognition system as an intermediary between the tester and the mobile application. Instead of directly interacting with limited APIs, the system captures screenshots, recognizes UI elements through image processing, and performs testing based on visual identification. This mediator approach bypasses the API limitation while enabling comprehensive automated testing.
Solution Approach 2:
The patent replaces the traditional API-based mechanical interaction system with an image recognition-based system. By substituting the API calling mechanism with visual element identification and coordinate-based interaction, the system achieves testing capability independent of the operating system's API provisions.
2Measurement precision
If manual testing is performed on mobile applications, then detailed visual inspection is possible, but testing process is time-consuming and less efficient
Solution Approach 1:
The system performs automated self-testing by capturing screenshots, automatically recognizing UI elements, and executing test cases without continuous human intervention. The image recognition algorithm autonomously identifies controls and their coordinates, enabling the system to service itself through automated visual analysis and testing execution.
Solution Approach 2:
The patent replaces manual visual inspection with automated image recognition technology. The system uses computer vision algorithms to identify and locate UI elements, substituting the human eye and manual measurement process with automated digital image processing that is both faster and more precise.
3Measurement precision
If grid testing parameters are set and virtual test grid is generated, then coordinate extraction becomes systematic, but system complexity increases
Solution Approach 1:
The patent divides the mobile application interface into a virtual test grid with systematically arranged coordinate points. By segmenting the UI into manageable grid sections with predefined coordinates, the system enables structured and systematic testing while maintaining manageable complexity through regular patterns and standardized coordinate extraction rules.
Data Source
AI summary
Disclosed are a test method, system, and device, as well as a readable storage medium. The test system is used to: set parameters of a test grid used for grid testing to obtain corresponding setting parameters; simulate a virtual test grid corresponding to the setting parameters for the uppermost layer of an operating interface of a tested application; extract a preset number of coordinate data from within the virtual test grid by a preset coordinate extraction rule; acquire a configuration file of the tested application from terminal under test and determine respective area pixel data of various controls of the tested application from the acquired configuration file; test the controls based on the acquired coordinate data and area pixel data by a preset test rule, to obtain respective test data of the various controls; and generate a corresponding test report for the tested application based on the obtained test data.