Application Testing Framework Overhead Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile app testing tools are inaccurate in determining response times and launch times due to overhead components introduced by testing tools, which can lead to misleading performance metrics and negatively impact user experience and app ratings.
Innovation Solution
An automated application testing framework that integrates with the development environment to download and install app builds on various devices, run UI performance tests in parallel, and capture application traffic logs, using device logs and session details to accurately estimate launch and response times by accounting for overhead components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If automated testing tools are used to measure app performance, then testing efficiency and coverage are improved, but measurement precision deteriorates due to overhead components introduced by the testing tools
Solution Approach 1:
The patent extracts and separates the overhead component introduced by the automated testing tool from the actual app performance metric. By identifying and removing this overhead time from the measured performance data, the system recovers the true app performance metric, thereby resolving the contradiction between using automated tools for efficiency and maintaining measurement precision.
Solution Approach 2:
The system implements feedback by using device logs and session details to analyze and determine the overhead component introduced by the testing tool. This feedback loop allows the system to continuously refine and correct performance measurements by accounting for the testing tool's impact, thus maintaining precision while using automated testing.
2Reliability
If testing is performed across multiple devices and environments, then adaptability and reliability are improved, but device complexity and testing infrastructure requirements increase
Solution Approach 1:
The patent implements a universal testing framework that can operate across multiple device types and environments using a consistent approach. The system uses standardized methods to collect device logs and session details from various devices, allowing it to maintain reliability across diverse platforms without proportionally increasing infrastructure complexity.
Solution Approach 2:
The system leverages self-service capabilities by utilizing device logs and session details that are automatically generated by the devices themselves. This approach reduces the need for complex external testing infrastructure, as the devices provide their own diagnostic information that the testing system can directly utilize for accurate performance measurement.
Data Source
AI summary
A system and method are provided for testing application. The method is executed by a device having a communications module and includes initiating via the communications module, an application testing tool, to test an application build according to at least one metric and obtain a test result. The method also includes accessing via the communications module, session details generated by the application testing tool while testing the application build, to determine an overhead component introduced by the application testing tool in generating the test result. The method also includes adjusting the test result based on the overhead component to increase an accuracy of the test result.