Mobile App Performance Testing Configuration and Network Isolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Regression testing of mobile applications is hindered by noise and inconsistencies due to complexity, variability in devices, and network instability, making it difficult to identify and resolve errors and performance issues.
Innovation Solution
A computer-implemented method that determines an optimum testing configuration for a mobile device, directs it to execute comparative performance tests between control and modified builds, and writes data to RAM to minimize inconsistencies, isolate network variations, and prevent thermal throttling and other features that cause inconsistencies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If regression testing is performed on mobile applications with standard configurations, then testing can be conducted without special setup, but the test results contain noise and inconsistencies due to device variability, network instability, and thermal throttling
Solution Approach 1:
The system performs preliminary actions by determining an optimum testing configuration before executing the comparative performance test. This includes pre-configuring the mobile computing device to prevent thermal throttling, pre-warming the application to ensure consistent startup conditions, and pre-establishing network conditions. By preparing the testing environment in advance with controlled parameters, the system eliminates noise factors before they can affect the test results, thereby achieving both ease of operation and high measurement precision.
2Power
If the mobile computing device operates without configured limits, then the device can run at full performance, but thermal throttling engages during testing causing inconsistent results
Solution Approach 1:
The system changes the operational parameters of the mobile computing device by establishing an optimum testing configuration that includes CPU frequency limits, GPU frequency limits, and other performance parameters. These parameter changes prevent thermal throttling from engaging during the comparative performance test by keeping the device within safe operational thresholds. The configuration maintains sufficient performance power to run the application and tests while ensuring reliability through consistent, throttling-free operation throughout the testing period.
3Adaptability or versatility
If network requests are handled in real-time during testing, then the application can respond to actual network conditions, but network variability introduces noise into performance measurements
Solution Approach 1:
The system extracts the network response handling from the real-time variable environment and isolates it for controlled testing. By determining an optimum testing configuration that accounts for network conditions and by controlling when and how network requests are processed, the system separates the application's core performance metrics from network variability. This allows the application to maintain adaptability in handling network requests while ensuring that performance measurements reflect application behavior rather than network fluctuations, thereby improving measurement precision.
Data Source
AI summary
A computer-implemented method for improving comparative performance test results of mobile applications may include (1) determining an optimum testing configuration for a mobile computing device, (2) directing the mobile computing device to (a) execute a comparative performance test, (b) operate in accordance with the determined optimum testing configuration during the execution of the comparative performance test, and (c) write data generated during the execution of the comparative performance test to a random-access memory (RAM) drive of the mobile computing device, (3) recording a network response directed to the mobile computing device, (4) detecting a subsequent network request sent by the mobile computing device, (5) sending the recorded network response to the mobile computing device in response to detecting the subsequent network request, and (6) tracking a control performance value and a modified performance value during the comparative performance test. Various other methods and systems are also disclosed.