GUI Image Area Change Analysis for Application Modification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Measuring web application performance from the user's perspective is costly and time-consuming, requiring specific instrumentation and additional coding, which hinders efficient identification and improvement of responsiveness.
Innovation Solution
A system and method that analyze image area changes in a software application's GUI over a recording period to identify application-active periods exceeding a threshold, generating recommendations to modify the application and reduce these periods without the need for additional coding or expensive instrumentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If specific instrumentation and additional coding are used to measure web application performance, then measurement precision is improved, but device complexity and development time increase
Solution Approach 1:
The patent uses screenshots (visual copies) of the application interface instead of complex instrumentation to measure performance. By capturing and analyzing image frames of the GUI, the system can detect changes and measure responsiveness without modifying the application code or adding specialized measurement tools.
Solution Approach 2:
The patent replaces the mechanical/instrumentation-based performance measurement system with an automated image analysis system. Instead of using specialized sensors or code instrumentation, the system uses standard screenshot capture and pixel comparison algorithms to measure application responsiveness.
2Measurement precision
If additional coding is added to enable performance testing, then measurement precision is improved, but productivity and development efficiency decrease
Solution Approach 1:
The patent enables the application to be tested for performance without requiring developer intervention or code modifications. The system automatically captures screenshots, analyzes pixel changes, and measures responsiveness, allowing developers to test performance while using the application normally without adding test code.
Solution Approach 2:
By using visual copies (screenshots) of the application interface, the system can perform precise measurements without requiring the application itself to be modified. This approach allows performance testing to be conducted on the application as-is, maintaining development efficiency while achieving accurate measurements.
3Measurement precision
If traditional performance measurement methods are used, then measurement precision is improved, but loss of time for testing increases
Solution Approach 1:
The patent enables continuous automated monitoring of application performance by capturing screenshots at regular intervals during normal use. This continuous capture and analysis allows performance data to be collected automatically over time without requiring dedicated testing sessions, reducing the time investment while maintaining accurate measurements.
Solution Approach 2:
By replacing manual or instrumentation-based measurement methods with automated screenshot analysis, the system can rapidly collect performance data without the time-consuming setup and configuration required for traditional measurement systems.
Data Source
AI summary
In one example of the disclosure, a set of image frames of a software application display, taken in sequence over a recording period, is obtained. For each frame from the set, a count of image areas that changed as between the frame and an adjacent frame is determined, and the count is recorded in correlation with order of recording of the frame relative to other frames of the set. An application-active period during which consecutive frames have changed-areas counts exceeding a changed-areas threshold is identified. Upon determining that duration of the application-active period exceeds a threshold period, a recommendation to modify the application is generated.