Application Quality Score Calculation Using Event Instrumentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Assessing the quality of computer applications in a diverse and dynamic mobile environment is challenging due to the high costs and inaccuracies of existing methods, leading to unreliable and incomplete results.
Innovation Solution
A system that computes quality indicators for computer applications by instrumenting them to emit application event reports, which are collected and processed to calculate percentile-based quality scores, incorporating unique user data and popularity metrics, providing accurate and reliable assessments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If existing quality assessment methods are used, then assessment coverage is achieved, but cost increases and accuracy decreases
Solution Approach 1:
The application instrumented with the quality measurement library performs self-assessment by automatically emitting event reports about its own execution state, eliminating the need for external observation tools and providing accurate, reliable quality data directly from the application itself
Solution Approach 2:
A quality measurement library acts as an intermediary component between the application and the quality assessment system, collecting execution events and transmitting them to the quality measurement server for processing and analysis
2Measurement precision
If comprehensive quality data is collected, then assessment accuracy improves, but system complexity increases
Solution Approach 1:
The quality measurement system is segmented into distinct functional modules: a quality measurement library for data collection, a quality measurement server for processing, and a quality indicator generation component for output, allowing each to specialize and reducing overall system complexity
Solution Approach 2:
The quality measurement library provides universal functionality by instrumenting applications to collect multiple types of execution events (launch, termination, errors, warnings) through a single integrated interface, reducing the need for separate monitoring tools for each event type
Data Source
AI summary
A quality score for a computer application release is determined using a first number of unique users who have launched the computer application release on user devices and a second number of unique users who have encountered at least once an abnormal termination with the computer application release on user devices. Additionally or optionally, an application quality score can be computed for a computer application based on quality scores of computer application releases that represent different versions of the computer application. Additionally or optionally, a weighted application quality score can be computed for a computer application by further taking into consideration the average application quality score and popularity of a plurality of computer applications.