User Experience Score Calculation System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computer applications lack effective methods to quantify and enhance user experience, which is crucial for adoption, retention, and productivity, as it is influenced by various factors including stability, performance, and usability of their components.
Innovation Solution
A system that calculates user experience scores by collecting and analyzing user event data from multiple frames of user sessions, generating frame scores, user session scores, and a unified user experience score, providing actionable insights for improvement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If user experience is quantified through multiple data collection points (frames and sessions), then measurement precision improves, but device complexity increases
Solution Approach 1:
The system segments user experience measurement into hierarchical levels: individual frames are scored separately, then grouped into user sessions, which are aggregated into overall application scores. This segmentation allows precise measurement at multiple granularities while organizing complexity through a structured framework.
Solution Approach 2:
The scoring system serves multiple functions simultaneously: it evaluates individual frames, assesses complete user sessions, compares different applications, and identifies specific performance issues. This multi-functionality justifies the system complexity by delivering comprehensive measurement capabilities.
2Loss of information
If comprehensive user event data is collected from multiple frames and sessions, then information completeness improves, but loss of time increases
Solution Approach 1:
The system performs preliminary scoring of individual frames as they occur during user sessions, rather than waiting to collect all data first. This allows incremental processing and reduces total computation time while maintaining complete information analysis.
Solution Approach 2:
The system collects more data points than minimally required (multiple frames per session, multiple sessions per application) to ensure comprehensive coverage of user experience variations, accepting the time cost as necessary for accurate measurement.
Data Source
AI summary
Examples relate to calculating user experience scores for applications. The examples disclosed herein collect, for each of at least two frames of each of at least two user sessions of an application, a set of user event data items representing user experiences from the perspective of a user device during a corresponding frame of the at least two frames of a user session. A frame score is calculated for each of the at least two frames in each of the at least two user sessions by analyzing the frame's set of user event data items. A user session score is calculated for each of the at least two user sessions by averaging the frame scores for the at least two frames in the user session of the at least two user sessions. A user experience score may then be calculated for the application by averaging the user session scores of each of the at least two user sessions.