QXscore System for Objective Website Usability Benchmarking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods lack an objective and reliable way to assess and compare the usability of websites, making it difficult for businesses to improve their online presence and compete effectively, as existing user experience testing methods are time-consuming, expensive, and not representative of the target audience.
Innovation Solution
A system and method for generating a Quality of Experience Score (QXscore) that combines behavioral metrics from user interactions with attitude scores derived from user feedback, allowing for a comprehensive and objective evaluation of website usability, ease of use, trust, and loyalty, enabling pre and post-redesign comparisons and benchmarking against industry peers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If focus groups are used to assess website usability, then user feedback can be collected, but the process becomes long, expensive, and unreliable due to unrepresentative demographics
Solution Approach 1:
Users automatically complete tasks and provide feedback without researcher intervention. The system self-administers the usability testing by presenting tasks, tracking user actions, and collecting feedback responses automatically, eliminating the need for manual focus group moderation and reducing time and cost while improving reliability through standardized procedures
Solution Approach 2:
The system changes the scale and structure of user feedback collection by using standardized rating scales (e.g., 1-5 or 1-10) and structured task completion metrics instead of unstructured focus group discussions. This standardization enables objective comparison and statistical analysis, improving reliability while reducing the time needed to process and interpret feedback
2Measurement precision
If traditional user experience testing methods are used, then user feedback is collected, but the methods are time-consuming and expensive
Solution Approach 1:
The patent replaces manual mechanical processes (researchers conducting interviews, manually analyzing user behavior, calculating metrics) with an automated computer-based system that presents tasks, tracks user interactions through code injection, and automatically calculates usability metrics. This substitution dramatically improves productivity while maintaining or enhancing measurement precision through consistent, error-free data collection and computation
Solution Approach 2:
The system introduces an intermediary automated platform that mediates between the user and the research objectives. This platform presents standardized tasks, captures user actions and feedback, and processes data through predefined algorithms, eliminating the need for manual intervention while ensuring precise and consistent measurement across all users
3Quantity of substance
If mass online surveys are used to collect user feedback, then information about user experience can be gathered, but objective comparison between websites remains difficult
Solution Approach 1:
The system segments feedback collection into distinct components: task completion success/failure, time-on-task metrics, specific usability rating questions, and behavioral data from code-tracked interactions. Each segment is measured with precise, standardized metrics that can be objectively compared across different websites, transforming unstructured survey data into structured, comparable measurements
Solution Approach 2:
The patent creates a universal measurement framework that can be applied to any website through standardized task presentations and feedback collection protocols. The same measurement instruments and calculation methods are used across different websites, enabling direct objective comparison while maintaining precision through consistent application of the universal system
Data Source
AI summary
Systems and methods for generating and analyzing a user experience score (QXscore) are provided. A plurality of success metrics for tasks on a website are collected and averaged together to generate a single success percentage value. This percentage value may be converted into a five-point scale (the behavior metric). Users are presented a series of statements and a question which are averaged to yield a score for the trust, appearance, ease of user (usability), and loyalty attitudes. Subsequently, all four attitude measurements are averaged to generate the final attitude value. This average may be a straight average, or may be a weighted average. The final attitude value and the behavior metric are then combined (again either by straight or weighted averaging) to generate the raw QXscore. This can be converted back into a 100-point scale for assisting in the comparison of the given QXscore to other websites' QXscore values.