Remote Usability Testing System with Automated Participant Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for assessing web site usability are costly, time-consuming, and unreliable, as they often rely on focus groups that may not represent the target customer base, making it difficult for marketing managers and designers to gather effective and representative usability data.
Innovation Solution
A method and system for remote usability testing that involves equipping participants with data processing units to track interactions on a modified web site, presenting questions and tasks, and analyzing responses using a validation and binning module, allowing for the selection of qualified participants based on predefined criteria and providing real-time data collection and analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If focus groups are used to assess web site usability, then user feedback can be obtained, but the process becomes long, expensive and unreliable due to unrepresentative sample sizes and demographics
Solution Approach 1:
The patent creates a copy of the target web site with embedded tracking code that participants interact with locally on their own devices. This digital twin approach allows multiple participants to simultaneously provide usability feedback without requiring centralized moderation or sequential testing, thereby reducing time costs while maintaining data reliability through automated tracking of all user interactions.
Solution Approach 2:
Participants independently complete usability tasks on their own devices without moderator intervention. The system automatically presents questions and tasks, tracks interactions through embedded code, and collects responses without requiring researcher presence, eliminating the time-consuming coordination and moderation inherent in traditional focus groups while improving reliability through consistent, standardized testing procedures.
2Reliability
If focus groups are used to assess web site usability, then user feedback can be obtained, but the process becomes expensive due to moderation and coordination requirements
Solution Approach 1:
The system eliminates the need for human moderators by implementing automated task presentation, interaction tracking, and response collection. Participants independently complete usability tasks on their own devices, with all data automatically captured through embedded tracking code and transmitted to the research server, removing labor costs associated with moderation while maintaining data quality through systematic automated procedures.
Solution Approach 2:
By distributing a copy of the web site with tracking code to participants' local devices, the system eliminates the need for centralized server resources and moderator coordination. Each participant's device becomes an independent testing station, reducing infrastructure costs and eliminating expenses related to scheduling, moderating, and coordinating focus group sessions while maintaining reliable data collection through automated tracking.
3Quantity of substance
If traditional usability testing methods are used, then comprehensive user feedback can be gathered, but the process is slow and cannot provide quick insights for web site improvements
Solution Approach 1:
Participants can complete usability tasks at their own pace and on their own schedule, allowing data collection to continue continuously without interruption by moderators or coordination delays. Multiple participants simultaneously contribute data in parallel, eliminating the sequential nature of traditional testing and enabling rapid accumulation of comprehensive usability data across diverse user populations.
Solution Approach 2:
Distributing the tested web site copy with tracking code to numerous participants simultaneously enables parallel data collection across many users at once. This eliminates the time-consuming sequential process of traditional usability testing where only one or a few users can be tested at a time, dramatically increasing productivity while maintaining comprehensive data collection through automated tracking of all interactions.
Data Source
AI summary
A system for performing remote usability testing of a website includes a module for generating particular tasks, a module for moderating a session with a number of participants, and a module for receiving usability data. The system further includes an analytics module for analyzing the received usability data. The module for generating the particular tasks includes a research server configured to interface with user experience researchers and storing multiple testing modules for selecting qualified participants from the number of participants and for generating the particular tasks having research metrics associated with a target web site. In an embodiment, the research server randomly assigns one or more of the multiple testing modules to one of the participants. The multiple testing modules may include card sorting studies for optimizing a web site's architecture or layout.