Browser Test Metrics Visualization for Real User Context
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
It is challenging to determine whether simulated user interactions with a website accurately reflect the experience of real users, and to contextualize these interactions due to the significant outnumbering of real user interactions by simulated ones.
Innovation Solution
A system is configured to compare controlled test metrics from simulated user interactions with observed metrics from real user interactions, using a graphical user interface to present the results, including distributions and percentiles, to contextualize the simulated results.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Difficulty of detecting and measuring
If simulated user interactions are used to diagnose website performance issues, then diagnostic capability is improved, but reliability in reflecting real user experience deteriorates
Solution Approach 1:
The patent introduces a comparison mechanism that acts as an intermediary between simulated and real user interactions. By displaying both simulated test metrics and real observed metrics side-by-side, the system mediates the discrepancy between the two data sources, allowing users to assess whether simulated interactions accurately reflect real user experiences.
2Ease of operation
If simulated user interactions are used for testing, then test control is improved, but contextualization difficulty increases due to outnumbering real user interactions
Solution Approach 1:
The patent adds a new dimension to the data presentation by displaying metrics across two distinct dimensions: simulated test metrics and real observed metrics. This dimensional expansion allows for easy comparison and contextualization, transforming the complex problem of reconciling disparate data volumes into a straightforward visual comparison task.
Data Source
AI summary
Techniques, which may be embodied herein as systems, computing devices, methods, algorithms, software, code, computer readable media, or the like, are described herein for comparing a set of metrics generated during a simulated user interaction with a website to metrics generated by observing real user interactions with the website. Simulated user interactions with a website can be used to diagnose a website's performance issues, but it can be difficult to determine whether the simulated interactions reflect the experience of real users. In addition, the simulated user interactions can be challenging to contextualize because the number of observed real user interactions may significantly outnumber the simulated interactions. A graphical user interface can help with the interpretation of these website interactions by using the real user interactions to properly contextualize the simulated results.