User Interface Interaction Evaluation via Mutation Event Logging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing user interface evaluation methods fail to effectively determine and analyze user interactions without impacting user experience, making it difficult for publishers to identify and improve user-friendly interfaces.

Innovation Solution

A method that involves accessing interface data and user interaction data to generate user interface states and session activity data, allowing for the creation of playback data that visually presents user interactions and contextual changes, enabling publishers to analyze and improve user interface design based on user feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If comprehensive user interaction data is collected and analyzed, then user interface evaluation accuracy is improved, but user experience is degraded due to increased bandwidth and memory usage

Engineering Contradiction:
Improveuser interface evaluation accuracyVSAvoidbandwidth and memory usage
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent extracts and logs only specific mutation events and user interactions that are relevant to interface evaluation, rather than collecting all possible data. This selective extraction reduces the volume of data transmitted and stored while maintaining evaluation accuracy by focusing on critical interaction patterns.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments user interactions into discrete, loggable events with specific attributes. By dividing the continuous stream of user behavior into structured, manageable event segments, the system efficiently captures essential interaction data without overwhelming bandwidth and memory resources.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If detailed user interaction tracking is implemented, then interface usability insights are improved, but device performance is degraded

Engineering Contradiction:
Improveinterface usability insightsVSAvoiddevice performance
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent uses lightweight, temporary data structures to represent user interactions and interface states. These ephemeral objects are created, processed, and discarded efficiently during session analysis, minimizing memory allocation overhead and improving device performance while preserving essential usability insights.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent transforms detailed interaction data into condensed parameter representations. By changing the form of data from raw interaction sequences to aggregated parameter metrics, the system maintains comprehensive usability insights while reducing processing requirements and improving device performance.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If complete user sessions are recorded for analysis, then user experience understanding is improved, but data processing complexity is increased

Engineering Contradiction:
Improveuser experience understandingVSAvoiddata processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent performs preliminary processing of user session data during the interaction itself, structuring and tagging events as they occur. This advance preparation organizes raw interactions into analysis-ready formats, reducing the complexity of subsequent processing while maintaining comprehensive user experience understanding.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary data layer that sits between raw user interactions and final analysis. This intermediate representation standardizes and simplifies complex session data, making it easier to process and analyze while preserving the full richness of user experience information.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12141413B2Evaluation of interactions with a user interface
Publication Date: 2024.11.12 FULLSTORY INC
  • US12141413B2 patent drawing
  • US12141413B2 patent drawing
  • US12141413B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for evaluating interactions with a user interface are disclosed. In one aspect, a method includes identifying a set of mutation events specifying changes to the structure of a user interface that occurred during the user session, and generating user interface states specifying different structures of the user interface throughout the given user session. Based at least in part on the user interface states, playback data that present visual changes of the user interface corresponding to the set of mutation events that occurred during the user session are generated. Session activity data describing user interactions that occurred during the user session are also generated. At least a portion of the playback data and the session activity data are output to a requesting device.