UI State Mapper for Web Document Interaction Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Complex user interfaces in cloud platforms, particularly those with nested features, pose challenges in tracking and simulating user interactions, leading to inefficient and inaccurate analysis of UI states, which hinders data analysis and user experience improvement.

Innovation Solution

A UI state mapper program generates graphical node representations by interacting with web document features, recording sequences of interactions, and storing them in a computer-readable format, allowing for repeatable testing and data analysis, including persistent and transient nodes, and their respective states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional manual tracking methods are used for UI interactions, then implementation simplicity is maintained, but measurement precision and analysis accuracy deteriorate due to inability to accurately track complex nested features

Engineering Contradiction:
ImproveUI state tracking accuracyVSAvoidtracking system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary component (UI state mapper program) that automatically maps and tracks UI states by interacting with the web document. This intermediary systematically records user interactions and generates graphical node representations, thereby achieving precise tracking of complex nested features without requiring manual intervention while maintaining system manageability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces manual mechanical tracking methods with an automated computer-based system. The UI state mapper program automatically interacts with UI elements, records states, and generates visual representations, substituting human operators with an automated computational system that provides higher precision and consistency in tracking complex UI interactions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated UI interaction tracking is implemented, then productivity and analysis efficiency are improved, but difficulty of detecting and measuring increases due to complex nested features

Engineering Contradiction:
Improveanalysis efficiencyVSAvoidcomplex nested feature tracking
Core Design Contradiction:
ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent segments the complex UI system into discrete, manageable components represented as nodes in a graphical node representation. Each UI element and state transition is divided into individual nodes that can be independently tracked and analyzed. This segmentation transforms the overwhelming complexity of nested features into a structured collection of simple, measurable units that can be efficiently processed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a simplified copy or representation of the complex UI system through graphical node representations. Instead of directly analyzing the intricate nested structure of the actual UI, the system generates an abstracted model that captures essential states and transitions. This copied representation is easier to detect, measure, and analyze while preserving the critical behavioral characteristics of the original system.

Inventive Principle:
Principle #26Copying

3Reliability

If comprehensive UI state recording is performed, then reliability of data analysis is improved, but loss of time increases due to detailed interaction sequencing

Engineering Contradiction:
Improvedata analysis reliabilityVSAvoidstate recording time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by automatically generating and storing graphical node representations of UI states in advance. During testing and analysis phases, these pre-generated representations can be directly utilized without requiring real-time generation, thereby reducing the time loss during actual analysis while maintaining comprehensive and reliable state data for accurate results.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240248826A1User interface state mapping
Publication Date: 2024.07.25 SALESFORCE INC
  • US20240248826A1 patent drawing
  • US20240248826A1 patent drawing
  • US20240248826A1 patent drawing

AI summary

Methods, systems, and devices supporting mapping user interface (UI) states for a web document are described. A UI state mapper program may determine a set of interactable elements that are configured to cause a UI state change to a UI of the web document, such as from a configuration for the web document. The UI state mapper program may interact with the set of interactable elements of the UI. The UI state mapper program may generate sets of nodes in a graphical node representation in response to the interacting. The sets of nodes may include nodes of a first node type with a UI state change resulting from a universal resource locator (URL) change and nodes of a second node type with a UI state change resulting from a visual effect on the UI without a URL change. The UI state mapper may generate a computer readable record indicating a sequence of interactions by the UI state mapper program to generate the graphical node representation.