Usability Test Recording Indexing and Annotation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The time-consuming process of reviewing and analyzing usability test videos for Human-Computer Interaction (HCI) evaluation methods hinders efficient identification of usability problems in user interfaces.

Innovation Solution

A method and apparatus for indexing user interface test recordings by capturing interactions and event streams, synchronizing them, identifying points of interest, and annotating the recordings to facilitate navigation and analysis of usability issues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If video recordings are manually reviewed and analyzed for usability testing, then comprehensive usability evaluation can be performed, but the analysis process becomes time-consuming

Engineering Contradiction:
Improveusability evaluation accuracyVSAvoidanalysis time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically capturing video recordings and generating event streams with timestamps during the usability test execution. Index entries are pre-created for each user interface event, allowing practitioners to quickly navigate to specific events without manual review of entire video recordings, thus reducing analysis time while maintaining evaluation accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary indexing system that bridges video recordings and usability events. The index contains entries linking user interface events to video timestamps and annotations, serving as a mediator that enables efficient navigation and analysis without requiring direct manual review of video content, thereby resolving the time-consuming nature of traditional analysis

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If detailed annotations are added to mark all usability events in video recordings, then comprehensive usability problem identification is achieved, but the complexity of the analysis system increases

Engineering Contradiction:
Improveusability problem detection completenessVSAvoidanalysis system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The indexing system is segmented into distinct components: video recording capture, event stream generation, index entry creation, and annotation addition. Each component handles a specific aspect of the analysis process independently, making the overall system more manageable and less complex while still achieving comprehensive usability problem detection through the coordinated work of these segments

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates a simplified copy of usability event data in the form of index entries that reference video timestamps and contain key event information. This copy allows practitioners to analyze and navigate usability events without processing the entire video recording, reducing system complexity while maintaining complete usability problem detection capability

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10649634B2Indexing and annotating a usability test recording
Publication Date: 2020.05.12 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10649634B2 patent drawing
  • US10649634B2 patent drawing
  • US10649634B2 patent drawing

AI summary

A method for indexing a user interface test recording includes capturing, during a session, a recording of a plurality of interactions with the user interface, capturing, during the session, an event stream including a plurality of user interface events, synchronizing, in time, the plurality of interactions and the plurality of user interface events, identifying a point of interest in the event stream, wherein the point of interest is correlated to a time in the recording by the synchronization, and annotating the recording at a time correlated to when the point of interest occurred.