Cognitive Usability Test via Self-Service Engine

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for evaluating product usability are often inefficient, requiring live product feedback, being influenced by emotional states, and lacking objective analysis, making it difficult to validate usability in a timely and accurate manner.

Innovation Solution

A cognitive computing-driven approach is implemented in three phases: pre-testing, testing, and post-testing, where a cognitive engine is trained with standard and industry-specific knowledge to recognize actionable elements, attempt operations, and generate usability scores, providing objective and quantifiable feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional usability testing methods are used, then user feedback can be collected, but the process is inefficient and time-consuming

Engineering Contradiction:

Improveusability validation efficiencyVSAvoidtesting time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The cognitive engine autonomously performs usability testing without requiring human testers to manually interact with the product. The system automatically analyzes user interfaces, tracks user actions, and generates usability scores, enabling the testing process to serve itself and eliminating the need for extensive human involvement in the actual testing execution.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual human testing mechanisms with an automated cognitive computing system. The cognitive engine uses artificial intelligence to simulate user interactions, analyze interface elements, and evaluate usability metrics, substituting the mechanical process of human testing with an automated computational system that operates faster and more consistently.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual usability testing is performed, then qualitative feedback can be obtained, but objectivity is compromised due to emotional influences

Engineering Contradiction:

Improveusability measurement objectivityVSAvoidemotional bias in testing

Core Design Contradiction:

Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The cognitive engine independently evaluates usability metrics without being influenced by human emotions or subjective interpretations. The system objectively analyzes user interface elements, user actions, and system responses to generate data-driven usability scores, ensuring measurements are based on observable behaviors rather than emotional or subjective assessments.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces human testers who are susceptible to emotional biases with an automated cognitive system that processes user interactions purely based on observable data. The cognitive engine eliminates emotional influences by using algorithmic analysis of user actions, interface elements, and task completion metrics to generate objective usability measurements.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If comprehensive usability analysis is conducted, then accurate usability scores can be generated, but the complexity of the testing system increases

Engineering Contradiction:

Improveusability score accuracyVSAvoidtesting system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The cognitive engine serves multiple functions within a single integrated system: it identifies actionable interface elements, tracks user actions, analyzes task completion, and generates usability scores. This multi-functional approach consolidates what would otherwise require separate testing tools and processes into one unified cognitive system, managing complexity through functional integration rather than proliferation of separate components.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The cognitive engine acts as an intermediary layer between the user interface and the usability analysis process. It mediates by automatically interpreting user interactions, translating raw user actions into meaningful usability metrics, and bridging the gap between complex interface elements and simplified usability scores, thereby managing system complexity through intelligent mediation.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20230306298A1Cognitive usability test

Publication Date: 2023.09.28 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

A system may include a memory and a processor in communication with the memory. The processor may be configured to perform operations. The operations may include training a cognitive engine and receiving a goal for the cognitive engine. The operations may include recognizing, with the cognitive engine, at least one actionable element and attempting, with the cognitive engine, operations on the at least one actionable element. The operations may include tracking data affiliated with the operations and generating, based on the data, a usability score for a user.