GUI Compliance Determination via Logic Tree Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Ensuring consistency of graphical user interfaces (GUIs) with formal and informal design requirements is a time-consuming task, often requiring manual expertise and involving significant effort to comply with platform-specific or cross-platform design guidelines.

Innovation Solution

A system and method that captures and analyzes GUI images, constructs logic trees to identify and correlate interface elements, compares these trees to a knowledge base of compliant designs, and generates recommendations for compliance, using machine learning and case-based reasoning to automate the process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual expert review is used to ensure GUI compliance with design guidelines, then design consistency and quality are improved, but time consumption and resource requirements increase significantly

Engineering Contradiction:
Improvedesign consistencyVSAvoidcompliance verification time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical review process with an automated computer-based system that uses image processing and logic tree comparison algorithms to verify GUI compliance, eliminating the need for human experts to manually examine each interface

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a logical copy of the GUI structure through logic trees that represent the hierarchical organization of interface elements, allowing automated comparison against design guidelines without requiring physical inspection of the actual interface

Inventive Principle:
Principle #26Copying

2Productivity

If automated analysis is implemented to reduce manual review time, then productivity increases, but system complexity and implementation difficulty increase

Engineering Contradiction:
Improvecompliance verification speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the GUI into discrete logical elements organized in a hierarchical tree structure, where each node represents a specific interface component and its relationships to parent and child elements, making the complex verification task manageable through structured decomposition

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces logic trees as an intermediary representation layer between the actual GUI and the compliance verification process, translating visual interface elements into a structured format that can be systematically analyzed against design guidelines

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11651245B2User interface (UI) design compliance determination
Publication Date: 2023.05.16 SAP SE
  • US11651245B2 patent drawing
  • US11651245B2 patent drawing
  • US11651245B2 patent drawing

AI summary

Embodiments relate to learning and determining user interface (UI) compliance with design guidelines. Those guidelines may enforce operability with requirements of an external UI platform. Embodiments receive as an input, a UI comprising a plurality of elements. An image of the UI is rendered, and a plurality of elements of the UI are identified from the image according to a recursive procedure. The plurality of elements are stored in a first logic tree exhibiting a first hierarchical structure having the plurality of elements as leaf nodes. The first logic tree is compared to a second logic tree exhibiting a second hierarchical structure, that is labeled with semantic metadata and stored within a knowledge base of a database. Input for the comparison may comprise the tree and/or additional meta information. Based upon the comparing, an output is generated indicating a similarity between the first logic tree and the second logic tree.