Graphical User Interface for Macro Generation and Modification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional macro recorders and specialized programmer tools are limited in their ability to perform complex tasks, are version and interface-specific, and require programming knowledge, making them inefficient and inaccessible to non-programmers.

Innovation Solution

A graphical user interface (GUI) for an automation application that displays a directed graph representing a macro for a target application, allowing users to visualize and modify sequences of inputs, and generate and execute modified macros without requiring programming knowledge.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If conventional macro recorders are used to automate tasks, then simple repetitive tasks can be performed automatically, but the system cannot make complex decisions based on feedback from the application and becomes useless when application versions or interfaces change

Engineering Contradiction:
Improveautomation capabilityVSAvoidadaptability to application changes
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent implements feedback mechanisms where the macro recorder monitors application responses and user interactions in real-time. The system captures feedback from the application (such as displayed data, confirmation messages, or error states) and uses this information to dynamically adjust the macro execution flow, enabling complex decision-making capabilities that adapt to changing application states and versions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent transforms static macro sequences into dynamic, adaptive workflows. The macro system continuously evaluates application state changes and modifies its behavior accordingly, allowing it to handle version changes and interface updates by dynamically adjusting its interaction sequence based on current application conditions rather than following rigid pre-recorded paths.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If conventional macro recorders are used, then macros can be created without programming knowledge, but the macros are tied to specific computing device characteristics and difficult to port

Engineering Contradiction:
Improveease of macro creationVSAvoidportability across devices
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent implements a universal macro recording framework that captures application logic and data relationships rather than device-specific implementation details. The system abstracts macro operations to focus on functional outcomes and data transformations, enabling the same macro to execute correctly across different computing devices with varying characteristics while maintaining ease of creation for non-programmers.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If specialized programmer tools are used to create macros, then complex tasks can be automated with decision-making capability, but programming knowledge is required to use these tools

Engineering Contradiction:
Improvecomplex task handling capabilityVSAvoidease of use for non-programmers
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces an intermediary layer between the user and the complex macro creation process. This intermediary provides a simplified graphical interface that automatically captures application behavior and user decisions during recording, translating complex automation logic into an intuitive visual workflow that non-programmers can create and modify without needing to understand underlying programming concepts while still achieving complex task automation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12299466B2Graphical user interface for macro generation, modification, and verification
Publication Date: 2025.05.13 HYLAND SOFTWARE INC
  • US12299466B2 patent drawing
  • US12299466B2 patent drawing
  • US12299466B2 patent drawing

AI summary

A graphical user interface (GUI) for an automation application is described herein. The automation applications present the GUI on a display. The GUI displays a directed graph representing a macro for a target application. The directed graph comprises nodes and directed edges connecting the nodes. Each node in the node in the nodes is assigned to an input received by the target application during recording of the macro. Each directed edge is assigned criteria that are to be satisfied in order to traverse each directed edge. Responsive to receiving a modification to the directed graph, the automation application displays a modified directed graph based upon the modification. The automation application generates a modified macro based upon the modified directed graph.