RPA UI Object Libraries for Reliable Descriptor Reuse

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current RPA technologies face inefficiencies in building reliable UI descriptors, lack of reusability, and challenges in upgrading systems due to non-straightforward process paths when applications change or upgrade.

Innovation Solution

A computer program and RPA developer application that facilitate the creation and management of UI object libraries and browsers, enabling the detection, selection, and generation of UI descriptors, which can be added to RPA workflow activities, and stored in a repository for reuse, using techniques such as selector-based, CV-based, and unified target identification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If default descriptors are generated automatically, then development speed is improved, but reliability of descriptors deteriorates

Engineering Contradiction:

Improvedevelopment speedVSAvoiddescriptor reliability

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system enables non-technical users to create and manage their own UI descriptors through an intuitive object browser and library interface, eliminating the need for technical expertise while maintaining descriptor quality through standardized generation processes

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

UI descriptors are pre-generated and stored in a reusable library before actual workflow execution. This preliminary generation allows for validation and standardization, ensuring reliability while enabling rapid deployment through reuse.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If descriptors are built manually for each UI action, then reliability is improved, but development time increases

Engineering Contradiction:

Improvedescriptor reliabilityVSAvoiddeveloper time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system creates reusable copies of UI descriptors in a centralized library. Once a descriptor is generated and validated for a particular UI element, it can be copied and reused across multiple workflows and applications, eliminating redundant manual work while preserving reliability through consistent generation methods.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The UI object library serves multiple functions: storing descriptors, providing reuse capabilities, enabling version management, and supporting multiple identification techniques (selector-based, CV-based, unified target). This universal platform reduces overall development time across multiple projects.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If systems are upgraded or changed, then functionality is improved, but upgrade complexity increases

Engineering Contradiction:

Improvesystem upgrade capabilityVSAvoidupgrade process complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments UI descriptors into independent, modular units stored in a library. When applications are upgraded, only the affected descriptor segments need to be updated in the library, while the rest of the workflow remains unchanged. This modular approach simplifies the upgrade process significantly.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The UI object library acts as an intermediary layer between the RPA workflows and the underlying application UIs. This abstraction layer decouples the workflow logic from application-specific details, allowing applications to be upgraded without requiring complex changes to the workflows themselves.

Inventive Principle:

Principle #24Intermediary (Mediator)

4Adaptability or versatility

If UI descriptors are not reused, then customization is improved, but development efficiency deteriorates

Engineering Contradiction:

Improvedescriptor customizationVSAvoiddevelopment efficiency

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The system allows descriptors to be customized at the local level (individual UI elements) while maintaining global reuse capabilities. Each descriptor in the library can be tailored to specific local requirements, yet remains reusable across multiple contexts, achieving both customization and efficiency.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS12353857B2User interface (UI) descriptors, UI object libraries, UI object repositories, and UI object browsers for robotic process automation

Publication Date: 2025.07.08 UIPATH INC

AI summary

User interface (UI) object descriptors, UI object libraries, UI object repositories, and UI object browsers for robotic process automation (RPA) are disclosed. A UI object browser may be used for managing, reusing, and increasing the reliability of UI descriptors in a project. UI descriptors may be added to UI object libraries and be published or republished as UI object libraries for global reuse in a UI object repository. The UI object browser, UI object libraries, and UI object repository may facilitate reusability of UI element identification frameworks and derivatives thereof.