RPA Activity Verification via Visual Feedback Indicators

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic process automation (RPA) tools lack effective verification mechanisms to determine if activities such as click, type, or hover actions are successfully executed, leading to uncertainties in automation processes.

Innovation Solution

A system and method that allow users to enable verification of activity execution by specifying a verification element and action, which appears or disappears upon successful execution, enabling the system to determine and display the status of the activity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If RPA tools are used to automate activities, then productivity is improved, but reliability deteriorates due to lack of verification mechanisms

Engineering Contradiction:
Improveautomation execution speedVSAvoidactivity execution verification
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the system automatically verifies activity execution by checking for the presence or absence of specified verification elements (such as text, images, or UI components) after an activity is performed. This feedback loop provides confirmation whether the activity succeeded or failed, resolving the reliability issue while maintaining high productivity through automated verification.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces manual verification methods (mechanical/systematic human checking) with automated computer-based verification mechanisms. The system automatically captures screenshots, compares UI elements, and determines activity status without human intervention, thus improving reliability without sacrificing the productivity gains from automation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If verification mechanisms are added to RPA tools, then reliability is improved, but device complexity increases

Engineering Contradiction:
Improveactivity execution verificationVSAvoidverification system structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The verification system is designed to be self-service in nature, where the system automatically performs verification tasks without requiring external intervention or complex configuration. The RPA tool itself captures verification elements and determines activity status using its existing capabilities, avoiding the need for separate complex verification infrastructure.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent makes the RPA system multi-functional by enabling it to both execute activities and verify their execution using the same system components. The verification mechanism leverages existing screenshot capture and UI element identification capabilities already present in the RPA tool, avoiding the need for dedicated verification hardware or software and thus minimizing complexity increase.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If manual verification is performed, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improveactivity execution status accuracyVSAvoidverification time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual verification (mechanical human observation and judgment) with automated computer-based verification. The system automatically captures screenshots, compares UI elements against expected states, and determines activity status with high precision instantaneously, achieving both measurement precision and time efficiency without the trade-off present in manual verification.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11650871B2System and computer-implemented method for verification of execution of an activity
Publication Date: 2023.05.16 UIPATH INC
  • US11650871B2 patent drawing
  • US11650871B2 patent drawing
  • US11650871B2 patent drawing

AI summary

A system and a method for verification of execution of an activity are provided. The method comprises receiving a user input indicative of enablement of the verification, and displaying, in response to the reception of the user input, a target element comprising a menu for selecting an edit action. The method further comprises receiving, in response to the selection of the edit action, a verification element, and determining a status of the activity, wherein the status of the activity comprises either of successful execution of the activity or non-successful execution of the activity. Further, the method comprises generating a verification response based on the status of the activity and the verification element.