Relative Path Object Identification for Reliable RPA
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional object identification methods in Robotic Process Automation (RPA) are unreliable due to changes in screen resolution or layout between recording and execution stages, leading to inefficiencies and inconsistent automation processes.
Innovation Solution
Identifying objects using relative paths within a hierarchical structure, such as a tree structure, to ensure consistent object identification across different screen environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional physical position-based object identification methods are used, then the identification process is simple, but the reliability deteriorates when screen resolution or layout changes between recording and execution stages
Solution Approach 1:
The patent transitions from two-dimensional screen coordinate-based identification to a hierarchical tree-structure-based identification approach. By establishing object relationships through parent-child connections and relative paths (e.g., 'child of X, sibling of Y'), the system achieves resolution-independent object location, resolving the contradiction between simple identification and reliable cross-device performance
Solution Approach 2:
The patent introduces a tree structure as an intermediary layer between the recording stage (where objects are captured) and the execution stage (where objects are located). This intermediate hierarchical model translates physical screen positions into logical relationships, enabling reliable object identification across different screen resolutions and layouts without direct dependency on pixel coordinates
2Adaptability or versatility
If multiple scripts are created for various screen environments, then adaptability to different screen environments improves, but device complexity and maintenance difficulty increase
Solution Approach 1:
The patent creates a universal object identification method that works across all screen environments through a single tree-structure-based approach. Instead of maintaining multiple environment-specific scripts, the system uses relative path notation (e.g., 'child of Window, sibling of Button') that inherently adapts to any screen resolution or layout, eliminating the need for multiple specialized scripts while improving adaptability
Solution Approach 2:
The patent changes the fundamental parameters of object identification from absolute physical positions (x, y coordinates) to relative hierarchical relationships (parent-child connections, sibling orders). This parameter transformation enables the same identification logic to function universally across different screen environments without requiring script multiplication or complex conditional logic
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method and a system for relative path-based object identification are provided. The method according to some embodiments may include receiving, by a first computing device, a selection of a first object and a second object from among a plurality of objects present on a first desktop screen from a user of the first computing device; identifying, by the first computing device, a relative path in a tree structure between the first and second objects; storing, by the first computing device, the identified relative path; and identifying, by the first computing device or a second computing device, the second object from among a plurality of objects present on a second desktop screen, using the first object and the stored relative path, wherein the first desktop screen is generated by the first computing device, and the second desktop screen is generated by the first computing device or the second computing device.