AI-Based DOM Element Identification for RPA Automation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional Robotic Process Automation (RPA) mechanisms face challenges in developing accurate and effective RPA bots due to architectural limitations, dependency on third-party tools, and lack of standard technical packages, as well as the inability to determine elements and their states on webpages for optimizing repetitive tasks.
Innovation Solution
The method involves identifying Document Object Model (DOM) elements from repetitive patterns through parsing application code components, determining dynamic DOM elements with high state change frequency, and training an AI model to execute code based on identified paths and positions within the application code component, enabling automated execution of repetitive tasks on user interfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional RPA mechanisms are used to automate repetitive tasks, then automation capability is provided, but accuracy and precision in identifying DOM elements and their states is insufficient
Solution Approach 1:
The patent replaces conventional RPA mechanisms with an AI-based system that uses machine learning models to identify and interact with DOM elements. The AI model analyzes webpage structures, determines element states, and predicts user actions, substituting the rule-based mechanical approach of traditional RPA with an intelligent system that achieves higher accuracy in element identification and state determination.
2Productivity
If manual interaction is used to perform repetitive tasks on user interface, then flexibility and adaptability are maintained, but time consumption increases
Solution Approach 1:
The AI-based system performs repetitive tasks autonomously without requiring manual intervention. The system automatically identifies DOM elements, determines their states, predicts user actions, and executes interactions, enabling self-service automation that maintains the flexibility of manual operation while dramatically reducing time consumption.
3Extent of automation
If conventional RPA bots are developed with third-party tools, then automation functionality is achieved, but dependency on external tools increases
Solution Approach 1:
The patent extracts the core automation functionality from third-party RPA tools and implements it through a custom AI-based system. By taking out the essential element identification, state determination, and action prediction capabilities and rebuilding them with AI models, the system achieves automation independence while maintaining or enhancing adaptability to different applications.
4Ease of manufacture
If standard technical packages are used for RPA development, then implementation ease is improved, but capability to handle dynamic DOM elements is reduced
Solution Approach 1:
The patent implements a dynamic approach to handling DOM elements by training AI models to adapt to changing webpage structures. The system continuously learns from new webpage patterns and adjusts its element identification and state determination strategies, enabling reliable handling of dynamic elements while maintaining ease of development through automated model training and updating processes.
Data Source
AI summary
A method and system for automating repetitive task on a user interface is disclosed. The method includes identifying a plurality of Document Object Model (DOM) elements from a repetitive pattern. The method further includes identifying a set of dynamic DOM elements from the plurality of DOM elements. The method further includes determining a path and a path position within the application code of the repetitive pattern for each of the set of dynamic DOM elements. The method further includes training an Artificial Intelligence (AI) model to identify the repetitive pattern and to identify the corresponding path and the path position within the application code component, for each of the set of dynamic DOM elements. The method further includes automatically executing a code for each of the set of dynamic DOM elements based on the associated path and path position.