Object-Aware Task Automation from Recorded User Events
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing RPA solutions require professional IT knowledge for script automation, leading to poor performance stability and inefficiency, especially when using recorded user events, necessitating a method to convert these events into optimized scripts suitable for target systems without manual supplementation.
Innovation Solution
A method and system that automatically selects object information from recorded user inputs, generates activities based on predefined patterns, and groups repetitive tasks to create high-level automation scenarios across various systems without requiring manual script designation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If recorded user events are used as automation scenarios directly, then the number of man-hours for script writing is reduced, but performance stability deteriorates
Solution Approach 1:
The patent introduces an intermediary optimization process between recorded user events and automation execution. The recording engine captures user events, which are then processed through an optimization module that analyzes and refines the event sequences into stable automation scenarios, preventing direct execution of raw recorded events.
Solution Approach 2:
The patent replaces the mechanical approach of directly executing recorded events with an intelligent optimization system that uses analysis and transformation algorithms. This substitution transforms the rigid, error-prone direct execution mechanism into a flexible, adaptive optimization process that ensures performance stability.
2Extent of automation
If professional developers write automation scripts, then automation capability is achieved, but ease of operation deteriorates
Solution Approach 1:
The patent enables self-service automation by allowing users to record their own task events without requiring professional developer intervention. The recording engine captures user actions, and the optimization module automatically transforms these into executable automation scenarios, making the system self-sufficient and accessible to non-experts.
Solution Approach 2:
The patent creates a universal automation platform that serves multiple functions: event recording, optimization, and execution. This multi-functional system eliminates the need for separate professional scripting services, allowing any user to automate tasks across different applications and scenarios.
3Reliability
If recording engine designation is required, then system compatibility is maintained, but ease of operation deteriorates
Solution Approach 1:
The system performs self-service by automatically selecting the appropriate recording engine based on the target application or context. Users simply initiate recording without specifying which engine to use, and the system autonomously determines the most suitable engine for the given scenario, maintaining compatibility while simplifying operation.
Solution Approach 2:
The patent creates an equipotential interface where all recording engines appear equally accessible to users through a unified recording initiation mechanism. The complexity of engine selection is equalized and hidden from users, who interact with a single standardized interface regardless of the underlying engine diversity.
Data Source
Figure 1a
Figure 1b
Figure 2
AI summary
A method for providing a task automation service, performed by at least one computing device is provided. The method may include collecting information on an object, in which a user's input occurs, by using a recording engine, generating an object information list for the object based on the information collected by the recording engine, determining first object information corresponding to the user's input based on a result of comparing a plurality of kinds of candidate object information included in the object information list, and automatically generating an activity corresponding to the user's input based on the first object information and predefined pattern information.