Recorded Screen Operations for Automatic RPA Flow Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current robotic process automation (RPA) technologies require significant time and effort for users to configure input settings and generate flows for software robots, as they need to manually define and arrange operation components, which is inefficient and labor-intensive.
Innovation Solution
An information processing apparatus that uses a recording function to automatically generate operation components and flows based on user interactions with screens, allowing for the automatic association of components according to the order of operations, thereby reducing the need for manual configuration and increasing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual configuration of operation components and flows is used, then flexibility and control are improved, but time consumption and labor effort increase
Solution Approach 1:
The system performs preliminary analysis of screen elements and operation sequences to pre-generate operation components and their associations. By analyzing screen capture images, element information, and operation order in advance, the system automatically creates flow configurations before user execution, significantly reducing manual configuration time while maintaining control through user review and modification capabilities.
2Productivity
If automatic flow generation is implemented, then productivity and efficiency are improved, but system complexity increases
Solution Approach 1:
The system introduces an intermediary flow generation unit that acts as a mediator between screen analysis and operation execution. This unit automatically generates operation components by analyzing screen capture images and element information, then associates them according to operation order. The intermediary layer handles the complexity of automatic generation internally while presenting a simplified interface to users, thereby improving productivity without exposing system complexity.
3Manufacturing precision
If detailed operation components are manually defined, then precision and accuracy are improved, but labor effort and complexity increase
Solution Approach 1:
The system enables self-service automatic generation of operation components by analyzing screen capture images, element information, and operation sequences. The flow generation unit automatically defines operation components with precise details including element identifiers, operation types, and parameter settings without requiring manual configuration. This self-service approach maintains high precision while eliminating the complexity and labor associated with manual definition, allowing users to simply review and execute the generated flows.
Data Source
AI summary
An information processing apparatus includes circuitry. The circuitry displays one or more screens that receive an operation by a user. The circuitry identifies an operation item corresponding to the operation based on display information of the one or more screens, according to the operation on the one or more screens. The circuitry generates an operation component associated with a condition corresponding to the operation item. The circuitry generates a flow of operations based on the operation component according to an order of operations including the operation by the user, the flow of operations being a flow to be processed by a computer that executes an application.