Mobile RPA Workflow Design Through a Model GUI Intermediary
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Automating repetitive tasks on mobile computing platforms, such as smartphones and tablets, poses challenges due to hardware and software heterogeneity and unique user interaction methods like gestures, which conventional robotic process automation (RPA) systems struggle to address effectively.
Innovation Solution
A method and system that utilize a model graphical user interface (GUI) to mimic a mobile computing device, allowing users to input gestures and select target elements, resulting in a computer-readable specification for an RPA robot to replicate these interactions on actual devices, thereby simplifying the programming and deployment of RPA on mobile platforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional RPA systems are used to automate mobile devices, then automation capability is provided, but the systems cannot effectively handle hardware and software heterogeneity across different mobile devices
Solution Approach 1:
The patent creates a digital twin or virtual model of the mobile device interface that replicates the visual appearance and interactive elements of the actual mobile device screen. This virtual model allows the RPA system to interact with and automate mobile devices without directly accessing the physical device, thereby overcoming hardware and software heterogeneity while maintaining automation effectiveness.
2Ease of operation
If graphical user interface tools are used to simplify RPA programming, then ease of use improves, but the complexity of handling mobile-specific gestures and interactions increases
Solution Approach 1:
The patent introduces a virtual model as an intermediary layer between the RPA system and the actual mobile device. This intermediary captures and standardizes mobile-specific gestures and interactions, allowing users to program automation using intuitive graphical tools while the virtual model handles the complexity of translating these interactions into device-specific commands.
3Adaptability or versatility
If RPA is extended to mobile platforms to broaden application scope, then versatility improves, but the requirement for advanced programming skills increases
Solution Approach 1:
By creating a virtual replica of the mobile device interface, the system allows users to design and deploy automation workflows for mobile platforms without needing to understand mobile-specific programming complexities. The virtual model abstracts away the technical difficulties, enabling users with basic programming skills to effectively automate mobile devices.
Data Source
AI summary
In some embodiments, a robotic process automation (RPA) design application provides a user-friendly graphical user interface that unifies the design of automation activities performed on desktop computers with the design of automation activities performed on mobile computing devices such as smartphones and wearable computers. Some embodiments connect to a model device acting as a substitute for an actual automation target device (e.g., smartphone of specific make and model) and display a model GUI mirroring the output of the respective model device. Some embodiments further enable the user to design an automation workflow by directly interacting with the model GUI.