Relative Position Software Operation Recording Across Display Environments
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing systems lack the ability to efficiently record and replicate software operation procedures across different display environments with varying screen sizes and resolutions, leading to inconsistencies in software execution.
Innovation Solution
An information processing apparatus with a recording unit that captures and generates control information based on the relative display position relationships of software elements, allowing for the recording and execution of operation procedures across different environments by identifying software and files through fixed display positions and generating control information for robotic process automation (RPA).
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If software operation procedures are recorded based on absolute display positions, then the recording is simple and straightforward, but the execution becomes inconsistent across different screen sizes and resolutions
Solution Approach 1:
The patent changes the parameter basis from absolute display positions (pixel coordinates) to relative display positions (position relationships between software elements). This allows the same operation procedure to be executed consistently across different screen sizes and resolutions by maintaining the relative spatial relationships rather than fixed coordinates.
Solution Approach 2:
The system dynamically adapts the recorded operation procedure to different display environments by calculating relative positions based on the actual software element locations during execution. This makes the system flexible and adaptable to various screen configurations while maintaining execution accuracy.
2Adaptability or versatility
If the system adapts to different screen sizes and resolutions, then execution consistency is improved, but the system complexity increases
Solution Approach 1:
The patent creates a universal control information format that can be executed across different display environments. By using relative position relationships instead of absolute coordinates, the same control information structure works universally across various screen sizes and resolutions without requiring environment-specific adaptations.
Solution Approach 2:
The system introduces relative position relationships as an intermediary layer between the recorded operation procedure and the actual software elements. This intermediary abstraction allows the system to handle different display environments without directly managing the complexity of absolute position calculations for each specific screen configuration.
3Measurement precision
If absolute position recording is used, then the recording process is simple, but the operation procedure cannot be executed accurately on different displays
Solution Approach 1:
The patent changes the measurement parameter from absolute position (fixed coordinates) to relative position (spatial relationship between elements). This improves identification accuracy across different displays while the automated calculation of relative positions minimizes the additional recording time required.
Data Source
AI summary
An information processing apparatus includes a recording unit that records an operation procedure of a piece of software operated in a region where a relative display position relationship among pieces of software is set, and generates control information that controls operation of the piece of software in accordance with the operation procedure.