Operation Sequence Adding Method for Electronic Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of third-party applications on smartphones often face difficulties in automating repetitive tasks due to the need for programming knowledge and compatibility issues with screen resolution changes, leading to errors in playback of recorded operations.
Innovation Solution
A method to record and add continuous operations as shortcut icons on electronic devices without requiring programming knowledge, allowing operations to be played back on multiple devices, simplifying the procedure and improving user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If Quick Macro software records click positions to automate operations, then operation automation is achieved, but errors occur when application updates or screen resolution changes
Solution Approach 1:
The patent changes the parameter basis for operation recording from fixed screen coordinates to dynamic UI element identification. Instead of recording absolute click positions that break with resolution changes, the system records UI element identifiers and their hierarchical relationships, allowing operations to adapt automatically when screen parameters change.
Solution Approach 2:
The patent introduces dynamic adaptation mechanisms that allow recorded operations to adjust to changing application states. The system dynamically identifies UI elements during playback based on their current state rather than relying on static coordinate recordings, enabling reliable operation automation even after application updates.
2Ease of operation
If users set shortcut instructions with logic assignment, then operation simplification is achieved, but programming knowledge is required
Solution Approach 1:
The patent enables the system to automatically generate and manage shortcut instructions without requiring user programming. The system self-services by automatically capturing operation sequences, identifying UI elements, and creating executable shortcuts that users can trigger with simple gestures, eliminating the need for users to understand programming logic.
Solution Approach 2:
The patent introduces an intermediary layer between user operations and automation execution. This intermediary system automatically translates user actions into structured operation sequences and manages the complexity of logic assignment, allowing users to benefit from automation without directly handling programming complexity.
3Ease of manufacture
If click operations are recorded based on screen position, then operation recording is simple, but errors occur with different screen resolutions
Solution Approach 1:
The patent creates a universal operation recording mechanism that works across different screen resolutions and device types. By recording operations based on UI element identification rather than screen coordinates, the system achieves multi-functionality that adapts to various display configurations without requiring separate recording configurations for each resolution.
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
An operation sequence adding method, an electronic device, and a system are provided. The method includes: detecting a first operation performed by a user on a first control; obtaining an event type of the first operation and name information of a first application in response to the first operation; displaying a second interface of the first application in response to the first operation, and detecting a second operation performed by the user on a second control; obtaining a second control identifier and an event type of the second operation in response to the second operation; saving the name information of the first application, the second control identifier, and the event type of the second operation; displaying a third interface of a second application, where the third interface of the second application includes a third control; detecting a third operation performed by the user on the third control; and displaying the second interface of the first application in response to the third operation. Therefore, an operation of a user is recorded and played back on an electronic device, an operation procedure of the user is simplified, and user experience is improved.