Browser Operation Recording via External Element Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing configurations for recording browser operations are inefficient due to high processing demands on computers and a large number of user operations, making it difficult to effectively record operation procedures.
Innovation Solution
A computer program and system that displays a browser image, outputs selection positions, acquires element information such as size and position from an external device, and displays selection objects on the browser image, allowing for efficient recording of browser operation procedures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the configuration of Patent Document 1 is used for recording operation procedures, then the operations can be recorded, but the processing load on the computer is large and the number of user operations is large, making the recording inefficient
Solution Approach 1:
The patent introduces an external device as an intermediary that performs the complex analysis processing. The terminal device (recording device) only needs to output selection positions and receive element information, while the external device handles the computationally intensive tasks of analyzing browser elements, determining their positions and sizes. This mediator approach resolves the contradiction by offloading processing complexity from the recording system.
Solution Approach 2:
The patent extracts the complex analysis processing function from the terminal device and places it in an external device. By separating the lightweight selection output function from the heavy analysis function, the system achieves efficient recording with minimal processing load on the terminal device, while still obtaining complete element information through the external analysis capability.
2Productivity
If the configuration of Patent Document 1 is used for recording operation procedures, then the operations can be recorded, but the number of user operations is large, making the recording process cumbersome
Solution Approach 1:
The patent enables the system to automatically perform analysis processing without requiring users to manually specify element positions or sizes. Once the user outputs a selection position, the external device automatically analyzes the browser element, determines its properties, and returns the information. This self-service automation dramatically reduces the number of user operations needed while maintaining accurate recording.
Solution Approach 2:
The external device performs preliminary analysis of browser elements in advance, preparing element information that can be quickly retrieved during recording. By pre-analyzing element positions, sizes, and identifiers, the system reduces the interactive steps users must perform during actual recording operations, improving ease of use.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A recording program (52) is used to record the procedure of an operation automatically performed on a browser screen, and causes a control unit (66) to execute the following processing. The control unit (66) executes processings of: displaying a browser image in which the browser screen is shown; and outputting a selection position selected on the browser image to an external device. Then, the control unit (66) acquires, regarding an element located at the screen position of the browser screen corresponding to the output selection position, element information indicating the size of the element and the image position of the element on the browser image, from the external device. The control unit (66) displays an object, which indicates that the element is selected, on the browser image based on the acquired element information.