Cloud Browser UI Feedback Using Element-Level Rendering Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud browsers experience delays in displaying momentary changes in user interface (UI) due to the need for generating and transmitting rendering results for user operations, leading to unrecognized unintentional selections until the final transition is completed.
Innovation Solution
An information processing system that transmits detailed information about user operations and element selections from a cloud server to a client device, allowing the client device to render UI changes swiftly, reducing processing time by offloading some rendering tasks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If the cloud server generates and transmits complete rendering results for all user operations, then the client device can display the final transition result, but the processing time increases and momentary UI changes are delayed
Solution Approach 1:
The patent extracts only the essential information needed for momentary UI change display (element position, size, and type) from the complete rendering result, sending this condensed data to the client device. This allows the client to display immediate feedback without waiting for the complete rendering process, thus reducing processing time while maintaining reliable user feedback recognition.
Solution Approach 2:
The patent segments the rendering process into two parts: (1) generating complete rendering results on the cloud server for final display, and (2) extracting and transmitting only essential element information for immediate UI feedback. This segmentation allows parallel processing and eliminates the sequential dependency that causes delays in momentary UI change display.
2Reliability
If the cloud server processes all rendering operations, then the client device can display the final result, but the client device cannot recognize unintentional selections until rendering completes
Solution Approach 1:
The patent implements preliminary action by extracting and transmitting essential element information (position, size, type) before the complete rendering process finishes. This allows the client device to display momentary UI changes and recognize unintentional selections immediately, while the cloud server continues processing the complete rendering result in the background.
Solution Approach 2:
The patent introduces an intermediary mechanism where the cloud server sends condensed element information to the client device as an intermediate step. This intermediary data enables the client to perform immediate UI feedback and unintentional selection recognition without waiting for the complete rendering process, thus resolving the contradiction between reliability and time loss.
3Productivity
If the system transmits complete rendering results to the client device, then the client can display the final transition result, but the processing load on the cloud server increases
Solution Approach 1:
The patent extracts only the essential information (element position, size, type) from the complete rendering result and transmits this condensed data to the client device. This extraction significantly reduces the amount of data transmitted and processed by the client, improving rendering efficiency while maintaining the necessary functionality for immediate UI feedback.
Solution Approach 2:
The patent segments the rendering task by separating the complete rendering process (executed on the cloud server) from the immediate feedback display (executed on the client device using extracted information). This segmentation allows the cloud server to focus on rendering while the client handles immediate display, improving overall system productivity and reducing unnecessary processing complexity.
Data Source
AI summary
An information processing device configured to transmit a rendering result obtained by processing web content to another information processing device and cause the other information processing device to display the rendering result, the information processing device comprises a reception unit configured to receive information related to a user operation on the web content from the other information processing device; an element acquisition unit configured to acquire an element that is a target of the user operation; an information acquisition unit configured to acquire detailed information of the element when the element is a predetermined element; and a transmission unit configured to transmit the detailed information to the other information processing device.