Dynamic Remote Display Encoding for Bandwidth Constraints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Display remoting technologies experience performance degradation due to limited network bandwidth and CPU resources, leading to jerky or delayed animation when users interact with the graphical user interface, particularly during actions like scrolling or dragging windows, resulting in a poor user experience.
Innovation Solution
A system that dynamically alters the encoding method for display information based on user interactions, such as reducing frame rate or encoding quality, to decrease data transmission demands, and reverts back to normal encoding once the interaction ends, using an agent on the host machine to monitor and adjust encoding parameters based on specific user inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the encoding method maintains high frame rate and quality, then user experience during normal operation is good, but network bandwidth and CPU resources are excessively consumed during user interactions
Solution Approach 1:
The encoding method dynamically adjusts frame rate and quality parameters based on real-time detection of user interaction states. During detected interactions (scrolling, dragging, etc.), the system transitions to a lower resource consumption mode with reduced frame rate and quality. When interactions end, the system returns to high-quality mode. This dynamic adaptation resolves the contradiction by making resource consumption variable rather than static.
Solution Approach 2:
The system changes encoding parameters (frame rate, quality) based on user interaction detection. During interactions, parameters are adjusted to reduce bandwidth and CPU usage. The agent monitors user inputs and triggers parameter changes accordingly, allowing the system to operate efficiently under resource constraints while maintaining good user experience during normal operation.
2Use of energy by moving object
If the encoding method reduces data transmission during user interactions, then network bandwidth consumption decreases, but animation smoothness and responsiveness deteriorate
Solution Approach 1:
The system performs preliminary detection of user interactions through an agent that monitors user inputs before significant performance degradation occurs. By detecting interaction start conditions (scrolling, dragging) early, the system can proactively adjust encoding parameters to reduce bandwidth consumption while maintaining adequate responsiveness. The key is detecting the interaction intent before the full impact on animation smoothness manifests.
3Reliability
If the system continuously monitors and adjusts encoding parameters, then user experience during interactions is optimized, but system complexity and processing overhead increase
Solution Approach 1:
The system implements feedback through an agent that continuously monitors user inputs and provides information about interaction states to the encoding system. This feedback loop enables automatic adjustment of encoding parameters based on actual user behavior. The agent detects interaction conditions and triggers appropriate encoding mode changes, creating a closed-loop system that optimizes user experience without requiring complex manual control.
Solution Approach 2:
The encoding system serves itself by automatically adjusting its own parameters based on feedback from the interaction detection agent. The system monitors its own operational state through user input detection and makes self-directed parameter adjustments without external intervention. This self-service approach reduces the need for complex external control mechanisms while maintaining optimization capabilities.
Data Source
AI summary
The disclosure herein describes a server-side system that dynamically enhances user experience on a remoting client device. During operation, the system monitors user inputs on the client device. When a user input involving a predetermined interaction between the user and the GUI on the client device is detected, the system alters parameters of frame encoding based on the user interaction. Frame updates transmitted to the client device during the user interaction are encoded with the altered encoding method to improve user experience. Once the user interaction is ended, the system reverts back to the normal encoding method.