Adaptive Screen Content Sharing Framework for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing screen content sharing technologies face inefficiencies due to strict software requirements, high network resource consumption, and degraded video quality, particularly when sharing diverse screen contents like web pages and videos across different operating systems and devices.
Innovation Solution
An adaptive screen content sharing framework that models shared content as a tree of objects, allowing for generalized descriptions and flexible trimming of content to accommodate various devices, enabling efficient transmission and rendering across different computational contexts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If original video files are shared directly, then video quality is maintained, but network bandwidth consumption increases
Solution Approach 1:
The screen content is segmented into different types (video regions, text regions, static regions). Video regions are handled by sharing original video files when detectable, while other regions use efficient compression. This segmentation allows selective application of different sharing strategies to optimize both quality and bandwidth usage.
Solution Approach 2:
The system dynamically changes the sharing parameter based on content type: for video content, it shares original files with high bitrate; for other content, it uses compressed pixel maps. This parameter change resolves the contradiction by adapting the sharing method to the specific content being displayed.
2Adaptability or versatility
If screen content is captured continuously as pixel maps, then software compatibility is improved, but network resource consumption increases
Solution Approach 1:
The screen is segmented into video regions and non-video regions. Video regions are identified and handled separately using original file sharing, while non-video regions continue to use pixel map capture. This reduces overall network resource consumption while maintaining software compatibility for the pixel-mapped portions.
Solution Approach 2:
The system introduces an intermediary analysis layer that examines screen content to identify video regions. This intermediary process enables selective handling of different content types, reducing the need to capture and transmit all screen content as pixel maps, thereby lowering network resource consumption while preserving compatibility.
3Ease of manufacture
If entire screen is captured without regard to content, then implementation simplicity is maintained, but transmission efficiency decreases
Solution Approach 1:
The screen capture process is segmented into content-aware regions. Instead of capturing the entire screen uniformly, the system identifies and segments video regions for special handling. This segmentation improves transmission efficiency by avoiding redundant capture and transmission of video content that can be shared more efficiently through original file sharing.
Solution Approach 2:
The capture parameter changes based on content type detection. When video content is detected in a region, the system switches from pixel map capture to original video file sharing for that region. This dynamic parameter change improves transmission efficiency while maintaining implementation feasibility through automated content analysis.
4Quantity of substance
If compressed pixel maps are shared, then bandwidth consumption is reduced, but video definition is degraded
Solution Approach 1:
The screen content is segmented to identify video regions. For these regions, the system applies a different sharing strategy (original video file sharing) that maintains high definition while controlling bandwidth usage. Non-video regions continue to use compressed pixel maps, achieving the right balance between bandwidth consumption and video definition.
5Productivity
If RDP protocol is used to rebuild screen content, then rendering efficiency is improved, but system compatibility is reduced
Solution Approach 1:
The system adopts a universal approach by using pixel map capture and transmission that can be rendered by any device with a standard display interface. This multi-functional approach maintains system compatibility across different platforms while achieving good rendering efficiency through intelligent content analysis and selective original file sharing for video regions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A framework for a screen content sharing system with generalized screen descriptions is described. In one approach, a screen content update message is sent from a client device to a control plane where the client device wishes to share its screen content with a remote device. The remote device sends a message indicating an interest in receiving said update. The control plane subsequently retrieves a detailed description from the client device. Based on the computational context of the remote device, the detailed description may be trimmed to a more compatible format. In some embodiments, the detailed description is sent to the remote device and includes a screen description and a content description. The content of the shared screen is described and the content is subsequently retrieved from a service router. A shared screen content is assembled based on the screen description and the content retrieved from the service router.