Screen Sharing Encoding Adaptation for Content Class
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing screen sharing technologies prioritize network state over content type, leading to potential interruptions or reduced resolution in shared screen images.
Innovation Solution
A method and apparatus that detect the class of content on a screen and adjust frame rate and resolution based on a Quality of Experience (QoE) policy, considering both the content type and network state to optimize the sharing of screen data among devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the bitrate is adjusted based only on network state, then network adaptability is improved, but image quality and continuity deteriorate
Solution Approach 1:
The system changes encoding parameters (bitrate, resolution, frame rate) dynamically based on both network state and content type. Different content types (game, video, chat, browser) receive different QoE policies, allowing the system to optimize image quality for each content type while adapting to network conditions, thus resolving the contradiction between network adaptability and image continuity
Solution Approach 2:
The system dynamically adjusts encoding parameters in real-time based on the detected content type and current network state. The QoE policy is not fixed but adapts dynamically to changing conditions, ensuring optimal image quality maintenance while maintaining network adaptability across different scenarios
2Manufacturing precision
If high bitrate is transmitted, then image quality is improved, but network load increases
Solution Approach 1:
The system changes the bitrate parameter dynamically based on content type and network state. Instead of using a fixed high bitrate, the system adjusts the bitrate to match the actual quality requirements of different content types, transmitting higher bitrates only when necessary (e.g., for video or game content) and using lower bitrates for text or chat, thus optimizing the balance between image quality and bandwidth consumption
3Speed
If frame rate is increased, then motion smoothness is improved, but data transmission volume increases
Solution Approach 1:
The system dynamically adjusts the frame rate parameter based on content type and network conditions. Motion-intensive content types (games, video) receive higher frame rates to maintain smoothness, while static or low-motion content types (text, chat, browser) receive lower frame rates, reducing unnecessary data transmission while maintaining acceptable quality for each content type
Data Source
AI summary
A method of improving quality of experience (QoE) in a first device which shares a screen of the first device with a second device includes: detecting a class of a content currently displayed on the screen; determining a QoE policy based on the detected class of the content; encoding a screen image of the screen based on the determined QoE policy; and transmitting the encoded screen image to the second device. As such, when a screen is shared among a plurality of devices, optimal QoE may be achieved with respect to each class of a content.