Media Bridge QoE Prioritization via RTCP Extension Headers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing real-time communication (RTC) systems lack the ability to dynamically apply user-defined quality of experience (QoE) customization and prioritization metrics, leading to suboptimal user experience due to network conditions and predefined application-layer metrics.
Innovation Solution
The system collects and considers user-input QoE preferences, transmitted as RTCP extension headers, to dynamically prioritize and degrade media streams based on user-defined metrics such as resolution, smoothness, and reliability, ensuring optimal user experience even under degraded network conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If predefined application-layer metrics are used for media stream optimization, then system complexity is reduced, but user-defined QoE customization capability deteriorates
Solution Approach 1:
The patent segments QoE metrics into two distinct categories: predefined application-layer metrics (handled by existing rate adaptation logic) and user-defined custom metrics (handled by new rate adaptation logic). This segmentation allows the system to maintain simple predefined optimizations while simultaneously supporting customizable user preferences without merging the two control paths.
Solution Approach 2:
The patent introduces rate adaptation logic as an intermediary component that receives both predefined metrics and user-defined custom metrics, then synthesizes them to control media stream encoding. This intermediary layer reconciles the conflict between simple predefined rules and flexible user customization by coordinating both input sources through a unified control mechanism.
2Reliability
If objective QoE metrics are optimized by application-layer control mechanisms, then media stream quality is improved, but user preference control deteriorates
Solution Approach 1:
The patent makes the rate adaptation logic dynamic by enabling it to switch between optimizing for predefined metrics and optimizing for user-defined custom metrics based on real-time user input. The system dynamically adjusts which QoE parameters take priority during media stream encoding, allowing users to change their preferences during the communication session without requiring system reconfiguration.
Solution Approach 2:
The patent implements feedback mechanisms where user-defined QoE preferences are continuously collected and fed back to the rate adaptation logic, which then adjusts media stream encoding accordingly. This feedback loop ensures that media stream quality optimization aligns with current user preferences rather than following fixed predefined rules.
3Reliability
If rate adaptation logic optimizes for predefined metrics, then communication reliability is maintained, but user-specific QoE preferences deteriorate
Solution Approach 1:
The patent segments the rate adaptation functionality into distinct processing paths: one path handles communication reliability through predefined metrics (such as packet loss thresholds and jitter tolerances), while another path handles user-specific QoE preferences (such as prioritizing video quality over audio quality). This segmentation allows both reliability maintenance and preference adaptation to coexist without interference.
Solution Approach 2:
The patent applies local quality by allowing different QoE parameters to be optimized at different locations in the media stream processing pipeline. Predefined metrics are applied globally to maintain overall communication reliability, while user-specific preferences are applied locally to specific media streams or parameters based on individual user needs and network conditions.
Data Source
AI summary
A method includes, at a media bridge configured to distribute a plurality of media streams among a plurality of client devices connected to the media bridge over a network during a real-time communication (RTC) instance, receiving a plurality of quality of experience (QoE) preferences from the plurality of client devices via the media bridge, the plurality of QoE preferences being transmitted as a real-time transport protocol (RTP) control protocol (RTCP) extension header of a transmitted data packet. The method also includes receiving a plurality of QoE metrics at the media bridge, and in response to a determination that a degradation in network conditions of the network has occurred, downgrading at least one of the plurality of media streams based on the plurality of QoE preferences.