Proxy Streaming Control Using End-Device QoE Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing streaming technologies fail to adapt to variations in link quality between a proxy device and an end device, resulting in poor presentation quality at the end device due to packet drops and skipped content, despite stable connections between the content server and the proxy device.
Innovation Solution
Implement a method where the content server, proxy device, and end device exchange information about the end device's context and Quality of Experience, allowing decisions on transmission control to be made at the appropriate entity based on this information, using streaming control protocols to adapt transmissions accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the client device acts as a proxy device to forward streams to the end device, then the stream can be transferred to another device (e.g., wireless headset or TV monitor), but the original streaming from the server does not adapt to variations in link quality between the proxy device and the end device, resulting in poor presentation quality with packet drops and skipped content
Solution Approach 1:
The end device transmits Quality of Experience (QoE) information back to the content server through the proxy device. This feedback loop enables the server to monitor the actual playback quality at the end device and adjust transmission parameters accordingly, resolving the contradiction by making the streaming adaptive to the second link's conditions.
Solution Approach 2:
The proxy device serves as an intermediary that not only forwards media packets but also transmits QoE information from the end device to the content server. This intermediary role allows the system to bridge the information gap between the server (which controls the first link) and the end device (which experiences the second link's quality issues).
2Ease of operation
If Quality of Service parameters are transmitted between devices using Bluetooth protocol, then the transmission can be controlled, but when the stream between proxy device and end device uses UDP protocol, the original streaming from server cannot adapt to link quality variations
Solution Approach 1:
The proxy device acts as an intermediary that collects QoS information from the end device (wherever it comes from - Bluetooth, UDP, or other protocols) and translates it into meaningful QoE feedback that the content server can understand and act upon. This intermediary function enables stream adaptation without being constrained by the specific protocol used between proxy and end device.
Solution Approach 2:
The system changes the parameter being monitored from raw QoS metrics at the proxy device to Quality of Experience metrics at the end device. By focusing on actual playback quality parameters (packet loss experienced, buffering events, etc.) rather than link-layer QoS parameters, the system achieves protocol-agnostic stream adaptation.
3Duration of action of stationary object
If the stream continues between server and proxy device without adaptation, then the transmission can maintain continuity, but the final presentation quality at the end device is poor with packet drops and skipped video or audio content
Solution Approach 1:
The system implements feedback by having the end device report QoE information to the content server. This feedback enables the server to detect quality issues and adjust transmission parameters (bitrate, resolution, etc.) to maintain both continuity and quality, resolving the contradiction between uninterrupted streaming and presentation quality.
Solution Approach 2:
The streaming system transitions from a static, fixed-rate transmission to a dynamic system that continuously adapts transmission parameters based on real-time QoE feedback. This dynamic adjustment allows the system to maintain optimal quality and continuity by responding to changing network conditions between the proxy device and end device.
Data Source
AI summary
Communications from a content server to an end device via a proxy device are controlled. The content server and the proxy device are connected by a first link using a streaming control protocol. The proxy device also has a connection to the end device over a second link. The method includes obtaining information about a context of the end device. The method further includes determining where a decision should be made about controlling transmissions from the content server over the first link, based on the information about the context of the end device. The method further includes controlling transmissions from the content server over the first link, based on information relating to a Quality of Experience at the end device.