Adaptive Output Speed Control for Streaming Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional streaming solutions experience high latency, leading to a negative viewer experience due to delays between event occurrence and display, and existing methods for reducing latency often result in detectable changes or increased risk of stalling.
Innovation Solution
Implementing adaptive output speed changes during portions of content with minimal detectability to viewers, such as scenes with less motion or speech, by determining candidate portions and adjusting output speed within specific rate ranges indicated in the bitstream, allowing for reduced latency without noticeable disruptions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If output speed is increased to reduce latency, then latency is reduced, but viewer detection of speed change increases
Solution Approach 1:
The patent applies local quality by differentiating between different portions of content and assigning different output speed change characteristics to each. Specifically, the system identifies portions with high motion or speech (where speed changes would be detectable) versus portions with low motion or speech (where speed changes are less detectable). By locally adapting the output speed based on the characteristics of each content portion, the system reduces latency while minimizing viewer detection of speed changes.
Solution Approach 2:
The patent implements dynamics by making the output speed adjustable and variable rather than fixed. The system dynamically changes the output speed based on real-time analysis of content characteristics (motion and speech levels) and current latency conditions. This dynamic adjustment allows the system to optimize latency reduction while adapting to the detectability constraints of different content segments.
2Loss of time
If output speed is changed to reduce latency, then latency is reduced, but risk of stalling increases
Solution Approach 1:
The patent applies preliminary action by pre-identifying suitable portions for output speed changes before implementing the speed adjustment. The system analyzes the content to identify portions with low motion or speech characteristics that are suitable for speed changes, and prepares these portions in advance. This preliminary identification ensures that when latency reduction is needed, the system can safely adjust speed during pre-validated portions, reducing the risk of stalling.
Solution Approach 2:
The patent implements feedback mechanisms to monitor content characteristics (motion and speech levels) and adjust output speed accordingly. The system continuously evaluates whether current content portions are suitable for speed changes based on their characteristics, and only applies speed adjustments when conditions are favorable. This feedback loop prevents stalling by avoiding speed changes during portions where they would be problematic.
3Loss of time
If buffer size is reduced to reduce latency, then latency is reduced, but bandwidth requirements increase
Solution Approach 1:
The patent applies parameter changes by modifying the output speed parameter rather than changing the buffer size parameter. Instead of reducing buffer size (which would increase bandwidth requirements), the system changes the output speed during specific content portions to achieve latency reduction. This alternative parameter adjustment achieves the same latency improvement goal without the adverse effect of increased bandwidth requirements.
Data Source
AI summary
At least one content item may be received. At least one portion of the at least one content item during which the amount of motion associated with the at least one portion satisfies a threshold may be determined based on an amount of motion associated with the at least one content item. The at least one portion of the at least one content item in which a playback device can modify a rate of playback of the at least one content item may be indicated.