Progressive Video Segment Streaming With Priority-Based Frame Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing adaptive bitrate streaming technologies suffer from latency and frame dropping issues due to network fluctuations, leading to poor quality of experience (QoE) in video streaming, particularly in congested networks where I-frames may arrive late and become useless.
Innovation Solution
Prioritize transmission of high-priority frames, such as I-frames and some P-frames, while buffering and playing at a lower frame rate, and transmit lower-priority frames only if time allows, adjusting frame rate based on available time before playback to minimize latency and frame dropping.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If adaptive bitrate streaming transmits all frames at normal frame rate, then video quality is maintained, but latency increases and frame dropping occurs during network fluctuations
Solution Approach 1:
The patent segments video frames into different priority levels (high priority I-frames and P-frames, low priority B-frames). By dividing the frame stream into priority segments, the system can transmit critical frames immediately while deferring non-critical frames, reducing latency without sacrificing overall video quality consistency.
Solution Approach 2:
The patent applies partial action by transmitting only the essential high-priority frames (I-frames and some P-frames) when network conditions are constrained, rather than transmitting all frames. This partial transmission maintains sufficient video quality while significantly reducing latency and preventing frame dropping during network fluctuations.
2Productivity
If all video frames are transmitted to maintain smooth playback, then frame rate is preserved, but transmission time increases causing latency
Solution Approach 1:
The patent segments frames into priority-based groups, allowing the system to transmit only high-priority frames when time is constrained. This segmentation enables the system to maintain high frame rate for critical frames while accepting lower frame rate for non-critical frames, optimizing the trade-off between productivity and transmission time.
Solution Approach 2:
The patent dynamically adjusts the frame rate based on network conditions and time availability. When transmission time is limited, the system plays back at a lower frame rate for low-priority frames while maintaining high frame rate for high-priority frames. This dynamic adaptation allows the system to maximize overall productivity given time constraints.
3Reliability
If frame dropping is used to reduce playback interruptions, then rebuffering is minimized, but video quality deteriorates
Solution Approach 1:
The patent applies local quality by differentiating the quality treatment of different frame types. High-priority I-frames and P-frames are transmitted with full quality, while low-priority B-frames are transmitted at reduced quality or deferred. This localized quality approach maintains playback continuity by ensuring critical frames are always available, while accepting reduced quality for non-critical frames.
Solution Approach 2:
The patent uses partial action by selectively transmitting only the essential high-priority frames needed for continuous playback, rather than transmitting all frames at full quality. This partial transmission ensures playback continuity is maintained while accepting that some video quality will be compromised for low-priority frames during network-constrained periods.
4Loss of time
If I-frames are prioritized for timely delivery in congested networks, then latency is reduced, but frame rate during playback must be reduced
Solution Approach 1:
The patent segments frames into high-priority (I-frames, some P-frames) and low-priority (B-frames) segments. By transmitting high-priority segments first and immediately, the system achieves reduced latency for critical frames. The low-priority segments can then be transmitted and played back at a lower frame rate, optimizing the trade-off between latency reduction and frame rate maintenance.
Solution Approach 2:
The patent dynamically adjusts playback frame rate based on which frame segments have been transmitted. When only high-priority frames are available, playback occurs at a lower frame rate. As low-priority frames are transmitted and become available, the playback frame rate can be dynamically increased. This dynamic adjustment allows the system to minimize latency for critical frames while maximizing overall frame rate when network conditions permit.
Data Source
AI summary
Video data transmission with prioritized frame sequences is disclosed for faster processing and play of a segment of a content item. High and low priority video frame transmission sequences are determined. Depending on an indication of the time remaining until play of the video segment, when sufficient time remains for reception of only the high priority frames, for example, I-frames and perhaps some P-frames, then only those are transmitted. These may be played at a lower frame rate before continuing with a subsequent video segment. In response to determining that, before start of play of the segment, sufficient time remains for reception of additional frames, for example, some B-frames, the lower priority frames may be transmitted. In this case, the segment may be played at a higher frame rate. Throughput may be determined according to an adaptive bitrate (ABR) implementation.