Video Streaming Transition via Intermediate Reference Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video streaming technologies experience significant delays when switching between channels due to network latency, buffer buildup, and decoding latency, leading to gaps in video playback, especially when transitioning between different resolutions or live streaming content.
Innovation Solution
The method involves transitioning between video channels using intermediate channels with different bit rates, frame rates, or frame sizes, and strategically buffering and decoding reference frames to minimize latency, allowing for seamless switching by aligning synchronization frames or using additional reference frames within chunks to facilitate quick decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the device waits for the next index frame to transition to a new channel, then decoding can start cleanly without reference frame issues, but the transition delay increases and live content is missed
Solution Approach 1:
The system performs preliminary buffering of reference frames before the transition point is reached. When a channel change is requested, the device has already cached the necessary reference frames (I-frames or key P-frames) from the new channel in advance, allowing immediate decoding without waiting for the next index frame boundary.
Solution Approach 2:
The patent introduces an intermediate buffering layer between network reception and decoding. This buffer stores reference frames from the new channel temporarily, acting as a mediator that enables seamless transition by providing ready-to-use reference data without requiring synchronization with index frame boundaries.
2Stability of the object's composition
If the device continues displaying the original video source content, then the display remains continuous without gaps, but the buffer buildup increases and transition latency accumulates
Solution Approach 1:
The system skips the traditional approach of continuing to display old content while buffering new content. Instead, it rapidly prepares and switches to the new channel's reference frames as soon as they are buffered, rushing through the transition process to minimize both display gaps and buffer accumulation.
Solution Approach 2:
The patent implements dynamic transition timing rather than static waiting for index frames. The system adapts the transition moment based on when reference frames become available in the buffer, allowing flexible switching that maintains display continuity while preventing buffer overaccumulation.
3Productivity
If additional reference frames are buffered within chunks, then faster decoding is enabled during transition, but the initial buffer requirement increases
Solution Approach 1:
The patent segments the buffer into specific regions for reference frames versus other data. By organizing buffer memory to prioritize storage of I-frames and key P-frames, the system enables fast decoding transitions while efficiently utilizing buffer space, requiring only essential reference frames rather than complete chunk buffering.
Data Source
AI summary
A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.