Staggered Content Stream Segmentation for Latency Shift Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional streaming protocols, such as Apple HLS, experience significant latency shift when switching between live video streams, particularly on mobile devices with limited bandwidth, due to constraints in MPEG video compression, HTTP architecture, and vendor-specific implementations, leading to frustrating delays and quality issues.
Innovation Solution
The solution involves generating multiple content streams with staggered segments, where each stream has segments offset in time relative to others, allowing for controlled latency shift upon switching by utilizing an offset index to identify the optimal stream for seamless transition, thereby minimizing latency shift to a value approximated by the offset Tg.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional streaming protocols (e.g., Apple HLS) are used to deliver live video content, then the system can provide basic streaming functionality with wide compatibility, but significant latency shift occurs when switching between different content streams
Solution Approach 1:
The patent segments the content stream into multiple parallel streams, each with a different time offset. Instead of switching within a single stream, the system creates N segmented streams where each stream contains segments at different temporal positions. This segmentation allows the client to switch between streams with minimal latency variation because each stream is pre-segmented to provide continuous content at offset intervals.
Solution Approach 2:
The system performs preliminary action by pre-segmenting and pre-offsetting multiple content streams before the client needs to switch. The server prepares N streams with predetermined time offsets (Tg, 2Tg, 3Tg, etc.) in advance, so when a switch is requested, the client can immediately transition to a pre-prepared stream without experiencing significant latency shift. This eliminates the need for real-time stream generation during switching.
2Loss of time
If multiple content streams with staggered segments are generated to reduce latency shift, then stream switching latency is reduced to approximately Tg, but the system complexity increases due to managing multiple offset streams
Solution Approach 1:
The patent uses copying by creating N copies of the same content stream, each copy offset by a fixed time interval Tg. Instead of managing fundamentally different stream types, the system replicates the base stream structure with simple temporal offsets. This copying approach reduces complexity because the underlying stream format and structure remain identical across all N streams, requiring only offset tracking rather than complete stream management for each variant.
Solution Approach 2:
The system changes a single parameter (time offset) across multiple streams rather than modifying multiple complex stream parameters. Each of the N streams is identical in format, encoding, and structure, with only the temporal offset parameter differing (Tg, 2Tg, 3Tg, etc.). This single-parameter variation simplifies stream management because the system only needs to track and manage the offset values rather than handling diverse stream configurations.
3Loss of time
If segments are offset by a small value Tg to minimize latency shift, then stream switching maintains low latency variation, but the number of required content streams increases
Solution Approach 1:
The patent implements dynamics by making the number of streams N adaptive rather than fixed. The system can dynamically adjust N based on network conditions, device capabilities, and content requirements. When bandwidth is abundant and low latency shift is critical, N can be increased with smaller Tg values. When bandwidth is limited, N can be reduced with larger Tg values, providing flexible optimization rather than a static configuration.
Solution Approach 2:
The system applies partial action by generating only the necessary number of offset streams (N streams) rather than creating all possible stream variations. The offset interval Tg is chosen to provide sufficient latency reduction without requiring an excessive number of streams. This balanced approach achieves acceptable latency shift reduction with a reasonable number of streams, avoiding the extreme of creating every possible temporal variation.
Data Source
AI summary
A method comprises receiving content from a source, and generating multiple content streams each comprising the received content. Each content stream includes segments comprising respective portions of the received content. Different segmenting is utilized in generating respective ones of the content streams such that the segments in each of the content streams are offset in time relative to corresponding segments in the other ones of the streams. For example, generating the multiple content streams may comprise segmenting n content streams such that each content stream comprises segments of length Ts with corresponding segments in adjacent ones of the content streams being offset from one another by an offset Tg. Such an arrangement ensures that latency shift upon switching between one of the content streams and another content stream in a different set of multiple content streams at a client device can be limited to a value approximated by Tg.