Access Point Segment Processing for Streaming Buffering Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current streaming technologies face significant buffering latency issues, causing delays before live or recorded multimedia content can be played, especially when switching between streams, as client devices require a predetermined number of segments or playback time to be buffered before rendering can initiate, leading to user dissatisfaction with black screens during transition periods.
Innovation Solution
The method involves generating a set of particular segments with a longer playback duration than regular segments by modifying timestamps or duplicating/padding the payload, allowing the client device to start rendering earlier while maintaining the required playback reserve, by processing regular segments into sets of particular segments that meet the client device's buffering prerequisites.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the client device buffers a predetermined number of segments before rendering, then the playback stability is improved, but the initial buffering latency increases
Solution Approach 1:
The patent divides the buffering requirement into two separate buffers: a first buffer that stores a predetermined number of segments for playback stability, and a second buffer that stores additional segments to enable earlier rendering initiation. This segmentation allows the system to meet the stability requirement while reducing perceived latency by having content ready in the second buffer before the first buffer is fully populated.
Solution Approach 2:
The patent performs preliminary buffering action by pre-populating the second buffer with segments before the client device actually needs to render. The access point or streaming server continues to buffer segments in the second buffer even after the first buffer has enough segments for stable playback, so that when rendering starts, content is already prepared and ready, reducing the perceived waiting time for the user.
2Reliability
If the streaming server transmits segments continuously, then the content delivery reliability is improved, but the client device experiences longer waiting time before playback can start
Solution Approach 1:
The streaming server or access point performs preliminary buffering by continuously receiving and storing segments in both the first and second buffers before the client device initiates playback. This preliminary action ensures that when playback starts, the client device can immediately access segments from the second buffer without waiting for continuous transmission to populate the buffer, thus reducing waiting time while maintaining delivery reliability.
Solution Approach 2:
The patent creates a copy of the segment stream by maintaining two separate buffers (first buffer and second buffer) that both receive the same continuous stream of segments. The second buffer acts as a copy that is prepared in advance, allowing the client device to start playback earlier by accessing the second buffer while the first buffer continues to be populated for stability.
3Adaptability or versatility
If the access point adapts the program stream for client device rendering capabilities, then the compatibility is improved, but the processing time increases
Solution Approach 1:
The access point performs stream adaptation and segmentation in advance, during the preliminary buffering phase, before the client device needs to play back the content. By adapting the program stream into the first and second buffers beforehand, the access point reduces the processing time required at playback initiation, as the adaptation work is completed during the continuous buffering period.
Solution Approach 2:
The access point autonomously adapts and segments the program stream based on the client device's rendering capabilities without requiring real-time negotiation or adjustment during playback. The adaptation parameters are determined and applied in advance during the buffering phase, allowing the system to serve the adapted content efficiently once playback begins.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
A method for initiating a transmission of a program stream (13) for delivery from a local access point (40) to a client device (50), said program stream (13) being structured as a plurality of regular segments (3) relating to a single event. This method comprises the steps of: (a) processing at least one of the regular segments (3) into a set (4) of particular segments (5), where the at least one regular segment (3) carries a payload of a first playback duration (T1) and the payload of said set (4) represents a second playback duration (T2) that is greater than that of the first playback duration (T1), and where the second playback duration (T2) is sufficient to comply with a client device requirement for initiating a rendering of the event, and (b) transmitting, during an initial period, from the local access point (40) said set (4) of particular segments (5).