Live Media Streaming Buffer Management for Network Congestion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current live media streaming technologies face challenges in adapting to dynamic network conditions, leading to playback discontinuity and quality issues due to network congestion and bandwidth fluctuations, particularly on mobile devices and in peer-to-peer architectures, where computation and bandwidth demands are high.

Innovation Solution

A live media streaming system and method that adjusts the transmission order of encoding-decoding units based on importance parameters, temporarily stores and modifies playback times of media data, and switches between bit rates to maintain smooth playback, even under varying network conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a data buffer is used to store media data to mitigate playback discontinuity, then playback smoothness is improved, but network adaptability deteriorates when congestion occurs for a long period

Engineering Contradiction:
Improveplayback smoothnessVSAvoidnetwork adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic buffer management where the buffer threshold is adjusted based on real-time network conditions. When network congestion is detected, the buffer threshold is lowered to trigger earlier refilling actions, allowing the system to adapt to changing network conditions rather than using a fixed buffer size. This dynamic adjustment resolves the contradiction by making the buffer system responsive to network variability while maintaining playback smoothness.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system continuously monitors network conditions and buffer status, using this feedback to adjust buffer management strategies. When congestion is detected, the system receives feedback about network performance and modifies its buffer refilling behavior accordingly. This closed-loop feedback mechanism enables the system to maintain playback smoothness while adapting to network congestion events.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If bitstream switch is used to select different bit rates, then network adaptability is improved, but computation burden increases

Engineering Contradiction:
Improvenetwork adaptabilityVSAvoidcomputation burden
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Instead of implementing full bitstream switching capability that would require complex computation for analyzing and switching between multiple bit rate streams, the patent applies a simplified partial approach. It focuses buffer management efforts on the current active stream, adjusting buffer thresholds and refilling strategies based on network conditions without requiring full bitstream switching infrastructure. This partial action reduces computation burden while maintaining network adaptability.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent introduces buffer management as an intermediary layer between the network and playback. Rather than directly implementing complex bitstream switching at the playback level, the system uses buffer management strategies as a mediator to handle network variability. This intermediary approach simplifies the computational requirements by managing network adaptability through buffer control rather than through complex stream switching logic.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If I-frames are used as reference for P and B frames, then image quality is improved, but switching flexibility deteriorates due to frame dependency

Engineering Contradiction:
Improveimage qualityVSAvoidswitching flexibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent ensures that buffer refilling actions are performed preliminarily before playback reaches critical points. By proactively refilling the buffer with I-frames and key data before they are needed for switching or playback, the system prepares the necessary reference frames in advance. This preliminary action allows for quality image decoding while reducing the urgency and complexity of real-time switching decisions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts buffer management based on the presence and timing of I-frames. When I-frames are detected or anticipated, the buffer management strategy adapts to prioritize their refilling and timing. This dynamic coordination between I-frame availability and buffer management enables the system to maintain image quality through proper I-frame reference usage while improving switching flexibility by anticipating frame dependency requirements.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9680902B2Media streaming method and device using the same
Publication Date: 2017.06.13 IND TECH RES INST
  • US9680902B2 patent drawing
  • US9680902B2 patent drawing
  • US9680902B2 patent drawing

AI summary

A media streaming method and a device using the same are introduced herein. The disclosure introduces a method for smooth and flawless playback of live media streaming in dynamic network environment. When network congestion occurs for a period, a media receiver may play media data as more as possible by adjusting the transmission order of media data meaningful to the receiver or a provider for providing the media data. In one embodiment, the disclosure introduces a method for smooth and flawless playback of live media streaming by caching a certain amount of media data and then playing them at an appropriate speed to catch up to the progress of the live media streaming, or by dynamically changing bit rates of the live media streaming in time by the provider to meet the most acceptable bit rate according to the network environment between the provider and the receiver.