Scalable Video Coding Layered Bitstream for HTTP ABR Streaming

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current HTTP Adaptive Bitrate (ABR) streaming protocols face challenges in low latency scenarios due to long startup times and inefficient track switching, particularly when switching between different bitrates or channels, as they require fetching new segments which is costly and introduces artifacts.

Innovation Solution

The implementation of Scalable Video Coding (SVC) with a layered bitstream structure and anchor frames allows for flexible and efficient video delivery by enabling instantaneous track switching and reduced latency, using HTTP Byte-Range Requests to pull specific byte-ranges of enhanced layers, and prioritizing the base layer for decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If conventional HTTP ABR streaming protocols are used with traditional segment-based delivery, then video content can be delivered with basic adaptive bitrate switching, but startup time is long and track switching introduces artifacts and requires fetching new segments which is costly

Engineering Contradiction:

Improvestartup timeVSAvoidtrack switching efficiency

Core Design Contradiction:

Loss of timeVSProductivity

Solution Approach 1:

The video stream is segmented into layered structures (base layer and enhancement layers) rather than traditional fixed-bitrate segments. This allows the client to receive and decode the base layer immediately while progressively receiving enhancement layers, enabling faster startup and seamless switching without requiring complete segment re-fetches.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The base layer and enhancement layers are prepared and made available in advance at the server side with proper timing relationships established. Anchor frames are strategically placed to enable instantaneous switching points, allowing the client to switch tracks immediately without waiting for new segment boundaries or performing costly re-buffering operations.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If traditional segment-based ABR switching is implemented, then bitrate adaptation is possible, but bandwidth consumption increases due to fetching new segments and introducing artifacts during switching

Engineering Contradiction:

Improvebitrate adaptationVSAvoidbandwidth consumption

Core Design Contradiction:

Adaptability or versatilityVSLoss of energy

Solution Approach 1:

Multiple bitrate representations are merged into a unified layered structure where the base layer serves all bitrate requirements and enhancement layers provide incremental quality improvements. This allows the client to adapt bitrate by selectively receiving enhancement layers rather than fetching entirely new segments, reducing bandwidth consumption and eliminating switching artifacts.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The bitrate adaptation mechanism is made dynamic through on-demand selection of enhancement layers based on current network conditions and client capabilities. The system transitions from static segment-based switching to dynamic layer-based adaptation, allowing continuous bitrate adjustment without the overhead of complete segment re-fetches and reducing unnecessary bandwidth consumption.

Inventive Principle:

Principle #15Dynamics

3Adaptability or versatility

If conventional ABR protocols require fetching new segments for track switching, then bitrate changes can be achieved, but latency increases and switching becomes costly

Engineering Contradiction:

Improvechannel switching capabilityVSAvoidswitching latency

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The essential switching functionality is extracted from the segment-based mechanism and implemented at the layer level. By separating the base layer (common to all tracks) from enhancement layers (specific to each bitrate), the system enables instantaneous switching by simply changing which enhancement layers are received, eliminating the need to wait for new segment boundaries and reducing switching latency dramatically.

Inventive Principle:

Principle #2Taking out (Extraction)

4Ease of manufacture

If traditional HTTP ABR streaming is used, then video delivery can be implemented with standard protocols, but efficiency is reduced due to long startup times and inefficient switching mechanisms

Engineering Contradiction:

Improveprotocol implementation simplicityVSAvoidvideo delivery efficiency

Core Design Contradiction:

Ease of manufactureVSProductivity

Solution Approach 1:

The layered video structure serves multiple functions simultaneously: it enables fast startup by delivering the base layer first, supports seamless bitrate switching through enhancement layers, provides efficient bandwidth utilization by allowing selective layer reception, and maintains compatibility with standard HTTP protocols. This multi-functional approach improves video delivery efficiency without sacrificing implementation simplicity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS20230283789A1Efficient hypertext transfer protocol (HTTP) adaptive bitrate (ABR) streaming based on scalable video coding (SVC)

Publication Date: 2023.09.07 INTEL CORP

AI summary

Various embodiments herein provide techniques related to a content provider in a network. In embodiments, the content provider may identify a request by a client over the network for content; identify a network bandwidth; and transmit, based on the network bandwidth, (1) a base layer of the content without an enhanced layer of the content, or (2) the base layer of the content and the enhanced layer of the content. Other embodiments may be described and/or claimed.