Video Coding Capability Advertisement Framework

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video coding technologies face challenges in efficiently advertising encoder capabilities, initializing encoder configurations, and signaling run-time control messages, particularly in scenarios involving scalable and simulcast video coding, which complicates the delivery of video content to devices with varying capabilities and network conditions.

Innovation Solution

A framework is introduced that enables the advertisement of encoder capabilities, initial configuration, and run-time control messaging for video coding and decoding, allowing for scalable and simulcast video coding/decoding by exchanging data between encoding and decoding controllers, including requests for encoder capability data, stream configuration, and run-time control messages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If scalable video coding is used to provide multiple versions of video at different quality levels, then video delivery flexibility is improved, but encoder configuration complexity increases

Engineering Contradiction:

Improvevideo delivery flexibilityVSAvoidencoder configuration complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The video stream is segmented into multiple independent bitstreams, each representing a different quality level (base layer and enhancement layers). This segmentation allows the encoder to provide multiple versions of video simultaneously, improving delivery flexibility without requiring complex runtime reconfiguration, as each bitstream can be independently decoded based on receiver capabilities.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The encoder configuration is established in advance through capability advertisement and initialization procedures. The encoder advertises its supported scalable video coding capabilities before encoding begins, and the receiver selects appropriate configuration parameters beforehand. This preliminary action resolves configuration complexity by establishing all necessary settings before runtime, eliminating the need for complex runtime reconfiguration.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If multiple bitstreams are encoded for different device capabilities, then compatibility across devices is improved, but encoding computational load increases

Engineering Contradiction:

Improvedevice compatibilityVSAvoidencoding computational load

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

Multiple bitstreams are merged into a single scalable video coding structure where base layer and enhancement layers are integrated. This merging allows the encoder to process one unified video source while generating multiple quality levels simultaneously, improving device compatibility without proportionally increasing computational load, as the enhancement layers reuse base layer information through inter-layer prediction.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The encoder uses parameter changes in the scalable video coding structure to adapt to different device capabilities. By modifying scalability parameters (such as spatial resolution, temporal resolution, and quality layers) rather than encoding completely separate bitstreams, the encoder achieves broad device compatibility while controlling computational load through efficient parameter-based adaptation.

Inventive Principle:

Principle #35Parameter changes

3Ease of operation

If encoder capabilities are advertised before encoding, then receiver device selection is improved, but communication overhead increases

Engineering Contradiction:

Improvereceiver device selectionVSAvoidcommunication overhead

Core Design Contradiction:

Ease of operationVSQuantity of substance

Solution Approach 1:

Encoder capability information is extracted and advertised separately from the actual video bitstream through dedicated capability advertisement messages. This extraction allows receivers to obtain necessary selection information without processing the entire video stream, improving device selection ease while minimizing communication overhead by transmitting only essential capability metadata rather than full video data.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS11089343B2Capability advertisement, configuration and control for video coding and decoding

Publication Date: 2021.08.10 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Innovations described herein provide a framework for advertising encoder capabilities, initializing encoder configuration, and signaling run-time control messages for video coding and decoding. For example, an encoding controller receives a request for encoder capability data from a decoding host controller, determines the capability data, and sends the capability data in reply. The capability data can include data that indicate a number of bitstreams, each providing an alternative version of input video, as well as data that indicate scalable video coding capabilities. The decoding host controller creates stream configuration request data based on the encoder capability data, and sends the configuration request data to the encoding controller. During decoding, the decoding host controller can create and send a control message for run-time control of encoding, where the control message includes a stream identifier for a bitstream and layer identifiers for a given layer of the bitstream.