Rate Sorted Entropy Coding for Scalable Video Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Scalable video coding techniques have seen limited practical use due to implementation complexity and increased computational resources required, despite offering flexibility in adapting video quality to available resources or application-level goals.

Innovation Solution

A top-down approach to scalable bitstream structure, where symbols are selected for exclusion based on semantic importance and bit rate, allowing decoders to replicate symbol-dropping decisions without additional signaling, and applying this to existing video compression schemes like HEVC using arithmetic coding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If scalable video coding techniques are implemented, then flexibility in adapting video quality to available resources is improved, but implementation complexity and computational resources increase

Engineering Contradiction:
Improveflexibility in adapting video qualityVSAvoidimplementation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the bitstream into multiple layers with different quality levels. Each layer contains entropy-coded symbols that can be independently decoded, allowing receivers to select appropriate quality levels based on available resources. This segmentation enables flexible adaptation without requiring complex scalable coding structures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of the conventional approach of encoding multiple quality versions and selecting at the decoder, this patent inverts the approach by encoding a single bitstream with rate-sorted entropy coding where the receiver adapts by selecting which symbols to decode based on available bandwidth and computational resources.

Inventive Principle:
Principle #13The other way round (Inversion)

2Adaptability or versatility

If scalable video coding techniques are implemented, then flexibility in adapting video quality to available resources is improved, but computational resources required increase

Engineering Contradiction:
Improveflexibility in adapting video qualityVSAvoidcomputational resources required
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent allows receivers to perform partial decoding by selecting only the necessary number of entropy-coded symbols based on available resources. Instead of fully decoding all symbols, receivers can stop decoding once their resource constraints are met, reducing computational overhead while maintaining adaptability.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If scalable video coding techniques are implemented, then flexibility in adapting video quality to available resources is improved, but decoder compatibility and ease of operation worsen

Engineering Contradiction:
Improveflexibility in adapting video qualityVSAvoiddecoder compatibility
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a universal bitstream format that can be decoded by both simple and complex receivers. The same entropy-coded bitstream can be partially or fully decoded depending on the receiver's capabilities, ensuring broad compatibility while maintaining adaptability across different device types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Productivity

If rate sorted entropy coding is used, then encoding efficiency is improved, but decoder synchronization complexity increases

Engineering Contradiction:
Improveencoding efficiencyVSAvoiddecoder synchronization complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent employs self-synchronizing entropy coding where the bitstream contains inherent synchronization information. The decoder can automatically resynchronize by detecting synchronization markers or using the deterministic nature of the entropy decoding process, eliminating the need for complex external synchronization mechanisms.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11212531B2Methods, systems, and computer readable media for decoding video using rate sorted entropy coding
Publication Date: 2021.12.28 THE UNIV OF NORTH CAROLINA AT CHAPEL HILL
  • US11212531B2 patent drawing
  • US11212531B2 patent drawing
  • US11212531B2 patent drawing

AI summary

According to one method, a method for decoding data using rate sorted entropy coding occurs at a video decoder implemented using at least one processor. The method comprises: receiving rate control information associated with a first bitstream; determining, using the rate control information, a maximum amount of bits available for a next symbol in the first bitstream; determining, using a symbol probability model and a first deterministic algorithm, an amount of bits for a least probable value of the next symbol; and determining that the next symbol is included in the first bitstream if the amount of bits for the least probable value of the next symbol is less than or equal to the maximum amount of bits available for the first bitstream.