STSA Sample Groupings for Temporal Layer Switching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The increasing popularity of digital media has presented challenges in efficiently representing high-quality digital media for storage, transmission, and playback, particularly in terms of coding efficiency and temporal layer switching in electronic devices.

Innovation Solution

The implementation of step-wise temporal sub-layer access (STSA) sample groupings, which involve encoding and signaling STSA samples within an ISO base media file format, extended to support High Efficiency Video Coding (HEVC) video streams, to facilitate efficient temporal layer switching and improved coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If digital media is encoded with high quality, then media quality is improved, but storage and transmission efficiency deteriorates

Engineering Contradiction:

Improvemedia qualityVSAvoidstorage and transmission efficiency

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The video stream is divided into multiple temporal layers with different quality levels. Each layer represents a segment of the overall video content with progressively higher quality, allowing receivers to selectively decode only the necessary layers based on available bandwidth and processing power, thus achieving high quality where needed while maintaining efficiency overall

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The encoding system uses variable quality parameters across different temporal layers, adjusting compression ratios and encoding complexity dynamically. Lower layers use higher compression for efficiency, while upper layers use lower compression for quality, resolving the contradiction between media quality and storage/transmission efficiency

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If temporal layer switching is implemented, then adaptability is improved, but device complexity increases

Engineering Contradiction:

Improvetemporal layer switching capabilityVSAvoidcoding and decoding complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The temporal layer switching mechanism dynamically adjusts the number and quality of decoded layers based on real-time network conditions, device capabilities, and user preferences. This dynamic adaptation allows the system to maintain high versatility while managing complexity through intelligent resource allocation rather than fixed complex processing

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The video stream is pre-encoded with multiple temporal layers during the encoding phase, with all necessary quality variations prepared in advance. This preliminary action shifts complexity to the encoding stage, allowing the decoding device to simply select and decode appropriate layers without performing complex real-time quality adjustments

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20250133225A1Method for signaling a step-wise temporal sub-layer access sample

Publication Date: 2025.04.24 DOLBY INTERNATIONAL AB

AI summary

An electronic device for encoding a picture is described. The electronic device includes a processor and instructions stored in memory that are in electronic communication with the processor. The instructions are executable to encode a step-wise temporal sub-layer access (STSA) sample grouping. The instructions are further executable to send and/or store the STSA sample grouping.