Video Random Access Constraints for CRA and BLA Pictures

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video codec standards limit the flexibility of random access points in video bitstreams, restricting the ability to perform operations like fast forwarding, rewinding, and seamless switching between video streams, due to constraints on decodable leading pictures.

Innovation Solution

Introduce 'clean random access' (CRA) and 'broken link access' (BLA) pictures that allow non-decodable leading pictures after CRA pictures, using flags or indicators to manage these pictures, and redefine unit types and constraints to simplify mapping to container formats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional video codec standards are used with strict constraints on leading pictures, then decoding reliability is improved, but adaptability for random access operations deteriorates

Engineering Contradiction:

Improvedecoding reliabilityVSAvoidadaptability for random access operations

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent introduces dynamic picture types (CRA and BLA pictures) that can be flexibly positioned within the bitstream according to random access requirements. These pictures dynamically adjust the reference picture set and allow non-decodable leading pictures under controlled conditions, enabling adaptive random access operations while maintaining decoding reliability through proper syntax element management and reference picture set updates.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes key parameters by introducing new picture type flags (e.g., `broken_link_flag`, `cabac_init_flag`) and modifying the reference picture set management. These parameter changes allow the system to transition between different operational modes (decodable vs. non-decodable leading pictures) and simplify initialization processes during random access, thereby improving adaptability without sacrificing reliability.

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If CRA pictures are allowed in the middle of bitstream with non-decodable leading pictures, then adaptability for random access is improved, but device complexity increases

Engineering Contradiction:

Improveadaptability for random access operationsVSAvoiddecoder complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the bitstream into distinct operational regions by introducing CRA and BLA pictures that create clear boundaries. These segmentation points divide the bitstream into independent decodable units with well-defined reference picture sets, allowing the decoder to initialize and operate independently at each segment boundary, thereby managing complexity through structured division rather than uniform processing throughout the entire bitstream.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary syntax elements and flags (e.g., `broken_link_flag`, `cabac_init_flag`, reference picture set management structures) that mediate between the complex requirements of random access and the decoder's processing capabilities. These intermediaries provide explicit control mechanisms that guide the decoder through non-decodable leading picture scenarios without requiring complex inference or error handling, thus improving adaptability while controlling complexity.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If non-decodable leading pictures are allowed after CRA pictures, then flexibility for video delivery is improved, but loss of information increases

Engineering Contradiction:

Improveflexibility for video deliveryVSAvoidinformation loss from non-decodable pictures

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent applies preliminary action by explicitly marking CRA and BLA pictures with syntax elements that pre-announce the presence of non-decodable leading pictures. This allows the decoder to prepare appropriate handling mechanisms in advance, such as clearing reference picture sets or skipping problematic frames, thereby maintaining flexibility for adaptive video delivery while minimizing information loss through proactive error prevention rather than reactive error correction.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS12513334B2Constraints and unit types to simplify video random access

Publication Date: 2025.12.30 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.