Video Random Access Constraints for Clean Mid-Stream Access

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video codec standards limit the flexibility of random access points in video bitstreams, making operations like fast forwarding, rewinding, and switching between streams cumbersome due to constraints on decodable leading pictures, especially when a clean random access (CRA) picture is not at the beginning of the bitstream.

Innovation Solution

Introduce 'broken link access' (BLA) pictures that allow non-decodable leading pictures after CRA pictures in the bitstream, using flags or indicators to manage these leading pictures, and redefine unit types and constraints to simplify mapping to container formats, enabling more flexible video delivery and editing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If CRA pictures are allowed only at the beginning of the bitstream with constraints on non-decodable leading pictures, then decoding reliability is improved, but adaptability and flexibility for random access operations deteriorate

Engineering Contradiction:

Improvedecoding reliabilityVSAvoidflexibility for random access operations

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent segments the bitstream into multiple independent random access segments by introducing CRA pictures at mid-stream positions. Each CRA picture creates a new decoding起点, allowing the bitstream to be divided into independent segments that can be accessed and decoded separately, thereby improving random access flexibility without compromising decoding reliability within each segment.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic flags (no_output_of_prior_pics_flag, broken_link_flag) that allow the decoder to adaptively handle different scenarios. These flags enable the system to dynamically switch between different decoding behaviors based on the presence of non-decodable leading pictures, providing flexibility while maintaining reliability through conditional processing.

Inventive Principle:

Principle #15Dynamics

2Manufacturing precision

If constraints on non-decodable leading pictures are enforced, then decoding correctness is improved, but ease of operation for editing and adaptive delivery deteriorates

Engineering Contradiction:

Improvedecoding correctnessVSAvoidease of operation for editing and adaptive delivery

Core Design Contradiction:

Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent applies preliminary action by inserting CRA pictures at strategically chosen mid-stream positions before editing or adaptive delivery operations. These pre-placed access points allow subsequent operations to start from known good decoding states, making editing and adaptive delivery easier while maintaining decoding correctness through the use of flags that guide the decoder.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses flags (no_output_of_prior_pics_flag, broken_link_flag) as intermediaries between the encoded bitstream and the decoder. These flags mediate the handling of non-decodable leading pictures, allowing the system to maintain decoding correctness by guiding the decoder to skip or handle such pictures appropriately, thereby facilitating easier editing and adaptive delivery operations.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If mid-bitstream CRA pictures are allowed with non-decodable leading pictures, then adaptability for random access is improved, but device complexity increases due to additional flags and constraints

Engineering Contradiction:

Improveadaptability for random accessVSAvoidcomplexity of decoder logic

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the complexity of handling non-decodable leading pictures into separate flag indicators (no_output_of_prior_pics_flag, broken_link_flag) that are attached to CRA pictures. This extraction allows the main decoding logic to remain relatively simple while the flags provide the necessary information to handle complex scenarios, thereby improving adaptability without proportionally increasing overall device complexity.

Inventive Principle:

Principle #2Taking out (Extraction)

4Adaptability or versatility

If multiple types of RAP pictures are introduced, then versatility for different access scenarios is improved, but difficulty of detecting and measuring picture types increases

Engineering Contradiction:

Improveversatility for different access scenariosVSAvoiddifficulty of detecting picture types

Core Design Contradiction:

Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent uses flag indicators (no_output_of_prior_pics_flag, broken_link_flag) as visual markers to distinguish between different types of RAP pictures. These flags act like color codes that immediately indicate the picture type and the required decoding behavior, making it easier for the decoder to detect and handle different RAP picture types without increasing overall complexity.

Inventive Principle:

Principle #32Color changes

Data Source

PatentUS12506901B2Constraints and unit types to simplify video random access

Publication Date: 2025.12.23 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.