Video Bitstream RAP Types for Flexible Random Access Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video codec standards limit the flexibility of random access points in video bitstreams, restricting the ability to perform operations like fast forwarding, rewinding, and seamless switching between video streams due to constraints on decodable leading pictures.

Innovation Solution

Introduce 'clean random access' (CRA) and 'broken link access' (BLA) pictures that allow non-decodable leading pictures after CRA pictures, using flags or indicators to manage these pictures, and redefine unit types and constraints to simplify mapping to container formats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video codec standards enforce strict constraints on decodable leading pictures after random access points, then decoding reliability is improved, but the flexibility and number of accessible random access points deteriorate

Engineering Contradiction:
Improvedecoding reliabilityVSAvoidflexibility of random access points
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent segments the bitstream into multiple independent random access points (RAP pictures) that can be decoded independently. By dividing the video stream into segments starting at different RAP points, the system enables flexible random access while maintaining decoding reliability within each segment. This segmentation allows viewers to jump to any RAP point and decode forward without requiring strict constraints across the entire bitstream.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic picture types including CRA (Clean Random Access) and BLA (Broken Link Access) pictures that can adaptively serve as random access points. These dynamic RAP types allow the system to flexibly create multiple access points throughout the bitstream based on content and transmission requirements, rather than enforcing static constraints. The decoder can dynamically identify and switch between different RAP points depending on network conditions and user needs.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If video bitstreams allow more flexible random access points with non-decodable leading pictures, then adaptability for fast forwarding and stream switching is improved, but decoding complexity and difficulty worsen

Engineering Contradiction:
Improveadaptability for fast forwarding and stream switchingVSAvoiddecoding complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by embedding advance information in the bitstream that identifies RAP picture locations and types before decoding begins. Syntax elements in the video parameter set and picture parameter set predeclare the positions and characteristics of CRA and BLA pictures, allowing decoders to prepare and efficiently locate random access points without complex runtime analysis. This preliminary structuring reduces decoding complexity while maintaining high adaptability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediary syntax elements and flags (such as no_output_of_prior_pics_flag, random_access_pic_id, and picture_order_cnt) that mediate between the complex requirements of flexible random access and the simpler needs of decoder implementation. These intermediary elements provide a standardized interface that simplifies decoder logic while enabling sophisticated random access behavior, acting as a buffer between flexibility requirements and decoding complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If video standards enforce strict constraints on picture ordering and decodability, then manufacturing precision of compliant codecs is improved, but ease of operation for editing and splicing deteriorates

Engineering Contradiction:
Improvecompliance precision of codecsVSAvoidease of editing and splicing
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent enables ease of editing and splicing by allowing flexible parameter changes at RAP points. Different RAP types (CRA, BLA, IDR) have different parameter constraints that can be selectively applied based on editing requirements. This allows precise control over where edits can occur and what reference pictures are available, making splicing operations easier while maintaining manufacturing precision through standardized parameter management and syntax element control.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12495161B2Constraints and unit types to simplify video random access
Publication Date: 2025.12.09 MICROSOFT TECHNOLOGY LICENSING LLC
  • US12495161B2 patent drawing
  • US12495161B2 patent drawing
  • US12495161B2 patent drawing

AI summary

Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.