Video Bitstream RAP Types for Flexible Random Access Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codec standards limit the flexibility of random access points in video bitstreams, restricting the ability to perform operations like fast forwarding, rewinding, and seamless switching between video streams due to constraints on decodable leading pictures.
Innovation Solution
Introduce 'clean random access' (CRA) and 'broken link access' (BLA) pictures that allow non-decodable leading pictures after CRA pictures, using flags or indicators to manage these pictures, and redefine unit types and constraints to simplify mapping to container formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video codec standards enforce strict constraints on decodable leading pictures after random access points, then decoding reliability is improved, but the flexibility and number of accessible random access points deteriorate
Solution Approach 1:
The patent segments the bitstream into multiple independent random access points (RAP pictures) that can be decoded independently. By dividing the video stream into segments starting at different RAP points, the system enables flexible random access while maintaining decoding reliability within each segment. This segmentation allows viewers to jump to any RAP point and decode forward without requiring strict constraints across the entire bitstream.
Solution Approach 2:
The patent introduces dynamic picture types including CRA (Clean Random Access) and BLA (Broken Link Access) pictures that can adaptively serve as random access points. These dynamic RAP types allow the system to flexibly create multiple access points throughout the bitstream based on content and transmission requirements, rather than enforcing static constraints. The decoder can dynamically identify and switch between different RAP points depending on network conditions and user needs.
2Adaptability or versatility
If video bitstreams allow more flexible random access points with non-decodable leading pictures, then adaptability for fast forwarding and stream switching is improved, but decoding complexity and difficulty worsen
Solution Approach 1:
The patent applies preliminary action by embedding advance information in the bitstream that identifies RAP picture locations and types before decoding begins. Syntax elements in the video parameter set and picture parameter set predeclare the positions and characteristics of CRA and BLA pictures, allowing decoders to prepare and efficiently locate random access points without complex runtime analysis. This preliminary structuring reduces decoding complexity while maintaining high adaptability.
Solution Approach 2:
The patent introduces intermediary syntax elements and flags (such as no_output_of_prior_pics_flag, random_access_pic_id, and picture_order_cnt) that mediate between the complex requirements of flexible random access and the simpler needs of decoder implementation. These intermediary elements provide a standardized interface that simplifies decoder logic while enabling sophisticated random access behavior, acting as a buffer between flexibility requirements and decoding complexity.
3Manufacturing precision
If video standards enforce strict constraints on picture ordering and decodability, then manufacturing precision of compliant codecs is improved, but ease of operation for editing and splicing deteriorates
Solution Approach 1:
The patent enables ease of editing and splicing by allowing flexible parameter changes at RAP points. Different RAP types (CRA, BLA, IDR) have different parameter constraints that can be selectively applied based on editing requirements. This allows precise control over where edits can occur and what reference pictures are available, making splicing operations easier while maintaining manufacturing precision through standardized parameter management and syntax element control.
Data Source
AI summary
Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.


