Broken Link Access Pictures for Flexible Video Random Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codec standards limit the flexibility of random access points in video bitstreams, restricting the ability to perform operations like fast forwarding, rewinding, and seamless switching between video streams due to constraints on decodable leading pictures.
Innovation Solution
Introduce 'broken link access' (BLA) pictures that allow non-decodable leading pictures after a CRA picture in the bitstream, using flags or indicators to manage these leading pictures, and redefine unit types and constraints for random access point pictures to simplify mapping to container formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video codec standards enforce strict constraints on decodable leading pictures after CRA pictures, then decoding reliability is improved, but operational flexibility for random access operations deteriorates
Solution Approach 1:
The patent segments the bitstream into distinct regions by introducing mid-stream CRA pictures that create independent decodable units. This allows the video stream to be divided into separable segments that can be accessed and decoded independently, enabling random access operations without requiring the entire bitstream to conform to strict leading picture constraints.
Solution Approach 2:
The patent introduces dynamic flexibility by allowing CRA pictures to appear at multiple positions within the bitstream rather than only at the beginning. This dynamic placement enables adaptive random access points throughout the video stream, allowing decoders to jump to any CRA picture and decode subsequent pictures with appropriate handling of leading pictures based on actual bitstream conditions.
2Adaptability or versatility
If mid-stream CRA pictures are allowed with non-decodable leading pictures, then access point flexibility is improved, but decoder complexity increases
Solution Approach 1:
The patent applies preliminary action by embedding advance indicators and flags in the bitstream that mark the presence of mid-stream CRA pictures and their associated non-decodable leading pictures. These preliminary markers allow decoders to prepare appropriately before encountering such pictures, identifying them in advance and switching to alternative decoding paths without requiring complex real-time analysis.
Solution Approach 2:
The patent introduces intermediary elements in the form of syntax flags and indicators that mediate between the complex scenario of mid-stream CRA pictures with non-decodable leading pictures and the decoder processing. These intermediary markers simplify the decoder's task by providing clear guidance on how to handle each situation, acting as a bridge between the flexible bitstream structure and the decoding logic.
3Productivity
If constraints on leading pictures are removed for mid-stream CRA pictures, then editing and delivery flexibility is improved, but bitstream processing complexity increases
Solution Approach 1:
The patent applies parameter changes by modifying the bitstream syntax to include new flags and indicators that control the behavior of mid-stream CRA pictures. These parameter changes allow the bitstream to convey information about non-decodable leading pictures and enable flexible editing and delivery operations while maintaining structured processing through well-defined syntax elements that guide the processing complexity.
Data Source
AI summary
Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.