Video Random Access Constraints for Clean Stream Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codec standards limit the flexibility of random access points in video bitstreams, restricting the ability to perform operations like fast forwarding, rewinding, and seamless switching between video streams due to constraints on decodable leading pictures.
Innovation Solution
Introduce 'clean random access' (CRA) and 'broken link access' (BLA) pictures that allow non-decodable leading pictures after CRA pictures, using flags or indicators to manage these pictures, and redefine unit types and constraints for RAP pictures to simplify mapping to container formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional video codec standards are used to ensure strict decodability of leading pictures, then decoding reliability is improved, but the flexibility of random access points and adaptability of video delivery is reduced
Solution Approach 1:
The patent changes the parameter of picture decodability by introducing CRA pictures that can have non-decodable leading pictures, transitioning from the traditional requirement that all leading pictures must be decodable. This allows the system to support more flexible random access scenarios including mid-stream random access and adaptive bitrate streaming, while maintaining decoding reliability through alternative mechanisms like separate parameter sets and proper reference picture management.
2Manufacturing precision
If constraints on leading pictures are enforced to maintain decoding correctness, then manufacturing precision of bitstream structure is improved, but device complexity increases due to additional flags and indicators needed to manage CRA pictures
Solution Approach 1:
The patent segments the bitstream structure by introducing separate parameter sets (SPS, PPS) that can be independently decoded and applied to different picture groups. This segmentation allows CRA pictures with non-decodable leading pictures to be managed separately from traditional I pictures, reducing the complexity burden on individual pictures while maintaining overall bitstream precision through structured parameter organization.
Solution Approach 2:
The patent applies preliminary action by requiring that parameter sets be decoded and configured before they are applied to pictures. This ensures that even though CRA pictures may have non-decodable leading pictures, all necessary decoding parameters and reference picture configurations are prepared in advance, maintaining bitstream structure precision without requiring complex runtime validation.
3Adaptability or versatility
If CRA pictures with non-decodable leading pictures are allowed, then adaptability of video delivery is improved, but loss of information increases due to potentially non-decodable pictures
Solution Approach 1:
The patent introduces parameter sets (SPS, PPS) as intermediary structures that carry essential decoding information independently of picture decodability. Even when leading pictures of a CRA picture are non-decodable, the parameter sets ensure that reference picture configurations, quantization parameters, and other critical information are preserved and can be applied to subsequent decodable pictures, preventing information loss while enabling delivery adaptability.
Data Source
AI summary
Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.