NAL Unit Random Access Identification for Reliable Video Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding syntax lacks easily identifiable/parseable syntax elements for random access points, random access picture types, and leading picture types in high-level syntax structures such as NAL unit headers, which complicates error resilience and bitstream manipulation in video decoding.
Innovation Solution
The method involves determining the current NAL unit type as an Intra Random Access Picture (IRAP) and decoding it as an Instantaneous Decoder Refresh (IDR) or Broken Link Access (BLA) if the previous NAL unit indicates the end of a coded video sequence, or as a Clean Random Access (CRA) if it does not, using flags and implicit derivation from high-level syntax structures to reduce the need for explicit coding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If explicit coding is used for random access point and picture types in NAL unit headers, then identification accuracy is improved, but syntax structure complexity increases
Solution Approach 1:
The patent extracts and removes redundant explicit coding elements from the NAL unit header syntax structure. By taking out unnecessary explicit flags and deriving picture types through implicit rules based on NAL unit type values and decoding context, the syntax structure becomes simpler while maintaining accurate identification of random access points and picture types.
Solution Approach 2:
The syntax structure performs self-service by enabling the decoder to automatically determine picture types and random access point locations through implicit derivation rules. The system uses its own internal state and context information to identify picture types without requiring external explicit signaling, reducing syntax complexity while maintaining functionality.
2Device complexity
If implicit derivation is used for random access point identification, then syntax complexity is reduced, but decoding reliability may worsen
Solution Approach 1:
The patent applies preliminary action by pre-establishing implicit derivation rules and context information before decoding occurs. The decoder is pre-configured with the rules for implicit picture type derivation based on NAL unit type values and decoding context, enabling reliable automatic identification without requiring complex explicit syntax during actual decoding operations.
Solution Approach 2:
The system incorporates feedback mechanisms where the decoder continuously monitors decoding context and adjusts its implicit derivation process accordingly. By using feedback from previously decoded NAL units and the current decoding state, the system maintains high reliability in picture type identification while keeping syntax structure simple.
3Reliability
If more syntax elements are added to NAL unit headers, then error resilience is improved, but bitstream manipulation capability deteriorates
Solution Approach 1:
The patent applies local quality by providing enhanced error resilience features only where needed within specific NAL unit types and contexts, rather than adding syntax elements uniformly across all NAL units. This allows maintaining bitstream manipulation capability for most units while providing targeted error resilience for critical random access points and picture types.
Solution Approach 2:
The system uses partial action by implementing error resilience mechanisms selectively for specific NAL unit types and decoding scenarios rather than applying comprehensive protection to all bitstream data. This approach maintains versatility for bitstream manipulation in most cases while providing sufficient error resilience where required.
Data Source
AI summary
An approach for reconstructing a current Network Abstraction Layer (NAL) unit for video decoding using at least one processor includes determining the current NAL unit to be an Intra Random Access Picture (IRAP) NAL unit; determining whether a previous NAL unit decoded immediately before the current NAL unit indicates an end of a coded video sequence (CVS); based on determining that the previous NAL unit indicates the end of the CVS, decoding the current NAL unit as one from among an Instantaneous Decoder Refresh (IDR) NAL unit or a Broken Link Access (BLA) NAL unit; and based on determining that the previous NAL unit does not indicate the end of the CVS, decoding the current NAL unit as a Clean Random Access (CRA) NAL unit, and reconstructing the decoded current NAL unit.