Video Encoder Parameter Set Control for Temporal Layer Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies do not appropriately set information related to encoding, leading to inefficient video processing.
Innovation Solution
An encoder and decoder system that applies adaptive loop filters with reference restrictions based on temporal IDs and NAL unit types to manage and restrict filter information, ensuring appropriate encoding and decoding of videos with hierarchical temporal scalability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If adaptive loop filters are applied without reference restrictions to all pictures, then filtering quality is improved, but processing complexity and memory usage increase
Solution Approach 1:
The patent applies different filter information reference rules to different picture types based on their NAL unit types. TSA pictures use restricted reference (only from lower temporal layers) while non-TSA pictures use unrestricted reference. This local differentiation optimizes filtering quality for each picture type while managing processing complexity appropriately.
Solution Approach 2:
The patent segments the video stream into different picture types (TSA and non-TSA) with different temporal ID characteristics. By segmenting the reference rules according to picture type, the system can apply appropriate filtering strategies to each segment, balancing quality and complexity.
2Manufacturing precision
If filter information from all temporal layers is referenced for encoding, then encoding quality is improved, but processing time and complexity increase
Solution Approach 1:
The patent implements local quality by applying different reference restrictions to different picture types. TSA pictures (with non-smallest temporal IDs) reference only filter information from lower temporal layers, while non-TSA pictures reference from all temporal layers. This localized approach optimizes encoding quality for each picture type while managing processing time.
Solution Approach 2:
The patent dynamically adjusts the reference scope of filter information based on the NAL unit type and temporal ID of each picture. The reference rules are not static but adapt to the specific picture being encoded, allowing optimal balance between quality and processing time for each frame.
3Manufacturing precision
If unrestricted reference of filter information across temporal layers is allowed, then decoding quality is improved, but system complexity and memory requirements increase
Solution Approach 1:
The patent applies local quality by implementing different reference restrictions for different picture types during decoding. TSA pictures use restricted reference from lower temporal layers only, while non-TSA pictures use unrestricted reference. This reduces system complexity for TSA pictures while maintaining decoding quality where appropriate.
4Adaptability or versatility
If filter information is managed without temporal layer restrictions, then encoding flexibility is improved, but reliability of temporal scalability deteriorates
Solution Approach 1:
The patent ensures reliability of temporal scalability by applying local quality rules: TSA pictures (which enable temporal switching) reference only filter information from lower temporal layers, ensuring that temporal scalability is maintained. Non-TSA pictures can use unrestricted reference for better quality where temporal switching is not required.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An encoder (100) which encodes a video including a plurality of pictures includes circuitry (160) and memory (162). Using the memory (162), the circuitry (160) performs: encoding a first picture among the plurality of pictures; and performing (i) a first operation for encoding a parameter set for a second picture which follows the first picture in coding order among the plurality of pictures after encoding the first picture, and encoding the second picture after encoding the parameter set, or (ii) a second operation for encoding the second picture without encoding the parameter set after encoding the first picture. The circuitry (160) performs the first operation when the second picture is a determined picture, in the performing of the first operation or the second operation.