Video Coding Segment-Boundary Control for Prediction and Loop Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards lack the ability to selectively enable or disable prediction and in-loop filtering mechanisms at segment boundaries based on content characteristics, limiting coding efficiency and flexibility in parallel processing and network transmission.
Innovation Solution
Implement a system where an encoder can indicate through flags or data structures whether prediction and in-loop filtering tools can operate across segment boundaries, allowing for selective control of these mechanisms at the slice or tile levels, enabling more tailored encoding and decoding processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If prediction and in-loop filtering mechanisms are applied across segment boundaries, then coding efficiency is improved, but error resilience and flexibility in parallel processing are degraded
Solution Approach 1:
The patent implements dynamic control of prediction and filtering mechanisms across segment boundaries through syntax elements that can be set independently for different boundary types (slice, tile, brick). This allows the system to adaptively enable or disable cross-boundary operations based on content characteristics and transmission conditions, resolving the contradiction between maintaining coding efficiency and ensuring error resilience.
Solution Approach 2:
The patent applies different prediction and filtering strategies to different spatial regions and boundary types within the video picture. By allowing independent control of cross-boundary operations for slices, tiles, and bricks, the system can optimize coding efficiency in regions where it benefits performance while maintaining error resilience in regions where it provides robustness, thus resolving the contradiction locally rather than globally.
2Productivity
If prediction and in-loop filtering are enabled across segment boundaries, then coding efficiency improves, but device complexity increases
Solution Approach 1:
The patent segments the control of prediction and filtering mechanisms into distinct syntax elements for different boundary types (slice boundaries, tile boundaries, brick boundaries). This segmentation allows the encoder to selectively enable or disable cross-boundary operations based on specific requirements, avoiding the need to always apply complex operations globally, thus reducing overall device complexity while maintaining coding efficiency where needed.
Solution Approach 2:
The patent introduces controllable parameters (syntax elements) that determine whether prediction and filtering operations extend across segment boundaries. By changing these parameters based on content characteristics and hardware capabilities, the system can adjust the complexity of encoding operations dynamically, resolving the contradiction between coding efficiency and device complexity.
3Productivity
If prediction mechanisms extend across segment boundaries, then coding efficiency is improved, but adaptability to different content characteristics and hardware capabilities is reduced
Solution Approach 1:
The patent implements dynamic adaptability through syntax elements that can be independently configured for different boundary types and content characteristics. The encoder can adaptively decide whether to enable cross-boundary prediction and filtering based on the specific content being encoded and the hardware capabilities, thus maintaining both coding efficiency and adaptability.
Solution Approach 2:
The patent allows different encoding strategies to be applied to different regions and boundary types within the video picture. By enabling independent control of cross-boundary operations for slices, tiles, and bricks, the system can optimize coding efficiency for content that benefits from it while using simpler methods for content where it provides less benefit, thus maintaining adaptability to different content characteristics.
Data Source
AI summary
Described are techniques in video coding and/or decoding that allow for selectively breaking prediction and/or in loop filtering across segment boundaries between different segments of a video picture. A high layer syntax element, such as a parameter set or a slice header, may contain one or more indications signalling to an encoder and/or decoder whether an associated prediction or loop filtering tool may be applied across the segment boundary. In response to such one or more indications, the encoder and/or decoder may then control the prediction or loop filtering tool accordingly.