Video Post-Filter Processing Order Signaling for NNPFs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards lack efficient methods for signaling and specifying processing orders for neural-network post-processing filters, which are crucial for enhancing video quality but are not adequately addressed in current SEI messages.
Innovation Solution
The implementation of neural-network post-processing filters (NNPFs) is signaled through supplemental enhancement information (SEI) messages, allowing for the determination and conversion of processing orders, including zero or more NNPFs and non-NNPFs, to enhance video data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If neural-network post-processing filters are implemented to enhance video quality, then video quality is improved, but the complexity of signaling and specifying processing orders increases
Solution Approach 1:
The patent segments the processing order information into separate fields: a first processing order field for non-NNPF filters and a second processing order field for NNPF filters. This segmentation allows independent signaling of each filter type's processing order, reducing the complexity of managing combined filter sequences while maintaining video quality enhancements from both filter types.
Solution Approach 2:
The patent introduces a new dimension to the SEI message structure by adding dedicated fields for NNPF processing orders alongside existing fields for non-NNPF filters. This dimensional expansion of the data structure enables comprehensive signaling of multiple filter types without overwhelming complexity in any single field.
2Manufacturing precision
If multiple post-processing filters including NNPFs are applied to video data, then video quality is enhanced, but the processing time increases
Solution Approach 1:
The patent establishes processing orders for multiple filters in advance through SEI message signaling before actual video processing occurs. By pre-defining the sequence in which non-NNPF and NNPF filters should be applied, the system avoids runtime decision-making delays and enables efficient batch processing of video frames through multiple enhancement stages.
3Productivity
If processing orders of post-processing filters are signaled in SEI messages, then filter application is optimized, but the SEI message complexity increases
Solution Approach 1:
The patent divides the SEI message into distinct segments: one segment for signaling processing orders of non-NNPF filters and another segment for signaling processing orders of NNPF filters. This segmentation allows each segment to be processed independently, improving filter application efficiency while managing SEI message complexity through structured organization.
Solution Approach 2:
The patent implements partial signaling by providing separate processing order fields only where needed - a first field for non-NNPF filters and a second field for NNPF filters. This partial action approach signals exactly the necessary information without excessive complexity, enabling efficient filter application with minimal overhead.
Data Source
AI summary
A mechanism for processing video data is disclosed. The mechanism includes determining to signal a processing order or a preferred processing order of different post-processing filters, including zero or more neural-network post-filters (NNPFs) and zero or more non-NNPF post-processing filters, in a supplemental enhancement information (SEI) processing order SEI message. A conversion is performed between a visual media data and a bitstream based on the SEI processing order SEI message.