NN Post-Filter Energy Metadata for Decoder Video Quality Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern video coding systems face challenges in managing energy consumption, particularly with the introduction of neural-network post-filters, which can increase energy requirements for processing and display, especially in consumer electronics.
Innovation Solution
Incorporating syntax elements in the bitstream to provide energy information related to neural network post-processing filters, allowing decoders to make informed decisions about applying these filters based on energy criteria, thereby allowing the decoders to apply or modify the video accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If neural network post-processing filters are applied to improve video quality, then video processing quality is improved, but energy consumption increases
Solution Approach 1:
The patent changes the parameter of filter application by introducing energy information metadata that allows the decoder to dynamically adjust whether to apply the neural network post-processing filter based on energy criteria. This parameter change enables selective filter application, improving video quality when energy is available while reducing energy consumption when it is not.
2Manufacturing precision
If neural network post-processing filters are applied to enhance video content, then video content quality is improved, but device energy requirements increase
Solution Approach 1:
The patent introduces dynamic decision-making at the decoder side by providing energy information metadata. The decoder can dynamically adjust its behavior based on available energy resources, making the system adaptable to different power conditions while maintaining video quality when energy permits.
Solution Approach 2:
The patent changes the operational parameters of the video decoding system by introducing energy criteria-based filter application. The energy information metadata allows the system to adjust the processing intensity and quality output based on available energy resources.
3Manufacturing precision
If complex neural network filters are used for post-processing, then video quality is improved, but processing complexity increases
Solution Approach 1:
The patent applies partial action by allowing the decoder to selectively apply the neural network filter based on energy criteria. Instead of always applying the complex filter, the system applies it partially or conditionally, reducing processing complexity while maintaining video quality improvement when energy is available.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Specific syntax elements define energy characteristics of a neural network post-processing filter (NNPF) used in a video coding system. An encoded video bitstream carries such syntax elements from an encoding device to a decoding device using a NNPFC mode metadata of a NNPFC-SEI message, thus allowing the encoding device to provide energy consumption information related to the NNPF and allowing the decoding device to handle its energy consumption by deciding whether or not it should apply the NNPF. An encoding method, a decoding method, an encoding apparatus and a decoding apparatus are described.