Metadata Hints for Best Effort Video Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video coding systems face challenges in power reduction and energy efficiency, particularly with the increasing demand for video delivery and streaming, which can outweigh the benefits of advanced manufacturing techniques, as decoding complexity for newer standards like HEVC/H.265 is significantly higher than older standards like AVC/H.264, and mobile devices consume a large portion of internet traffic.
Innovation Solution
A coder/decoder system that allows dynamic switching between decoding protocols based on resource conservation, with an encoder estimating when to switch to a resource-saving mode by providing metadata identifiers for distortion and resource levels, enabling the decoder to engage alternative decoding operations that conserve resources without significantly degrading image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If advanced video coding standards like HEVC/H.265 are used, then video quality and compression efficiency are improved, but decoding complexity and power consumption increase significantly
Solution Approach 1:
The system dynamically switches between full decoding and best-effort decoding modes based on real-time resource availability. The decoder monitors resource metrics (power, processing capacity) and adaptively adjusts the decoding strategy, transitioning from protocol-mandated full decoding to simplified best-effort decoding when resources are constrained, and vice versa when resources are abundant.
Solution Approach 2:
The invention changes the decoding parameter set based on resource conditions. When resources are sufficient, the decoder uses the complete protocol-mandated parameter set for optimal quality. When resources are constrained, it switches to a reduced parameter set for best-effort decoding that maintains acceptable quality while reducing computational load and power consumption.
2Manufacturing precision
If protocol-mandated decoding operations are performed, then image quality is maintained, but resource consumption increases
Solution Approach 1:
The best-effort decoding performs partial decoding operations instead of complete protocol-mandated operations. It selectively applies only the most critical decoding steps necessary to achieve acceptable image quality, omitting less essential processing stages. This partial action approach reduces resource consumption while maintaining sufficient quality for the given resource constraints.
Solution Approach 2:
The system employs simplified, less resource-intensive decoding algorithms for best-effort mode that accept lower quality output. These are essentially 'cheap' decoding variants that consume fewer resources and produce acceptable but not optimal results, suitable for situations where resource conservation is prioritized over maximum quality.
3Use of energy by stationary object
If decoding complexity is reduced for power savings, then energy efficiency improves, but image quality degradation increases
Solution Approach 1:
The system incorporates feedback mechanisms where the decoder monitors both resource conditions and output quality metrics. Based on this feedback, it dynamically adjusts the decoding strategy, increasing decoding thoroughness when quality degradation becomes unacceptable and reducing effort when quality remains within acceptable thresholds, thus optimizing the energy-quality tradeoff.
Solution Approach 2:
The decoding complexity is made dynamic rather than static. The system continuously adapts the level of decoding effort based on real-time assessment of both resource availability and observed image quality, transitioning smoothly between different decoding intensities to maintain optimal energy efficiency while preventing unacceptable quality degradation.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
In a coding system, an encoder codes video data according to a predetermined protocol, which, when decoded causes an associated decoder to perform a predetermined sequence of decoding operations. The encoder may perform local decodes of the coded video data, both in the manner dictated by the coding protocol that is at work and also by one or more alternative decoding operations. The encoder may estimate relative performance of the alternative decoding operations as compared to a decoding operation that is mandated by the coding protocol. The encoder may provide identifiers in metadata that is associated with the coded video data to identify such levels of distortion and/or levels of resources conserved. A decoder may refer to such identifiers when determining when to engage alternative decoding operations as may be warranted under resource conservation policies.