Hierarchical Video Decoder Integration With Codec Wrapper Plug-Ins
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video decoding technologies face challenges in efficiently integrating hierarchical coding formats like LCEVC with existing decoders without complete redesign, requiring efficient and backward-compatible solutions that can support various codecs and platforms.
Innovation Solution
A video decoder architecture that includes decoder plug-ins for base and enhancement layers, with a decoder integration layer controlling the operation of these plug-ins to generate a decoded reconstruction of the original video signal using residual data from the enhancement layer, allowing for flexible integration with different base encodings and platforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If hierarchical coding formats like LCEVC are integrated with existing decoders, then compression efficiency and resource utilization are improved, but integration complexity and compatibility requirements increase
Solution Approach 1:
The decoder is segmented into distinct functional modules: a base decoder for decoding the base layer video stream, an enhancement decoder for decoding the enhancement layer stream, and a combiner for merging the decoded layers. This modular segmentation allows each component to be optimized independently while maintaining overall system efficiency and reducing integration complexity.
Solution Approach 2:
The decoder architecture is designed with universal interfaces and data structures that can accommodate multiple base codecs (e.g., H.264, H.265) and enhancement layers. The combiner module uses generic merging logic that works across different codec combinations, enabling the system to handle various hierarchical coding formats without requiring complete redesign for each scenario.
2Use of energy by moving object
If hierarchical decoding is implemented to reduce power consumption, then energy efficiency is improved, but processing overhead and system requirements increase
Solution Approach 1:
The decoder dynamically adapts its processing mode based on the input stream characteristics and device capabilities. When processing hierarchical coded streams, it activates the enhancement decoder and combiner modules; for standard streams, it operates in simple base decoding mode. This dynamic adaptation optimizes power consumption by enabling complex processing only when necessary.
Solution Approach 2:
The enhancement decoder and combiner functionality are nested within the overall decoder architecture, allowing the system to maintain a compact structure. The enhancement layer processing is embedded as an optional subsystem that can be activated or deactivated based on the presence of enhancement data, reducing idle processing overhead and power consumption.
3Adaptability or versatility
If a wrapper interface is implemented for base decoders, then adaptability to different codecs is improved, but interface complexity and data exchange requirements increase
Solution Approach 1:
A standardized wrapper interface acts as an intermediary between the base decoder and the enhancement decoder/combiner modules. This interface defines a uniform set of data structures and function calls that abstract the underlying codec-specific details, allowing the upper layers to operate independently of the specific base codec being used while maintaining full compatibility.
Data Source
AI summary
A video decoder is provided with: one or more decoder plug-ins that provide a wrapper for one or more respective base decoders to implement a base decoding layer to decode an encoded video signal, each wrapper implementing an interface for data exchange with a corresponding base decoder; an enhancement decoder to implement an enhancement decoding layer, the enhancement decoder being configured to: receive an encoded enhancement signal; and, decode the encoded enhancement signal to obtain one or more layers of residual data, the one or more layers of residual data being generated based on a comparison of data derived from the decoded video signal and data derived from an original input video signal, and a decoder integration layer to control operation of the one or more decoder plug-ins and the enhancement decoder to generate a decoded reconstruction of the original input video signal using and the one or more layers of residual data from the enhancement encoding layer, wherein the decoder integration layer provides a control interface for the video decoder. A system, methods and computer readable medium are also provided.