Hierarchical Video Encoder Integration with Codec Plug-In Wrappers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies face challenges in efficiently integrating hierarchical coding formats, such as LCEVC, with existing encoding implementations without requiring a complete redesign, and in supporting integration with various codecs, both existing and future, without increasing coding complexity.
Innovation Solution
A video encoder architecture that includes one or more encoder plug-ins to wrap base codecs, an enhancement encoder for generating residual data, and an encoder integration layer to control the operation of these components, allowing for efficient encoding and decoding of video signals using a hierarchical encoding structure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If hierarchical coding formats like LCEVC are integrated with existing encoding implementations, then compression efficiency is improved and backwards compatibility is maintained, but integration complexity and device architecture complexity increase
Solution Approach 1:
The encoder is divided into separate functional modules: a base codec handling traditional encoding, an enhancement encoder generating residual data, and an integration layer coordinating between them. This segmentation allows each component to be developed and optimized independently while maintaining overall system functionality and backwards compatibility.
Solution Approach 2:
The enhancement encoder and integration layer are nested within the existing base codec architecture. The base codec processes video data first, then the enhancement encoder processes the decoded signal from the base codec to generate residual data. This nested structure enables hierarchical coding where the enhancement layer builds upon the base layer without requiring complete redesign of existing codecs.
2Adaptability or versatility
If hierarchical coding formats are designed to be codec-agnostic and future-proof, then adaptability is improved, but system complexity and integration requirements increase
Solution Approach 1:
The enhancement encoder is designed with a universal interface that can work with any base codec through the integration layer. The integration layer acts as a standardized intermediary that handles codec-specific details, allowing the enhancement encoder to remain codec-agnostic. This universal design enables the system to support existing codecs and future codecs without requiring changes to the enhancement encoding logic.
Solution Approach 2:
The integration layer serves as an intermediary between the base codec and enhancement encoder. It manages the interaction between different codec implementations, translating between codec-specific interfaces and the standardized enhancement encoding interface. This mediator approach isolates complexity within the integration layer while maintaining simple, clean interfaces at the boundaries.
3Productivity
If both encoding and decoding operations are performed by a base codec in some realisations, then operational efficiency is improved, but control complexity and instruction management increase
Solution Approach 1:
The integration layer merges the control functions for both base codec encoding and enhancement encoding into a single coordinated process. It manages the flow of data between the base codec and enhancement encoder, and orchestrates the combination of their outputs. This unified control approach reduces the complexity of managing separate encoding paths while maintaining operational efficiency.
Data Source
AI summary
A video encoder is provided that has: one or more encoder plug-ins that provide a wrapper for one or more respective base codecs to implement a base encoding layer, each wrapper implementing an interface for data exchange with a corresponding base codec, the base encoding layer being configured to encode and decode a video signal; an enhancement encoder to implement an enhancement encoding layer, the enhancement encoder being configured to: receive a decoded video signal from one of the one or more encoder plug-ins, the decoded video signal comprising a decoded version of an encoded video signal generated by said one of the one or more encoder plug-ins, and generate an encoded enhancement signal for the encoded video signal, the encoded enhancement signal comprising one or more layers of residual data, the residual data being generated based on a comparison of data derived from the decoded video signal and data derived from an input video signal, and, an encoder integration layer to control operation of the one or more encoder plug-ins and the enhancement encoder to generate an encoding of the input video signal using the base encoding layer and the enhancement encoding layer, wherein the encoder integration layer provides a control interface for the video encoder. A system, methods and computer readable medium are also provided.