Multi-layered Video Encoding with Reference Processing Signals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in delivering 3D content to home users using existing 2D hardware and systems while minimizing bandwidth consumption, requiring innovative methods for efficient encoding and decoding of multi-layered image and video delivery.
Innovation Solution
The proposed solution involves a multi-layered encoding and decoding system that processes images and videos using a base layer and enhancement layers, with reference processing units (RPUs) for interpolation and error correction, allowing for backwards compatible 3D video delivery through existing infrastructure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 3D content is delivered using existing 2D hardware and systems, then backwards compatibility is maintained, but bandwidth consumption increases and image quality deteriorates
Solution Approach 1:
The patent segments the video content into multiple layers: a base layer containing essential information that can be decoded by legacy 2D systems, and enhancement layers containing additional 3D information. This segmentation allows the same content to be delivered at different quality levels over the same bandwidth, maintaining backwards compatibility while enabling 3D functionality when bandwidth is available.
Solution Approach 2:
The patent adds a temporal and quality dimension to the delivery system by creating multiple resolution versions and enhancement layers. The base layer provides 2D compatibility, while enhancement layers add 3D depth information. This dimensional approach allows the system to adapt to different bandwidth conditions and hardware capabilities without increasing overall bandwidth consumption.
2Manufacturing precision
If multi-layered encoding is implemented, then image quality and scalability are enhanced, but device complexity increases
Solution Approach 1:
The encoding system is segmented into modular components: base layer encoder, enhancement layer encoder, and reference processing units. Each module performs a specific function and can be independently optimized. This modular segmentation reduces overall system complexity while maintaining high image quality through multi-layer processing.
Solution Approach 2:
The patent performs preliminary processing of the base layer content before creating enhancement layers. Reference processing units pre-compute interpolation and prediction data that will be used in enhancement layer encoding. This preliminary action simplifies the subsequent encoding steps and reduces the computational complexity of the overall system.
3Quantity of substance
If reference processing signals are used for enhancement layers, then bandwidth efficiency is improved, but decoding complexity increases
Solution Approach 1:
The patent introduces reference processing units as intermediary components between the base layer and enhancement layers. These units process reference pictures and generate prediction data that mediates the relationship between different layers. This intermediary approach improves bandwidth efficiency by avoiding redundant transmission of reference data, while the added decoding complexity is localized to dedicated reference processing modules.
Data Source
AI summary
The present disclosure describes a system and method for multi-layered image and video delivery using reference processing signal. A multi-layered encoder and a multi-layered decoder, both comprising at least one enhancement layer processor that uses reference processing and a base layer processor are provided. A multi-layered encoder and a multi-layered decoder that use reference processing and are capable of frame-compatible 3D video delivery are also described.