Layered Image Stack Encoding for HDR Video Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codecs struggle to efficiently encode and decode high dynamic range (HDR) and enhanced dynamic range (EDR) video content for immersive user experiences, particularly in rendering images with a wide range of intensities across various display devices.
Innovation Solution
The proposed solution involves generating layered image stacks that include SDR and HDR image layers, alpha maps, and beta scale maps. These layered image stacks are then encoded into a video signal, allowing recipient devices to adjust alpha values and perform beta scaling operations to render images that match the capabilities of various display devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video codecs encode HDR and EDR video content with wide intensity range, then image quality and dynamic range are improved, but coding complexity and processing difficulty increase
Solution Approach 1:
The patent segments the video content into multiple layers with different dynamic ranges (SDR layer and HDR/EDR layer). Each layer is encoded separately with appropriate parameters, allowing the complex HDR content to be broken down into manageable segments that can be processed more efficiently while maintaining overall image quality.
Solution Approach 2:
The patent introduces a temporal dimension by creating layered image stacks that represent multiple time points. This allows the codec to process HDR content across multiple layers and time points, distributing the coding complexity over time rather than requiring all processing to occur simultaneously, thus managing the complexity burden.
2Adaptability or versatility
If video content is rendered for various display devices with different capabilities, then adaptability and versatility are improved, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary encoding by creating layered image stacks that contain both SDR and HDR/EDR information in advance. This pre-processing allows recipient devices to simply select and render the appropriate layer based on their capabilities, eliminating the need for real-time conversion and significantly reducing processing time at playback.
Solution Approach 2:
The layered image stack structure serves multiple functions simultaneously: it provides both SDR and HDR/EDR content, supports multiple display device types, and enables flexible rendering options. This multi-functionality is achieved through a single encoded structure that adapts to different device capabilities without requiring separate encoding processes.
3Manufacturing precision
If alpha maps and beta scale maps are generated for layered images, then rendering precision and dynamic range adjustment are improved, but data quantity and encoding overhead increase
Solution Approach 1:
The patent applies alpha maps and beta scale maps selectively to different regions and layers of the image stack rather than uniformly across all content. This localized application ensures high rendering precision where needed (at layer boundaries and transition regions) while minimizing the overall data quantity by avoiding redundant information in homogeneous regions.
Data Source
AI summary
A multi-view input image covering multiple sampled views is received. A multi-view layered image stack is generated from the multi-view input image. A target view of a viewer to an image space depicted by the multi-view input image is determined based on user pose data. The target view is used to select user pose selected sampled views from among the multiple sampled views. Layered images for the user pose selected sampled views, along with alpha maps and beta scale maps for the user pose selected sampled views are encoded into a video signal to cause a recipient device of the video signal to generate a display image for rendering on the image display.