Depth Map Encoding Using YUV Chrominance Components
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for generating, storing, transmitting, and reproducing depth maps in three-dimensional video streams are inefficient, particularly in managing the large number of views required for advanced 3D visualization, and do not effectively utilize the chrominance components for compression and representation.
Innovation Solution
The method involves representing depth maps as a 'dummy color' image using luminance and chrominance components, specifically using the Y, U, and V components to create a color image that maintains spatial correlation, allowing for standard encoding and decoding techniques to be used, and enabling the storage and transmission of multiple depth maps within existing video infrastructure without reducing image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If depth maps are represented using only luminance component (Y), then storage and transmission bandwidth is reduced, but image quality and depth information fidelity deteriorate
Solution Approach 1:
The patent transitions from representing depth maps in a single dimension (luminance Y component only) to utilizing multiple dimensions by embedding depth information across all three color components (Y, U, V). This dimensional expansion allows full-depth fidelity to be preserved while still maintaining compression efficiency through the chrominance subsampling characteristics of the YUV color space.
Solution Approach 2:
The patent creates a composite representation where depth map information is integrated into the color image structure by distributing depth values across luminance and chrominance components. This composite approach leverages the existing YUV color space framework to simultaneously achieve compression efficiency and high fidelity depth representation.
2Manufacturing precision
If multiple depth maps are stored and transmitted separately, then depth information quality is maintained, but storage space and transmission bandwidth increase significantly
Solution Approach 1:
The patent merges multiple depth maps into a single color image structure by embedding different depth map data into the Y, U, and V components. This consolidation allows multiple depth representations to coexist within one integrated data structure, dramatically reducing storage and transmission requirements while preserving the quality of each individual depth map through selective extraction.
Solution Approach 2:
The patent creates a universal color image structure that serves multiple functions: it simultaneously represents multiple depth maps, maintains backward compatibility with standard video processing pipelines, and enables efficient compression through existing YUV subsampling techniques. This multi-functional approach eliminates the need for separate storage and transmission channels for each depth map.
3Productivity
If chrominance components (U, V) are used to store depth map data, then storage efficiency increases, but compatibility with standard video processing may deteriorate
Solution Approach 1:
The patent makes the color image structure universal by using the standard YUV color space that is already widely supported in video processing systems. The same structure that efficiently stores multiple depth maps also functions as a valid color image, ensuring compatibility with existing video processing pipelines, codecs, and display systems without requiring specialized processing paths.
Solution Approach 2:
The patent creates a copy of the depth map information in the chrominance components that can be extracted and used independently while leaving the original luminance component intact. This copying approach ensures that standard video processing operations on the luminance component are unaffected, while the chrominance copy provides efficient depth map storage and retrieval.
Data Source
AI summary
A method is described for generating a color image composed of a plurality of components (Y, U, V) by starting from at least one depth or disparity map (DM1, DM2), wherein a first set of pixels of said at least one depth or disparity map (DM1, DM2) is entered into the luminance component (Y) of said color image, and wherein a second and a third sets of pixels of said at least one depth or disparity map (DM1, DM2) are entered into the two chrominance components (U, V) of said color image.