Depth Map Modification Using Luminance and Chrominance Correlation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 2D to 3D conversion techniques are computationally intensive and often produce imperfect depth maps, necessitating a simpler method to enhance depth maps, particularly those generated based on color analysis, for efficient real-time processing on mobile platforms.
Innovation Solution
A method that correlates depth with pixel height using luminance and chrominance information to modify depth maps, incorporating natural scene depth cues and employing pixel-based algorithms, allowing for real-time processing on mobile devices and enhancing existing depth maps generated by color-based 2D to 3D conversion processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If content analysis algorithms are used to identify objects and assign depths, then depth map accuracy is improved, but computational complexity increases significantly
Solution Approach 1:
The patent segments the depth map modification process into distinct functional components: luminance analysis, chrominance analysis, and depth value assignment. Each component handles a specific aspect of depth estimation, allowing the system to achieve accurate depth maps through coordinated simple operations rather than a single complex algorithm.
Solution Approach 2:
The patent changes parameters by using luminance and chrominance values directly from the image to determine depth relationships. Instead of performing complex object identification, the system transforms color space parameters (luminance Y, chrominance U/V) into depth information through predefined rules and lookup tables, significantly reducing computational requirements.
2Productivity
If color-based depth map generation is used, then computational requirements are reduced, but depth map accuracy deteriorates
Solution Approach 1:
The patent merges multiple color-based depth estimation approaches by combining luminance information (brightness variations) with chrominance information (color variations). This combination allows the system to leverage simple color-based processing while achieving improved depth map accuracy through the complementary nature of different color space components.
Solution Approach 2:
The patent introduces intermediate processing steps that transform raw color values into meaningful depth information. Lookup tables and predefined functions act as intermediaries between simple color analysis and final depth values, enabling accurate depth estimation without requiring complex real-time computations.
3Measurement precision
If complex depth enhancement algorithms are applied, then depth map quality is improved, but real-time processing capability is lost
Solution Approach 1:
The patent performs preliminary actions by pre-computing lookup tables and defining fixed processing rules for luminance and chrominance analysis. These pre-prepared resources enable real-time processing during actual depth map generation, as the system only needs to query predefined tables and apply simple transformations rather than performing complex calculations on-the-fly.
4Reliability
If luminance-based depth correlation is applied, then natural scene depth cues are utilized, but processing complexity increases
Solution Approach 1:
The patent applies local quality by treating different regions of the image with different processing characteristics based on their luminance and chrominance values. Specific rules are applied locally to different color regions (e.g., sky, water, land) to enhance depth accuracy for each region according to its natural properties, rather than applying a uniform complex algorithm throughout.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A method (and system) of processing image data in which a depth map is processed to derive a modified depth map by analysing luminance and/or chrominance information in respect of the set of pixels of the image data. The depth map is modified using a function which correlates depth with pixel height in the pixellated image and which has a different correlation between depth and pixel height for different luminance and/or chrominance values.