RGB Subpixel Depth Value Assignment for Colored Depth Frame Packing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video compression systems experience distortion when converting between RGB and YUV formats, particularly in areas with large depth gaps, due to the filling of missing chrominance values during compression and decompression, which affects the accuracy of depth frame recovery.
Innovation Solution
A method and circuit for assigning and recovering selected depth values to and from RGB subpixels, allowing for direct recovery of multiple depth values in the RGB format by interleaving depth values and assigning them to corresponding subpixels, thereby improving distortion around areas with dramatic depth gaps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If chrominance values are filled during decompression to recover RGB format, then the image can be reconstructed, but distortion occurs in areas with large depth gaps
Solution Approach 1:
The patent segments the depth values and assigns them to specific subpixels (R, G, B) within each pixel. Instead of treating all pixels uniformly with filled chrominance values, the invention divides the depth information into multiple components that can be independently recovered, reducing distortion in areas with large depth gaps by preserving actual depth variations rather than using uniform filled values.
Solution Approach 2:
The patent introduces a new dimension by embedding depth values within the RGB color format itself. By assigning selected depth values to specific subpixels (R, G, B) and using the least significant bits of color values to encode depth information, the invention creates a multi-dimensional data structure that simultaneously carries both color and depth information, enabling accurate depth recovery without traditional chrominance filling.
2Loss of energy
If YUV 420 format is used for compression, then transmission bandwidth is reduced, but multiple depth values cannot be recovered accurately
Solution Approach 1:
The patent merges color information (RGB) and depth information into a single unified format. By encoding depth values within the least significant bits of the RGB color values and using specific assignment patterns to different subpixels, the invention combines multiple data streams (color and depth) into one compact representation that can be transmitted efficiently without requiring separate depth channels, thus reducing bandwidth while preserving depth information.
Solution Approach 2:
The patent changes the parameter representation by using the least significant bits of color values to encode depth information. Instead of transmitting full-depth precision separately, the invention repurposes existing color data parameters to carry depth information, achieving efficient compression while maintaining recoverable depth values through the assigned patterns in the RGB subpixels.
Data Source
AI summary
A method comprises: obtaining two depth values from each of a first pixel depth value and a fourth pixel depth value, and obtaining one depth value from each of a second pixel depth value and a third pixel depth value; and assigning the two depth values obtained from the first pixel depth value to the R-subpixel and B-subpixel values of the first pixel, assigning the depth value obtained from the second pixel depth value to the R-subpixel, G-subpixel and B-subpixel values of the second pixel, assigning the depth value obtained from the third pixel depth value to the R-subpixel, G-subpixel and B-subpixel values of the third pixel, and assigning the two depth values obtained from the fourth pixel depth value to the G-subpixel value of the first pixel and the R-subpixel, G-subpixel and B-subpixel values of the fourth pixel.