Projection-Based 360-Degree Image Decoding for Compression Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, requiring improved performance in image encoding and decoding.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in various projection formats, utilizing motion vector candidates and reference pictures for enhanced compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If 360-degree images are processed using conventional image encoding methods, then the images can be captured and stored, but the data volume becomes excessively large and processing performance is insufficient
Solution Approach 1:
The patent divides the 360-degree image into multiple projection formats (e.g., equirectangular, cubic, octahedral projections) and processes each format separately through region-wise packing. This segmentation allows the large 360-degree image data to be handled in manageable units, improving processing performance while maintaining comprehensive data representation across different viewing angles
Solution Approach 2:
The patent transforms the 360-degree image data from a single continuous representation into multiple dimensional projections (2D equirectangular, 6-face cubic, 8-face octahedral). This dimensional transformation enables more efficient compression and processing by leveraging the geometric properties of different projection formats, thereby reducing data volume while preserving image quality
2Loss of energy
If image encoding complexity is increased to improve compression performance, then compression ratio improves, but processing time and computational resources increase
Solution Approach 1:
The patent performs region-wise packing and projection format conversion before the main encoding process. By pre-organizing the 360-degree image into optimized projection formats and regions, the subsequent encoding operations become more efficient, achieving better compression ratios without proportionally increasing processing time
Solution Approach 2:
The patent dynamically selects different projection formats (equirectangular, cubic, octahedral) and packing strategies based on the specific characteristics of the 360-degree image content. This parameter optimization allows the system to achieve high compression efficiency by matching the encoding approach to the image characteristics, avoiding unnecessary computational overhead
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.