Projection-Format Reconstruction for 360-Degree Image Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing image processing systems struggle with the massive amount of data generated for 360-degree images in virtual and augmented reality, leading to insufficient performance in encoding and decoding high-resolution images.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in a specific projection format, such as Equi-Rectangular, CubeMap, OctaHedron, or IcoSahedral, while optimizing image expansion and rearrangement based on partitioning units.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multi-view images are processed to generate 360-degree images for virtual reality and augmented reality, then the realism and immersion of media service are improved, but the amount of data generated increases massively
Solution Approach 1:
The patent divides the 360-degree image into multiple equirectangular images (first, second, third, and fourth equirectangular images) representing different regions of the spherical projection. Each region is processed and encoded independently, allowing the system to handle the massive data by breaking it into manageable segments that can be processed more efficiently while maintaining the overall 360-degree coverage and realism.
2Manufacturing precision
If high-resolution images are processed to meet demand for HD and UHD images, then image quality is improved, but the performance of image processing system becomes insufficient due to large data volume
Solution Approach 1:
The patent applies different processing strategies to different regions of the 360-degree image. Each equirectangular image region can be processed with appropriate quality settings based on its specific characteristics and requirements, allowing high image quality in regions where it is most important while reducing processing intensity in other regions, thus balancing image quality with processing performance.
Solution Approach 2:
The system performs preliminary processing by generating multiple equirectangular images from the multi-view images before final encoding. This preliminary conversion to equirectangular format allows for optimized processing of each region independently, preparing the data in advance for more efficient encoding while maintaining high resolution and image quality.
3Ease of manufacture
If conventional image encoding methods are used for 360-degree images, then processing simplicity is maintained, but compression performance is insufficient for the massive data generated
Solution Approach 1:
The patent transforms the input images into equirectangular projection format, which is a dimensional transformation from conventional rectangular images to a spherical coordinate system representation. This dimensional change allows the encoding system to exploit the specific geometric properties of 360-degree images, improving compression efficiency by aligning the data structure with the projection format while maintaining processing feasibility through systematic region-based approaches.
Data Source
AI summary
Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.