Projection-Format 360-Degree Image Reconstruction for Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing image processing systems for 360-degree images in virtual and augmented reality are inadequate in handling the massive data generated, leading to insufficient performance in encoding and decoding high-resolution images.
Innovation Solution
A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing it according to projection formats like ERP, CMP, or OHP, with image expansion based on partitioning units to enhance compression performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If multi-view images captured with a plurality of cameras are processed for 360-degree images, then the amount of data generated increases massively, but the performance of image processing system decreases
Solution Approach 1:
The patent divides the 360-degree image into multiple equirectangular images (first, second, third, and fourth equirectangular images) representing different horizontal fields of view. Each segment is processed independently through encoding and decoding operations, reducing the computational burden on the processing system while maintaining the complete 360-degree coverage when segments are reassembled.
2Manufacturing precision
If high-resolution images are processed for virtual reality and augmented reality, then image quality improves, but data volume increases massively
Solution Approach 1:
The patent applies different processing strategies to different regions of the 360-degree image. The first and second equirectangular images correspond to left and right horizontal fields of view, while the third and fourth correspond to front and back fields. This regional division allows optimization of compression and processing parameters for each local region, maintaining high image quality while reducing overall data volume through selective processing.
3Speed
If 360-degree images are encoded and decoded using conventional methods, then processing speed is maintained, but compression performance is insufficient
Solution Approach 1:
The patent transforms the 360-degree spherical image data into multiple 2D equirectangular projections, each representing a specific horizontal field of view. This dimensional transformation enables the application of conventional 2D image encoding techniques to 360-degree data, achieving effective compression while maintaining processing speed through parallel processing of multiple independent equirectangular images.
Data Source
AI summary
Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.