360-Degree Image Coding with MPM Reconfiguration for Projection Formats
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated from processing multi-view 360-degree images for virtual and augmented reality, leading to insufficient performance in encoding and decoding high-resolution images.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in specific projection formats like ERP, CMP, OHP, and ISP, while performing image expansion and intra-prediction based on partitioning units and adjacent pixel information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multi-view 360-degree images are processed to provide virtual reality and augmented reality services, then the quality and realism of media service is improved, but the amount of data generated increases massively
Solution Approach 1:
The 360-degree image is divided into multiple partitioning units (e.g., 8x8 blocks) that can be processed independently. Each partitioning unit is further divided into prediction units and transform units, allowing the large image data to be segmented into manageable portions for efficient encoding and decoding.
Solution Approach 2:
The patent transforms the 360-degree image from its original spherical coordinate system into different projection formats (ERP, CMP, OHP, ISP) which represent the same visual information in alternative dimensional arrangements. This dimensionality change allows the same visual content to be encoded more efficiently in the transformed space.
2Manufacturing precision
If high-resolution 360-degree images are encoded and decoded, then the image quality is improved, but the processing performance of the image processing system becomes insufficient
Solution Approach 1:
The patent performs image expansion and prediction operations before the actual encoding process. By generating predicted images using intra-prediction based on adjacent partitioning units and performing expansion operations beforehand, the system prepares the data in advance to reduce the computational burden during the main encoding and decoding phases.
Solution Approach 2:
The patent replaces traditional mechanical image processing methods with mathematical transformations and algorithms. Instead of direct pixel manipulation, the system uses intra-prediction algorithms, transform operations, and projection format conversions to achieve efficient compression and reconstruction of high-resolution 360-degree images.
Data Source
AI summary
A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.