360-Degree Image Decoding with Reconfigured MPM Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, requiring improved performance in encoding and decoding methods.
Innovation Solution
A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in specific projection formats like ERP, CMP, OHP, or ISP, with image expansion and intra-prediction techniques to enhance compression performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional image encoding/decoding methods are used for 360-degree images, then the processing can be performed with standard algorithms, but the performance is insufficient for processing the massive data generated by multi-view images
Solution Approach 1:
The patent divides the 360-degree image processing into multiple view images captured by different cameras. Each view image is processed separately through encoding and decoding operations, allowing the massive data to be handled in manageable segments rather than as a single overwhelming dataset
Solution Approach 2:
The patent transforms multi-view images into 360-degree images by adding a dimensional transformation step. This involves projecting multiple 2D views into a spherical or equirectangular coordinate system, enabling efficient compression and processing of the immersive image data through dimensionality conversion
2Adaptability or versatility
If multi-view images are processed to create 360-degree images for virtual and augmented reality, then realistic media services can be provided, but the amount of data generated increases massively
Solution Approach 1:
The patent performs encoding operations on the multi-view images before they are fully processed into 360-degree format. By compressing and encoding the source view images first, the data volume is reduced in advance, preventing the massive data generation from occurring in the first place
Solution Approach 2:
The patent combines multiple encoded view images into a single 360-degree image structure. This merging process integrates the compressed data from multiple cameras into a unified immersive image format, reducing overall data requirements while maintaining service quality
Data Source
AI summary
A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.