Projection-Based 360-Degree Image Decoding Under Heavy Data Loads
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, necessitating improved performance in image encoding and decoding, particularly for 360-degree images.
Innovation Solution
A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image based on projection formats like ERP, CMP, OHP, and ISP, with image expansion and rearrangement based on partitioning units and motion information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 360-degree images are captured with multiple cameras for virtual reality and augmented reality, then the realism and quality of the media service are improved, but the amount of data generated increases massively and the image processing system performance becomes insufficient
Solution Approach 1:
The patent divides the 360-degree image data into multiple projection format options (ERP, CMP, OHP, ISP), allowing the system to process and transmit data in segmented, manageable formats tailored to specific application needs, thereby improving processing efficiency while maintaining realism
Solution Approach 2:
The patent enables dynamic switching between different projection formats and image expansion methods based on device capabilities and network conditions, changing processing parameters adaptively to optimize both image quality and system performance
2Measurement precision
If image expansion is performed on reference pictures for prediction, then the accuracy of motion compensation is improved, but the computational complexity and processing time increase
Solution Approach 1:
The patent performs image expansion selectively only on reference pictures that require motion compensation, rather than expanding all reference pictures uniformly. This partial action approach maintains motion compensation accuracy for necessary regions while reducing unnecessary processing time
Solution Approach 2:
The patent performs image expansion on reference pictures in advance before the actual decoding and motion compensation processes, so that when motion compensation is needed, the expanded reference pictures are already prepared, reducing real-time processing time
Data Source
AI summary
Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.