360-Degree Image Encoding with Projection-Aware Block Partitioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated by 360-degree images for virtual and augmented reality, necessitating improved performance in image encoding and decoding.
Innovation Solution
A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in a projection format, utilizing projection formats like ERP, CMP, OHP, and ISP, and performing image expansion based on partitioning units to enhance compression performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 360-degree images are captured and processed for virtual reality and augmented reality, then realistic media service quality is improved, but the amount of data generated increases massively and processing performance becomes insufficient
Solution Approach 1:
The 360-degree image is divided into multiple projection formats (ERP, CMP, OHP, ISP) and further segmented into partitioning units for independent processing. This segmentation allows the large data volume to be handled in smaller, manageable chunks, improving processing efficiency while maintaining service quality.
Solution Approach 2:
The patent transforms the 360-degree image data from a single complex representation into multiple dimensional projection formats. By converting the spherical image data into different geometric projections (cube, octahedron, icosahedron), the system can process and transmit data more efficiently in various dimensional representations.
2Quantity of substance
If image encoding and decoding is performed on 360-degree images, then compression is achieved, but processing complexity increases due to multiple projection formats
Solution Approach 1:
The patent performs preliminary actions by pre-defining multiple projection formats and their corresponding syntax structures. The encoding system prepares and selects the appropriate projection format before actual compression, and the decoding system is pre-configured to handle these formats, reducing runtime complexity despite multiple format options.
Solution Approach 2:
The system changes parameters by selecting different projection formats based on specific requirements. Each projection format (ERP, CMP, OHP, ISP) represents a different parameter configuration for representing the same 360-degree image data, allowing optimization for different processing scenarios while maintaining manageable complexity through standardized syntax.
3Manufacturing precision
If projection format information is included in syntax information for decoding, then accurate image reconstruction is achieved, but data transmission overhead increases
Solution Approach 1:
The patent extracts only the essential projection format information needed for accurate reconstruction and includes it in the syntax. By taking out only the critical parameters (projection type identifier and essential geometric parameters) rather than complete projection data, the system maintains reconstruction accuracy while minimizing transmission overhead.
Data Source
AI summary
Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.