360-Degree Image Encoding and Decoding Using Projection-Aware Block Division
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated by 360-degree images for virtual and augmented reality, necessitating improved performance in image encoding and decoding, particularly for 360-degree images.
Innovation Solution
A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image based on projection formats like ERP, CMP, OHP, and ISP, with image expansion and rearrangement based on partitioning units and motion information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional image encoding/decoding methods are used for 360-degree images, then the processing can be performed with standard algorithms, but the performance is insufficient for handling the massive data volume generated by 360-degree images
Solution Approach 1:
The patent divides the 360-degree image into multiple projection formats (ERP, CMP, OHP, ISP) and processes each format separately with format-specific optimization. The decoding process is segmented into distinct stages: syntax information extraction, predicted image generation, residual image processing, and format-specific reconstruction. This segmentation allows the system to handle massive data volumes by processing different portions of the image data through specialized pipelines optimized for their respective projection characteristics.
Solution Approach 2:
The patent transforms the processing approach by introducing projection format as an additional dimension for organizing and processing 360-degree image data. Instead of treating all pixel data uniformly, the system reorganizes the massive data volume according to projection geometry (e.g., cube faces for CMP, spherical coordinates for ERP), enabling more efficient memory access patterns and parallel processing strategies that improve overall productivity despite the large data quantity.
2Productivity
If image expansion and rearrangement are performed based on partitioning units, then the compression performance is enhanced, but the processing complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the image into partitioning units and processing each unit independently through expansion and rearrangement operations. Each partitioning unit is handled with format-specific rules, allowing the complex processing to be broken down into manageable, repeatable steps that can be parallelized, thereby improving compression performance without overwhelming the processing system.
Solution Approach 2:
The patent implements local quality by applying different expansion and rearrangement strategies to different regions of the image based on their projection format characteristics. For example, cube map projections may use face-based partitioning while equirectangular projections use latitude-longitude grid partitioning. This localized processing approach optimizes compression for each region's specific geometric properties while keeping the overall processing complexity manageable through consistent local rules.
3Adaptability or versatility
If multiple projection formats are supported, then the adaptability for different VR/AR applications is improved, but the device complexity increases
Solution Approach 1:
The patent achieves universality by designing a single decoding apparatus that can handle multiple projection formats (ERP, CMP, OHP, ISP) through a unified architecture. The system uses format identification syntax information to route data through appropriate processing pipelines, allowing one device to serve multiple VR/AR application requirements without requiring separate specialized hardware for each projection type, thus improving adaptability while controlling complexity.
Solution Approach 2:
The patent applies preliminary action by extracting and identifying the projection format from syntax information at the beginning of the decoding process. This early format identification allows the system to pre-configure the appropriate processing pipeline and parameters before actual image reconstruction begins, enabling multi-format support without requiring complex real-time format switching or multiple complete decoding chains, thereby reducing overall system complexity.
Data Source
AI summary
Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.


