360-Degree Image Decoding With Projection-Based Block Rearrangement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated from processing multi-view images for 360-degree images in virtual and augmented reality, leading to insufficient performance in encoding and decoding high-resolution images.
Innovation Solution
A method for encoding and decoding 360-degree images involves generating a predicted image using syntax information, reconstructing the decoded image into a projection format, and rearranging blocks according to region-wise packing, with image expansion based on partitioning units and motion vector generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional image processing methods are used for 360-degree images, then processing can be performed with standard tools, but the performance is insufficient for handling massive data from multi-view images
Solution Approach 1:
The patent divides the 360-degree image into multiple projection formats (e.g., equirectangular, cubic, octahedral projections) and processes each projection format independently through separate encoding and decoding paths. This segmentation allows the system to handle massive data volumes by distributing processing across multiple specialized channels rather than attempting to process the entire spherical image as a single unit, thereby improving overall processing performance.
2Manufacturing precision
If high-resolution 360-degree images are processed, then image quality is improved, but the amount of data generated increases massively
Solution Approach 1:
The patent transforms the same high-resolution 360-degree image into multiple different projection formats, each with distinct geometric parameters and data structures. By changing the projection parameter (e.g., from equirectangular to cubic projection), the system maintains the same image resolution and quality while distributing the data across different format representations, enabling efficient processing without increasing the fundamental data amount.
3Adaptability or versatility
If multiple projection formats are supported, then versatility is improved, but device complexity increases
Solution Approach 1:
The patent implements multiple projection format support by creating separate, independent processing chains for each format (equirectangular, cubic, octahedral, etc.). Each chain contains dedicated encoding and decoding modules specific to that format. This segmentation isolates the complexity within each format-specific module while maintaining overall system versatility, as each module can be developed and optimized independently without affecting other format handlers.
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.