360-Degree Image Decoding with Projection-Based Inter Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data requirements of 360-degree images for virtual and augmented reality, necessitating improved performance in image encoding and decoding, particularly for 360-degree images.
Innovation Solution
A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in a specific projection format, utilizing projection formats like ERP, CMP, and ISP, and employing image expansion based on partitioning units to enhance compression performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional image encoding/decoding methods are used for 360-degree images, then the processing can be performed with standard algorithms, but the processing performance is insufficient for the massive data volume
Solution Approach 1:
The 360-degree image is divided into multiple projection formats (ERP, CMP, OHP, ISP) and processed separately. The encoding apparatus performs image expansion and setting based on the specific projection format, allowing parallel processing of different regions and formats, thereby improving overall processing performance for large data volumes
Solution Approach 2:
The patent transforms the processing approach by introducing projection format dimensionality. Instead of treating all 360-degree images uniformly, the system converts images into different projection formats (2D plane, cube, octahedron, polyhedron) and applies format-specific processing, enabling more efficient handling of the massive data through dimensional transformation
2Manufacturing precision
If image expansion is performed on the entire 360-degree image, then the resolution is improved, but the processing time and complexity increase significantly
Solution Approach 1:
The image expansion process is segmented by projection format. Instead of uniformly expanding the entire 360-degree image, the apparatus performs expansion separately for each projection format (ERP, CMP, OHP, ISP) based on the syntax information, reducing the computational complexity and processing time while maintaining resolution quality
Solution Approach 2:
The patent applies local quality processing by performing image expansion and setting operations tailored to each projection format's specific characteristics. The encoding apparatus adjusts the expansion parameters and processing methods according to the local requirements of each projection format, achieving high resolution without unnecessary processing overhead
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.