360-Degree Image Decoding with Projection-Specific Inter Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, requiring improved performance in encoding and decoding methods.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in specific projection formats like ERP, CMP, OHP, and ISP, while utilizing motion vector candidates and reference picture expansion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional image encoding/decoding methods are used for 360-degree images, then the processing can be performed with standard algorithms, but the performance is insufficient due to the massive amount of data generated
Solution Approach 1:
The patent applies segmentation by dividing the 360-degree image into multiple projection formats (ERP, CMP, OHP, ISP) and processing them separately. The encoding/decoding method segments the image data according to different projection types, allowing optimized handling of each segment's specific characteristics, thereby improving overall processing performance despite the large data volume.
Solution Approach 2:
The patent implements local quality by applying different encoding/decoding strategies tailored to each projection format's characteristics. Each projection type (ERP, CMP, OHP, ISP) receives customized processing parameters and methods suited to its specific data structure and properties, optimizing the processing efficiency for each local region of the image data.
2Adaptability or versatility
If multiple projection formats are supported for 360-degree images, then the adaptability and versatility are improved, but the device complexity increases
Solution Approach 1:
The patent achieves universality by designing a multi-functional encoding/decoding apparatus that can handle multiple projection formats (ERP, CMP, OHP, ISP) within a single integrated system. The apparatus contains specialized processing units for each projection type, allowing one device to perform multiple functions and support various 360-degree image formats without requiring separate dedicated systems for each format.
Solution Approach 2:
The patent applies the nesting principle by organizing the processing architecture in a hierarchical manner where a general 360-degree image processing framework contains specialized sub-routines and modules for each specific projection format. Each projection format handler is nested within the overall processing system, allowing compact organization of complex functionality and reducing apparent system complexity through structured nesting.
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.