360-Degree Image Decoding Using Scaled Projection Offsets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated by 360-degree images for virtual and augmented reality, requiring improved performance in encoding and decoding methods.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in specific projection formats like ERP, CMP, OHP, and ISP, while utilizing motion vector candidates and reference pictures for enhanced compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 360-degree images are captured and processed for virtual reality and augmented reality, then the realism and quality of media service is improved, but the amount of data generated increases massively and the performance of image processing systems becomes insufficient
Solution Approach 1:
The 360-degree image is divided into multiple projection formats (ERP, CMP, OHP, ISP) and processed separately. The decoding apparatus selectively applies different projection formats based on the specific requirements of virtual reality and augmented reality applications, allowing efficient handling of large data volumes while maintaining high quality
Solution Approach 2:
The patent implements dynamic projection format conversion that adapts to different viewing conditions and application requirements. The system can switch between different projection formats (e.g., from ERP to CMP) based on the specific needs of VR/AR content delivery, optimizing both quality and processing efficiency
2Reliability
If image encoding and decoding is performed with high quality requirements, then the media service quality is improved, but the processing time and system resource consumption increase
Solution Approach 1:
The patent performs preliminary projection format conversion and image processing during the encoding stage, preparing multiple format versions in advance. This allows the decoding apparatus to quickly select and decode the appropriate format without performing complex real-time conversions, significantly reducing processing time while maintaining high image quality
Solution Approach 2:
The system changes projection format parameters (from ERP to CMP/OHP/ISP) based on application requirements. By pre-processing images in multiple formats with different parameter settings, the system can quickly adapt to different quality requirements without reprocessing, reducing both time and resource consumption
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.