360-Degree Image Encoding and Decoding by Projection Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated from processing multi-view images for 360-degree images in virtual and augmented reality, leading to insufficient performance in encoding and decoding high-resolution images.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in various projection formats, such as Equi-Rectangular, CubeMap, OctaHedron, and IcoSahedral, while utilizing motion vector candidates and reference pictures for enhanced compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multi-view images are processed for 360-degree images, then the realism and quality of virtual reality and augmented reality services are improved, but the amount of data generated increases massively
Solution Approach 1:
The 360-degree image is divided into multiple projection formats (ERP, CMP, OHP, ISP) and processed separately. The decoding apparatus selects and processes only the required projection format, segmenting the large data volume into manageable portions corresponding to different viewing scenarios.
Solution Approach 2:
The patent applies different processing strategies to different regions of the 360-degree image based on their characteristics. Equi-rectangular projection regions are handled differently from cube map, octahedron, or icosahedron projection regions, optimizing compression and decoding efficiency for each local area.
2Manufacturing precision
If high-resolution images are encoded and decoded, then the image quality is improved, but the processing performance of the image processing system becomes insufficient
Solution Approach 1:
The encoding apparatus pre-processes the 360-degree image into multiple projection formats and generates syntax information in advance. The decoding apparatus uses this pre-prepared syntax information to quickly reconstruct the image, avoiding real-time complex calculations and improving processing performance.
Solution Approach 2:
The patent transforms the 360-degree image into different projection formats (ERP, CMP, OHP, ISP) with different parameter representations. This parameter transformation enables more efficient encoding and decoding by matching the mathematical properties of each projection type with appropriate processing algorithms.
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.