360-Degree Image Encoding and Decoding for Projection Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, requiring improved performance in image encoding and decoding, particularly for 360-degree images.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in specific projection formats like ERP, CMP, OHP, and ISP, with image expansion based on partitioning units and motion vector prediction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multi-view images captured with a plurality of cameras are processed for 360-degree images, then the realism of virtual reality and augmented reality is improved, but the amount of data generated increases massively
Solution Approach 1:
The patent divides the 360-degree image into multiple projection faces (e.g., cube map faces) and processes each face separately. This segmentation allows the system to handle the massive data by breaking it into manageable units that can be encoded and transmitted more efficiently, while still maintaining the overall realism of the virtual reality experience.
Solution Approach 2:
The patent transforms the 360-degree spherical image into different projection formats (such as equirectangular projection, cube map projection) which represent the same visual information in alternative dimensional arrangements. This dimensionality change enables more efficient data compression and transmission while preserving the immersive reality experience.
2Area of stationary object
If the amount of data for 360-degree images increases massively, then the coverage and field of view are improved, but the performance of the image processing system becomes insufficient
Solution Approach 1:
The patent applies different processing qualities and compression parameters to different regions or faces of the 360-degree image. By optimizing each local region according to its specific characteristics and importance, the system can maintain high processing performance while preserving the overall wide coverage and field of view required for immersive experiences.
3Ease of manufacture
If conventional image encoding methods are used for 360-degree images, then the processing method is simple, but the compression performance is insufficient for large data volumes
Solution Approach 1:
The patent performs preliminary actions by converting the 360-degree image into specific projection formats and organizing the data into structured faces before encoding. This preliminary organization simplifies the subsequent encoding process while significantly improving compression performance, as the structured format enables more efficient exploitation of spatial and temporal redundancies in the data.
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.