Projection-Format 360 Image Reconstruction with Syntax-Guided Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, necessitating improved performance in image encoding and decoding, particularly for 360-degree images.
Innovation Solution
A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in a specific projection format, such as Equi-Rectangular, CubeMap, OctaHedron, or IcoSahedral, to enhance compression performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 360-degree images are processed for virtual reality and augmented reality, then the quality and realism of media service is improved, but the amount of data generated increases massively
Solution Approach 1:
The patent divides the 360-degree image into multiple equirectangular images representing different regions (front, back, left, right, top, bottom). This segmentation allows the system to process and transmit only the necessary regions based on user position and viewing direction, significantly reducing the effective data量 while maintaining the complete 360-degree view quality when needed.
2Loss of information
If multi-view images captured with multiple cameras are processed for 360-degree images, then the completeness of visual information is improved, but the performance of image processing system decreases due to large data volume
Solution Approach 1:
The patent implements dynamic region selection where the system determines which equirectangular images to transmit and process based on real-time user position and viewing direction information. This dynamic adaptation allows the system to maintain processing performance by only handling the necessary subset of regions at any given time, while ensuring complete visual information is available when required.
3Loss of energy
If 360-degree images are encoded and decoded, then the compression efficiency is improved, but the complexity of encoding and decoding process increases
Solution Approach 1:
The patent segments the 360-degree image into multiple equirectangular images, each of which can be independently encoded and decoded using standard image compression techniques. This segmentation approach maintains compatibility with existing compression algorithms while achieving better overall compression efficiency by allowing selective processing of only the necessary regions.
Solution Approach 2:
The patent introduces projection format information as a key parameter that guides the encoding and decoding process. By specifying the projection format (equirectangular, cubemap, octahedron, or icosahedron), the system can efficiently transform and compress the image data without requiring complex processing, thus reducing encoding/decoding complexity while maintaining compression efficiency.
Data Source
AI summary
Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.