360-Degree Image Reconstruction Across Projection Formats
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, requiring improved performance in image encoding and decoding, particularly for 360-degree images.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image according to projection formats like Equi-Rectangular, CubeMap, OctaHedron, and IcoSahedral, enhancing compression performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multi-view images are processed to generate 360-degree images for virtual reality and augmented reality, then the realism and immersion of media service are improved, but the amount of data generated increases massively
Solution Approach 1:
The patent divides the 360-degree image into multiple view images captured by separate cameras. Each camera captures a specific view, and these segmented views are then processed independently before being synthesized into the final 360-degree image. This segmentation allows for more efficient data handling and processing while maintaining the realism of the virtual reality experience.
Solution Approach 2:
The patent transforms 2D images captured by multiple cameras into a 360-degree representation that can be displayed on a 2D screen while maintaining the perception of 3D space. This dimensional transformation allows the system to work with manageable 2D data while producing immersive 360-degree viewing experiences, effectively managing the data quantity issue.
2Manufacturing precision
If the amount of data for 360-degree images is increased to improve image quality and resolution, then the visual quality is improved, but the performance of image processing systems deteriorates
Solution Approach 1:
The patent processes multiple view images separately before synthesis, allowing the system to handle smaller individual image datasets while achieving high overall image quality. Each camera's view is processed independently with standard processing performance, and the results are combined to create the final high-quality 360-degree image, thus maintaining processing performance while improving image quality.
Solution Approach 2:
The patent merges multiple processed view images into a single 360-degree image representation. By combining the processed data from multiple cameras, the system achieves high image quality and resolution without requiring each individual processing step to handle the entire large dataset alone, thus maintaining processing performance.
3Adaptability or versatility
If existing image encoding and decoding methods are used for 360-degree images, then compatibility with standard systems is maintained, but compression performance is insufficient
Solution Approach 1:
The patent creates a universal processing framework that can handle both standard 2D images and 360-degree images using the same fundamental principles. The system uses standard camera imaging technology and processes multiple views in a way that is compatible with existing image processing pipelines, while achieving superior compression performance specifically optimized for 360-degree content.
Data Source
AI summary
Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.