Region-Wise 360-Degree Image Reconstruction With Block Repacking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems struggle with the massive data generated for 360-degree images in virtual and augmented reality, requiring improved performance in encoding and decoding methods.
Innovation Solution
A method for encoding and decoding 360-degree images that includes generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image in various projection formats, while utilizing motion vector candidates and reference pictures for enhanced compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If conventional image encoding methods are used for 360-degree images, then the encoding process is simple, but the compression performance is insufficient for massive data volumes
Solution Approach 1:
The patent divides the encoding process into distinct stages: generating predicted images using syntax information, separately processing residual images through inverse quantization and inverse transformation, and combining them for reconstruction. This segmentation allows each component to be optimized independently, improving overall compression performance while maintaining manageable complexity.
Solution Approach 2:
The patent performs preliminary actions by generating predicted images using syntax information from the bitstream before final reconstruction. Motion vector candidates and reference pictures are prepared in advance to enhance compression efficiency, allowing the system to handle massive data volumes more effectively.
2Quantity of substance
If image processing systems process large amounts of 360-degree image data, then comprehensive coverage is achieved, but processing performance becomes insufficient
Solution Approach 1:
The patent applies local quality by using region-wise packing with arrangement information to optimize the reconstruction of decoded image blocks. Different regions are processed according to their specific characteristics, allowing efficient handling of large data volumes while maintaining high processing performance through localized optimization strategies.
3Adaptability or versatility
If multiple projection formats are supported for 360-degree images, then versatility is improved, but system complexity increases
Solution Approach 1:
The patent implements universality by designing a reconstruction system that handles multiple projection formats (ERP, CMP, OHP, ISP) through a unified framework. The syntax information contains projection format indicators that route the decoding process appropriately, allowing the system to support diverse formats without requiring separate dedicated systems for each format.
Data Source
AI summary
A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.