Non-Rectangular Pixel Structure for VR Image Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image and video formats for virtual reality applications, such as cube maps and equirectangular projections, are inefficient in terms of data rate and complexity, requiring a high number of pixels and leading to suboptimal user experiences and increased computational resources.
Innovation Solution
A method and apparatus for generating a two-dimensional rectangular image property pixel structure from a non-rectangular pixel structure representing a view sphere, where the central region is derived from the central region of the first image property pixel structure and the corner regions are derived from the border regions, allowing for a more efficient representation and encoding of image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If conventional image formats (cube maps, equirectangular projections) are used for virtual reality applications, then complete view sphere coverage is achieved, but data rate and computational complexity increase significantly
Solution Approach 1:
The patent divides the view sphere representation into a central region and corner regions, where the central region uses a first image property pixel structure and corner regions use a second image property pixel structure. This segmentation allows different parts of the image to be encoded with different efficiencies, reducing overall data rate while maintaining complete view coverage.
Solution Approach 2:
The patent applies different image property pixel structures to different regions of the view sphere based on local requirements. The central region uses one structure optimized for certain properties, while corner regions use another structure optimized for different properties, allowing each region to have the quality and efficiency appropriate to its specific needs.
2Quantity of substance
If conventional image formats are used for virtual reality applications, then complete view sphere coverage is achieved, but processing complexity increases
Solution Approach 1:
The patent segments the processing into distinct stages: generating the first image property pixel structure for the central region, generating the second image property pixel structure for corner regions, and combining them. This segmentation simplifies the overall processing complexity by breaking down the complex task of view sphere representation into more manageable, specialized sub-tasks.
Solution Approach 2:
The patent enables dynamic switching between different image property pixel structures depending on the region being processed and the specific application requirements. This dynamic approach allows the system to adapt processing complexity to actual needs, using simpler structures where sufficient and more complex structures only where necessary.
3Manufacturing precision
If high data rate is used to maintain image quality, then image quality is preserved, but bandwidth requirements increase
Solution Approach 1:
The patent applies different image property pixel structures to different regions based on local quality requirements. The central region uses a structure optimized for its specific quality needs, while corner regions use a different structure optimized for their requirements, allowing the system to maintain overall image quality while reducing total data rate by not applying uniform high-quality encoding across the entire view sphere.
Data Source
AI summary
The invention relates to an apparatus for generating or processing an image signal. A first image property pixel structure is a two-dimensional non-rectangular pixel structure representing a surface of a view sphere for the viewpoint. A second image property pixel structure is a two-dimensional rectangular pixel structure and is generated by a processor (305) to have a central region derived from a central region of the first image property pixel structure and at least a first corner region derived from a first border region of the first image property pixel structure. The first border region is a region proximal to one of an upper border and a lower border of the first image property pixel structure. The image signal is generated to include the second image property pixel structure and the image signal may be processed by a receiver to recover the first image property pixel structure.