Segmented Sphere Projection Frame Packing for Panoramic Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing frame packing arrangements for panoramic images using extant codecs result in increased processing overhead, inadequate bandwidth, decreased compression efficiency, and high battery utilization during encoding and decoding, particularly due to sub-optimal geometric projections and aspect ratios that do not align well with modern display devices and codecs.
Innovation Solution
The implementation of Segmented Sphere Projections (SSP) and Rotated Sphere Projections (RSP) that optimize frame packing by encoding imaging data into extant formats, reducing pixel count, and strategically segmenting or rearranging data to minimize distortion and align better with existing codecs, thereby improving compression efficiency and compatibility with modern display devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional rectangular image formats are used with extant codecs, then compatibility with existing image processing techniques is maintained, but compression efficiency decreases and processing overhead increases
Solution Approach 1:
The patent segments the spherical panoramic image into multiple rectangular regions (e.g., front, back, left, right hemispheres) that can be independently encoded using traditional rectangular codecs. This segmentation allows each region to be processed by extant codecs while maintaining overall spherical geometry, thus resolving the contradiction between format compatibility and compression efficiency.
Solution Approach 2:
The patent embeds multiple rectangular image regions within a unified spherical projection framework. Each rectangular region is nested within the larger spherical context, allowing traditional rectangular encoding methods to be applied to individual regions while the overall structure maintains spherical geometry for improved compression.
2Adaptability or versatility
If panoramic images are converted to two-dimensional projection formats, then compatibility with modern display devices is improved, but image distortion increases
Solution Approach 1:
The patent divides the spherical image into multiple rectangular projection regions, each with controlled distortion characteristics. By segmenting the sphere into manageable rectangular portions, the overall distortion is distributed and managed more effectively than in a single-projection approach, maintaining display compatibility while reducing cumulative distortion effects.
Solution Approach 2:
Different rectangular regions of the spherical image are projected using optimized local projection parameters tailored to their specific geometric characteristics. This allows each region to maintain higher local image quality while the overall spherical structure preserves global geometric accuracy, resolving the distortion-compatibility contradiction.
3Manufacturing precision
If higher resolution panoramic content is transmitted, then image quality improves, but bandwidth requirements increase
Solution Approach 1:
The patent segments high-resolution spherical panoramic content into multiple rectangular regions that can be independently compressed and transmitted. This segmentation enables more efficient bandwidth utilization by allowing selective transmission of regions based on importance, viewer position, and available bandwidth, while maintaining overall high resolution where needed.
Solution Approach 2:
The patent implements progressive transmission where essential rectangular regions are transmitted first at lower resolution, followed by additional high-resolution data for specific regions of interest. This partial action approach allows immediate display of acceptable quality content while progressively improving resolution, reducing initial bandwidth requirements while maintaining final image quality.
Data Source
AI summary
Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, an encoder apparatus is disclosed. In a variant, the encoder apparatus is configured to encode Segmented Sphere Projections (SSP) imaging data and/or Rotated Sphere Projections (RSP) imaging data into an extant imaging format. In another variant, a decoder apparatus is disclosed. In one embodiment, the decoder apparatus is configured to decode SSP imaging data and/or RSP imaging data from an extant imaging format. Computing devices, computer-readable storage apparatus, integrated circuits and methods for using the aforementioned encoder and decoder are also disclosed.