Panoramic Video Bitstream Encoding Spatial Continuity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional video coding techniques are inefficient for representing three-dimensional visual scenes, especially when encoding panoramic images, as they fail to maintain spatial continuity and optimal compression rates due to non-adjacent areas being encoded together.
Innovation Solution
The method involves mapping panoramic images from spherical coordinates to two-dimensional rectangular coordinates, determining and storing adjacent region relationships, and including this information in the bitstream to improve encoding efficiency and facilitate targeted error recovery during decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If traditional two-dimensional video coding techniques are used to encode panoramic images, then the encoding process is simple, but the spatial continuity is lost and compression efficiency deteriorates
Solution Approach 1:
The panoramic image is divided into multiple non-overlapping rectangular regions (tiles) that are encoded separately. Each region is processed independently with its own set of coding parameters, allowing for optimized compression while maintaining spatial continuity within each region. The neighboring information between regions is preserved to enable proper reconstruction.
Solution Approach 2:
The patent transitions from traditional two-dimensional video coding to three-dimensional spherical coordinate system coding. By mapping panoramic images onto a spherical coordinate system with latitude, longitude, and radius dimensions, the patent maintains spatial continuity and enables more efficient compression of immersive content while still allowing for region-based processing.
2Speed
If non-adjacent areas of panoramic images are encoded together, then encoding speed is maintained, but visual continuity is lost and quality deteriorates
Solution Approach 1:
Different regions of the panoramic image are assigned different coding characteristics based on their local properties. Each rectangular region can have optimized coding parameters tailored to its specific content and spatial relationships. The neighboring information is preserved and utilized to maintain visual continuity at region boundaries while allowing independent optimization within each region.
3Measurement precision
If three-dimensional spherical coordinate information is fully preserved, then spatial accuracy is improved, but data complexity and processing requirements increase
Solution Approach 1:
The three-dimensional spherical coordinate space is divided into multiple two-dimensional rectangular regions that can be processed independently. Each region contains a subset of the spherical coordinate information and can be encoded separately, reducing the processing complexity while maintaining the overall spatial accuracy when regions are reconstructed together with their neighboring relationships.
Data Source
AI summary
Techniques for encoding or decoding digital video or pictures include acquiring a video bitstream that includes an encoded video image that is a two-dimensional image comprising multiple regions of a panoramic image in three-dimensional coordinates, extracting neighboring information for the multiple regions, performing, using the neighboring information, post-processing of a video image decoded from the video bitstream, and generating a display image from the video image after the post-processing.