Immersive Video Frame Packing for Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive video encoding technologies face challenges in efficiently encoding and decoding 6DoF and 3DoF+ videos, leading to increased pixel rates and decreased coding efficiency due to the need to handle omnidirectional views and motion parallax.
Innovation Solution
A frame packing method is introduced that efficiently arranges texture and depth information of basic and additional views on a single screen by using an immersive video encoding and decoding method. This method involves generating and unpacking packs containing atlas components based on packing flags and information, optimizing the encoding process to reduce complexity and energy consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If omnidirectional video views are encoded separately to provide 6DoF viewing freedom, then viewing freedom and immersion quality are improved, but pixel rate and data volume increase significantly
Solution Approach 1:
The patent merges multiple view images into a single packed frame by arranging different views (e.g., front, back, left, right) as quadrants or regions within one frame. This combining approach transmits multiple views through a single data stream, significantly reducing the total data volume compared to encoding each view separately while maintaining 6DoF viewing freedom at the decoder.
Solution Approach 2:
The patent embeds multiple view images nested within a single frame structure, where each view occupies a specific region or quadrant. This nesting approach allows the decoder to extract individual views from the packed frame, providing viewing freedom while minimizing the overall data transmission requirement.
2Manufacturing precision
If multiple view images are encoded with high resolution to maintain quality, then video quality is improved, but encoding complexity and processing time increase
Solution Approach 1:
The patent segments the encoding process by treating each view within the packed frame as a separate encoding unit. Each view can be encoded independently using standard video coding techniques, allowing parallel processing and reducing overall encoding complexity while maintaining high resolution and video quality for each individual view.
Solution Approach 2:
The patent transitions from encoding multiple separate full-resolution frames to encoding a single packed frame containing multiple views. This dimensional change in the data structure reduces the total number of encoding operations required while preserving the ability to deliver high-quality individual views through the packed format.
3Productivity
If frame packing is used to reduce data volume, then transmission efficiency is improved, but decoding complexity increases
Solution Approach 1:
The patent applies preliminary action by organizing and packing multiple views into a standardized frame structure during encoding. This pre-organization includes adding metadata or markers that indicate the position and configuration of each view within the packed frame, which simplifies the decoding process by providing clear extraction instructions rather than requiring complex analysis.
Data Source
AI summary
A frame packing method in an MPEG immersive video format is provided. A frame packing method in association with an immersive-video encoding and decoding method efficiently arranges, on a single screen, texture information and depth information of a basic view and an additional view to increase the coding efficiency.