360 Viewport And Motion Estimation for Efficient Immersive Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 360-degree video technologies face challenges in achieving efficient compression, decompression, and computational efficiency, which impact the dissemination and user experience of immersive video.
Innovation Solution
A 360 neighbor-based quality selector, range adjuster, and viewport manager are integrated with a motion estimator to optimize graphics processing, enabling efficient block-based updates and asynchronous displays for immersive video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional compression methods are used for 360-degree video, then compression efficiency is improved, but video quality deteriorates
Solution Approach 1:
The patent applies local quality by differentiating treatment of neighboring blocks based on their spatial relationships in 360-degree space. Blocks that are neighbors in 360-space but not in 2D-frame space receive specialized quality handling, allowing the system to maintain high video quality in critical regions while optimizing compression elsewhere. This resolves the contradiction by applying quality preservation selectively where it matters most in the immersive video context.
Solution Approach 2:
The patent transitions from traditional 2D-frame neighbor relationships to 360-space neighbor relationships, adding a dimensional context. By considering blocks as neighbors if they are adjacent in the spherical 360-degree space rather than just in the flattened 2D frame, the system achieves better compression efficiency while maintaining quality across the immersive viewport, resolving the trade-off between compression and quality.
2Manufacturing precision
If complex motion estimation is applied to improve video quality, then computational efficiency deteriorates
Solution Approach 1:
The patent segments the 360-degree video into blocks and processes them using neighbor relationships defined in 360-space. By organizing motion estimation around these segmented blocks with clear spatial relationships, the system achieves accurate motion compensation for high video quality while maintaining computational efficiency through the structured approach. The segmentation allows parallel processing and optimized algorithms specific to each block's context.
3Productivity
If 360-space neighbor relationships are considered for quality selection, then device complexity increases, but compression efficiency improves
Solution Approach 1:
The patent implements dynamic quality selection where the quality factor for each block is determined based on its neighboring blocks in 360-space. This dynamic approach adapts quality allocation to the local content characteristics and spatial relationships, improving compression efficiency by concentrating quality where needed while reducing it where tolerable. The system manages complexity through algorithmic dynamic adjustment rather than static complex configurations.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
An embodiment may include a display processor, memory to store a 2D frame corresponding to a projection from a 360 video, and a quality selector to select a quality factor for a block of the 2D frame based on quality information from neighboring blocks of the 2D frame, including blocks which are neighboring only in the 360 video space. The system may also include a range adjuster to adjust a search range for the 2D frame based on a search area of the 2D frame, a viewport manager to determine if a request for a viewport of the 2D frame extends beyond a first edge of the 2D frame and to fill the requested viewport with wrap-around image information, and/or a motion estimator to estimate motion information based on both color information and depth information. Other embodiments are disclosed and claimed.