Selective Filtering for Cubic-Frame Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video coding systems face inefficiencies and artifacts when processing assembled cubic-face frames from 360-degree panoramic videos, particularly due to discontinuities between cubic faces or faces and blank areas, which affect coding efficiency and visual quality.
Innovation Solution
Selective filtering is applied based on discontinuity detection within assembled cubic frames, skipping filtering at discontinuous boundaries and applying it to continuous areas, using techniques like de-blocking, sample adaptive offset (SAO), and adaptive loop filter (ALF), with control signaled in the video bitstream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If filtering process is applied to assembled cubic frames, then visual quality is improved, but artifacts are introduced at discontinuous boundaries between cubic faces
Solution Approach 1:
The patent applies filtering selectively to different regions of the cubic frame based on their continuity characteristics. Continuous regions (within the same cubic face) receive filtering to improve visual quality, while discontinuous regions (at boundaries between cubic faces) are excluded from filtering to prevent artifacts. This local differentiation of filtering application resolves the contradiction by making the filtering process adaptive to the local structural properties of the image.
2Device complexity
If conventional filtering is applied uniformly across all cubic frames, then processing simplicity is maintained, but coding efficiency is reduced due to artifacts
Solution Approach 1:
The patent segments the cubic frame into continuous and discontinuous regions, and applies filtering only to the continuous regions. This segmentation approach improves coding efficiency by eliminating artifacts at boundaries while maintaining relatively simple processing through automated region detection and selective filtering application.
Solution Approach 2:
The filtering process is made dynamic by adaptively determining which regions to filter based on discontinuity detection. The filtering application changes dynamically across different regions of the cubic frame, being applied in continuous regions and skipped in discontinuous regions, thereby optimizing coding efficiency without excessive complexity.
3Object-generated harmful factors
If filtering is skipped at discontinuous boundaries, then artifacts are reduced, but processing complexity increases due to discontinuity detection
Solution Approach 1:
The patent performs preliminary discontinuity detection before applying the filtering process. By identifying discontinuous boundaries in advance, the system can selectively apply filtering only where appropriate, reducing artifacts while keeping processing complexity manageable through a structured two-stage approach (detection then selective filtering).
Data Source
AI summary
Methods and apparatus of processing cube face images are disclosed. According to embodiments of the present invention, one or more discontinuous boundaries within each assembled cubic frame are determined and used for selective filtering, where the filtering process is skipped at said one or more discontinuous boundaries within each assembled cubic frame when the filtering process is enabled. Furthermore, the filtering process is applied to one or more continuous areas in each assembled cubic frame.