Video Sample Filtering Based on Depth and Motion Discontinuities
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video coding artifacts are caused by depth and motion discontinuities in video images, leading to variations in texture characteristics across different areas of the image.
Innovation Solution
A video decoding device determines filtering operations based on depth and motion information, using filters like bilateral, deblocking, adaptive loop, sample adaptive offset, and cross-component sample adaptive offset filters, to address depth and motion discontinuities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If standard video coding filters are applied uniformly across all video blocks, then processing simplicity is maintained, but coding artifacts appear at depth and motion discontinuities
Solution Approach 1:
The patent applies different filtering operations to different video blocks based on their local characteristics. Depth information is used to identify blocks with depth discontinuities, and motion information identifies blocks with motion discontinuities. These identified blocks receive specialized filtering operations (such as adjusted deblocking filter strength or bilateral filtering) while other blocks receive standard filtering, thereby improving video quality at discontinuities without uniformly increasing complexity across all blocks.
2Reliability
If filtering strength is increased to reduce coding artifacts, then video quality improves, but processing complexity and computational cost increase
Solution Approach 1:
The patent dynamically changes filtering parameters based on local video characteristics. Specifically, the strength of deblocking filters is adjusted according to depth differences in a block, and bilateral filtering parameters are modified based on motion discontinuity detection. This allows stronger filtering where needed (at discontinuities) while maintaining standard parameters elsewhere, improving video quality without uniformly increasing processing complexity.
3Reliability
If depth information is used to determine filtering operations, then coding artifacts at depth discontinuities are reduced, but information processing requirements increase
Solution Approach 1:
The patent performs preliminary analysis of depth information to identify blocks containing depth discontinuities before applying filtering operations. Depth maps or depth components are processed in advance to generate indicators that mark blocks requiring special filtering treatment. This preliminary action allows the main decoding process to efficiently apply filtering only where needed, reducing the overall data processing load compared to applying complex filtering to all blocks.
4Reliability
If motion information is used to guide filtering operations, then coding artifacts at motion discontinuities are reduced, but computational requirements increase
Solution Approach 1:
The patent uses motion information as an intermediary to guide filtering operations. Motion vectors and motion compensation data are analyzed to identify blocks with motion discontinuities, which then serve as indicators for applying bilateral filtering or adjusting other filter parameters. This intermediary approach allows motion characteristics to indirectly control filtering behavior without requiring direct, computationally intensive analysis of every pixel's motion trajectory.
Data Source
AI summary
Systems, methods, and instrumentalities are disclosed herein for determining whether to apply a filter and/or the parameters of a filter to be applied to a video block based on depth and/or motion information associated with the video block. The determination may be made based on the existence or non-existence of a depth discontinuity in the video block. The filter may be a bilateral filter, a deblocking filter, a sample adaptive offset (SAO) filter, a cross-component sample adaptive offset (CC-SAO) filter, or an adaptive loop filter.