Reduced Resolution Update Mode for Multi-View Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Multi-view Video Coding (MVC) technologies face inefficiencies in compression and quality maintenance, particularly at low bit rates, due to limitations in encoding multiple views of the same scene, leading to reduced objective and subjective quality.
Innovation Solution
The implementation of a Reduced Resolution Update (RRU) mode in video encoding and decoding, which allows for encoding and decoding of pictures using larger block sizes and subsampling of residual data, enabling efficient bitstream reduction and maintaining subjective quality by adapting resolution on a slice or macroblock basis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If independent encoding of each single view is used, then encoding simplicity is maintained, but compression efficiency deteriorates
Solution Approach 1:
The patent merges the encoding processes of multiple views by introducing inter-view prediction mechanisms. Specifically, it combines temporal prediction (within a single view) and inter-view prediction (across different views) to exploit redundancy between views. The encoder uses motion compensation from reference views to predict current view blocks, thereby improving compression efficiency while maintaining manageable encoding complexity through structured prediction modes.
Solution Approach 2:
The patent creates a universal encoding framework that handles both intra-view temporal prediction and inter-view spatial prediction using a unified motion compensation structure. The same motion estimation and compensation machinery is used for both single-view temporal prediction and multi-view inter-view prediction, making the system multi-functional and efficient.
2Measurement precision
If full resolution encoding is used for all views, then objective quality is maintained, but bit rate increases significantly
Solution Approach 1:
The patent applies local quality by allowing different regions of the video to be encoded at different resolutions. Specifically, it introduces reduced resolution update modes where certain macroblocks or slices can be encoded at lower resolutions when they contain stationary or slowly varying content, while maintaining full resolution for regions with high motion or important visual information. This selective resolution approach maintains perceptual quality while reducing overall bit rate.
Solution Approach 2:
The patent applies partial action by encoding only the residual differences between predicted and actual blocks at full resolution, rather than encoding all blocks at full resolution. The inter-view prediction and temporal prediction provide a base layer at reduced resolution, and only the necessary residual information is encoded at higher precision, achieving efficient bit rate reduction.
3Quantity of substance
If reduced resolution update mode is applied, then bit rate is reduced, but objective quality deteriorates
Solution Approach 1:
The patent introduces an intermediary upsampling process that reconstructs full-resolution images from reduced-resolution encoded data. The upsampler acts as a mediator between the compressed low-resolution representation and the desired high-resolution output, using filtering and interpolation techniques to recover fine details while maintaining the bit rate benefits of reduced resolution encoding.
Solution Approach 2:
The patent dynamically changes the resolution parameter based on content characteristics. It introduces flags and modes that allow the encoder to switch between full-resolution and reduced-resolution encoding for different macroblocks or slices, adapting the resolution parameter to local content requirements rather than applying a fixed resolution throughout the entire video sequence.
4Device complexity
If larger block sizes are used in RRU mode, then overhead is reduced, but motion accuracy decreases
Solution Approach 1:
The patent segments the picture into different types of macroblocks with different properties. It introduces skip macroblocks, forward skip macroblocks, and regular macroblocks, each with different motion compensation requirements. This segmentation allows the system to use larger effective block sizes for stationary regions (reducing overhead) while maintaining fine-grained motion compensation for regions with significant motion, thereby balancing overhead reduction with motion accuracy.
Data Source
AI summary
There are provided a method and apparatus for providing reduced resolution update mode for multi-view video coding. A video encoder includes an encoder for encoding a picture using a reduced resolution update mode. The picture is one of a set of pictures corresponding to multi-view content having different view points with respect to a same or similar scene. The picture represents one of the different view points.