Parameterized Video Resampling Filters for Low-Bitrate Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Standard video encoders experience significant degradation in performance at low bit rates, leading to substantial quality drops due to distortion and loss of high-frequency information, which existing compression techniques fail to adequately address.

Innovation Solution

The use of parameterized and signaled filters for spatially scalable video coding and decoding, allowing for efficient upsampling and downsampling of video information, including the calculation of filter taps based on constraint matrices and signaling of filter information in bitstreams, enables flexible resampling and interpolation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If standard video compression techniques are used, then bit rate is reduced, but visual quality deteriorates significantly at low bit rates

Engineering Contradiction:
Improvebit rateVSAvoidvisual quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the filter selection adaptive rather than fixed. The encoder dynamically selects from multiple filter types (e.g., bilinear, bicubic, Lanczos) based on local image characteristics such as edge orientation, texture complexity, and frequency content. This allows the compression system to optimize visual quality at each region while maintaining overall low bit rate, resolving the contradiction between reduced bit rate and maintained visual quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements local quality by applying different filtering strategies to different regions of the video frame. High-frequency regions with edges or fine details receive more sophisticated filtering (e.g., bicubic or Lanczos) to preserve quality, while low-frequency smooth regions use simpler filtering (e.g., bilinear) to save bits. This regional adaptation maintains visual quality where needed while achieving overall bit rate reduction.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If high-frequency information is preserved to maintain quality, then bit rate increases, but at low bit rates this information is lost causing artifacts

Engineering Contradiction:
ImprovequalityVSAvoidbit rate
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies parameter changes by varying filter order, kernel size, and cutoff frequencies based on local image characteristics. In regions requiring high-frequency preservation, the system uses higher-order filters with larger kernels and less aggressive low-pass filtering. In regions where quality is less critical, it uses lower-order filters with smaller kernels and stronger compression. This dynamic parameter adjustment maintains quality where needed while controlling overall bit rate.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements partial action by applying high-quality filtering only to necessary regions rather than uniformly across the entire frame. By identifying regions with edges, textures, or fine details that require preservation, the system applies sophisticated filtering selectively to those areas while using aggressive compression in smooth, less critical regions. This partial application of high-quality processing maintains essential visual information while keeping the overall bit rate low.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If multiple filter types are used for different regions, then visual quality improves, but computational complexity increases

Engineering Contradiction:
Improvevisual qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the video frame into multiple regions based on local characteristics such as edge detection, gradient magnitude, and frequency analysis. Each segment is then assigned an appropriate filter type from the available set (bilinear, bicubic, Lanczos, etc.). This segmentation approach allows the system to use complex filtering only where necessary while using simpler filters elsewhere, thereby improving visual quality without uniformly increasing computational complexity across the entire frame.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamics by making filter selection adaptive based on real-time analysis of local image characteristics. Rather than using a fixed filter for the entire frame or pre-defining static regions, the system dynamically determines the appropriate filter type for each region based on current image content. This dynamic adaptation improves visual quality where needed while avoiding unnecessary computational complexity in regions where simple filtering suffices.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8107571B2Parameterized filters and signaling techniques
Publication Date: 2012.01.31 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8107571B2 patent drawing
  • US8107571B2 patent drawing
  • US8107571B2 patent drawing

AI summary

Filter taps for filters are specified by filter coefficient parameters. The filter taps are greater in number than the coefficient parameters from which the filter taps are calculated. For example, two coefficient parameters are used to specify a four-tap filter. Filter information can be signaled in a bitstream, such as by signaling one or more family parameters for a filter family and, for each filter in a family, signaling one or more filter tap parameters from which filter taps can be derived. Family parameters can include a number of filters parameter, a resolution parameter, a scaling bits parameter, and/or a full integer position filter present parameter that indicates whether or not the filters include an integer position filter. Filter parameters can be signaled and used to determine coefficient parameters from which filter taps are calculated.