Video Block Quality Determination Using Spatial and Temporal Filters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding techniques face issues with abrupt changes in quality values for objects moving across different blocks, leading to inconsistent visual fidelity across frames, as quality values are set independently for each block without considering the object's continuity across frames.

Innovation Solution

A method is introduced to determine quality values for a subject block by identifying contributing blocks within the same or different frames that are part of the same object, applying spatial and temporal filters to adjust the initial quality value, ensuring a consistent visual representation by blending quality values from contiguous and temporally related blocks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If quality values are set independently for each block without considering object continuity, then the encoding process is simple and fast, but abrupt changes in visual quality occur for objects moving across blocks

Engineering Contradiction:
Improveencoding speedVSAvoidvisual quality consistency
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements feedback by using spatial and temporal filters that analyze quality values from neighboring blocks and previous frames, then adjust the current block's quality value based on this feedback. This ensures objects maintain consistent quality as they move across block boundaries while still allowing independent block processing for efficiency.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies local quality by allowing different quality values for different blocks based on their spatial and temporal relationships. Objects moving through multiple blocks receive adapted quality values in each block based on filters applied to contributing blocks, enabling localized quality adjustment without uniform processing across the entire frame.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If quality values are adjusted using spatial and temporal filters considering object continuity, then visual quality consistency is improved, but the encoding process becomes more complex

Engineering Contradiction:
Improvevisual quality consistencyVSAvoidencoding process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the quality adjustment process into distinct spatial and temporal filter operations. By dividing the complex task of maintaining object quality continuity into separate spatial filtering (across blocks in the same frame) and temporal filtering (across frames), the system manages complexity while achieving consistent visual quality for moving objects.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11310496B2Determining quality values for blocks of encoded video
Publication Date: 2022.04.19 ATI TECHNOLOGIES ULC
  • US11310496B2 patent drawing
  • US11310496B2 patent drawing
  • US11310496B2 patent drawing

AI summary

A technique for determining a quality value for a subject block of encoded video is provided. Contributing blocks, of the same frame and/or different frames of the subject block, are determined by identifying blocks likely to be a part of the same moving object or background as the subject block. A spatial and/or temporal filter is then applied to the quality values of the contributing blocks and an initial quality value of the subject block. With a spatial filter, quality values for contributing blocks from the same frame are combined and used to modify the quality value of the subject block. With a spatial filter, a temporal characteristic quality value for contributing blocks of one or more other frames (such as the immediately previous frame) is determined and then combined with a quality value representative of the subject block.