Spatiotemporal Metrics for Video Coding Artifact Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video compression systems face challenges in minimizing spatial and temporal artifacts such as flickering and distortion due to inadequate coding mode and quantization decisions, which affect the perceptual quality of compressed video.

Innovation Solution

The implementation of spatial and temporal metrics to optimize coding mode decisions and quantization processes, including pre-filtering methods and dynamic programming techniques, to minimize artifacts and improve perceptual quality by considering the impact on neighboring blocks and frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional video compression systems use standard coding modes and quantization, then compression efficiency is maintained, but spatial and temporal artifacts such as flickering and distortion increase

Engineering Contradiction:
Improveperceptual qualityVSAvoidspatial and temporal artifacts
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent applies preliminary action by computing spatio-temporal metrics before final coding mode selection. The system evaluates multiple candidate coding modes and quantization parameters in advance using predicted distortion measures, allowing artifact-prone configurations to be identified and avoided before actual encoding occurs. This proactive approach enables the system to select coding parameters that minimize flickering and spatial-temporal artifacts while maintaining compression efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms where the encoder uses spatio-temporal metrics and distortion measures to guide coding mode decisions. The system continuously monitors the impact of coding decisions on artifact generation and adjusts quantization parameters and coding modes accordingly. This feedback loop ensures that compression operations are optimized to minimize perceptual quality degradation and artifact formation.

Inventive Principle:
Principle #23Feedback

2Reliability

If coding mode decisions are made without considering spatio-temporal metrics, then processing speed is maintained, but artifacts in compressed video increase

Engineering Contradiction:
Improveperceptual qualityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies local quality by computing spatio-temporal metrics selectively for specific regions and coding modes rather than uniformly for the entire video stream. The system identifies local areas prone to artifacts and applies enhanced metric evaluation only where needed, such as in regions with high motion activity or temporal flickering potential. This localized approach maintains processing efficiency while improving perceptual quality in critical areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent employs partial action by implementing spatio-temporal metric computation only for a subset of coding modes and quantization parameters that are most likely to generate artifacts. Rather than exhaustively evaluating all possible coding configurations, the system focuses computational resources on the most critical decisions, achieving sufficient artifact reduction with lower processing overhead.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If quantization is applied without spatio-temporal optimization, then compression efficiency is maintained, but spatial artifacts and temporal flickering increase

Engineering Contradiction:
Improveperceptual qualityVSAvoidspatial artifacts and temporal flickering
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent applies dynamics by making quantization parameters adaptive rather than fixed. The system dynamically adjusts quantization step sizes and precision levels based on real-time spatio-temporal metric evaluations. In regions where temporal flickering is detected, the system increases temporal quantization precision. Similarly, spatial artifacts trigger localized precision adjustments. This dynamic quantization optimization minimizes artifacts while maintaining overall compression efficiency.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9020294B2Spatiotemporal metrics for rate distortion optimization
Publication Date: 2015.04.28 DOLBY LABORATORIES LICENSING CORP
  • US9020294B2 patent drawing
  • US9020294B2 patent drawing
  • US9020294B2 patent drawing

AI summary

Spatial and temporal metrics are computed for a picture or regions within a picture to determine the impact of coding and quantization on the quality of an encoded picture. Prediction mode decisions and quantization optimization algorithms are used to create a compressed bit stream that minimizes coding artifacts. Pre-processing techniques are also used to suppress coding artifacts that reduce picture quality.