Adaptive Video Preprocessing via Complexity Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding techniques face challenges in determining optimal preprocessing methods to minimize visible artifacts and achieve efficient encoding, lacking a mechanism to accurately assess video sources for informed preprocessing decisions.

Innovation Solution

The implementation of a multiple-pass video encoding system that analyzes complexity measurements from a first-pass encoding to calculate temporal and spatial complexity parameters, which are used to determine preprocessing filters and parameters for adaptive preprocessing, thereby enhancing encoding efficiency and reducing artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If preprocessing filters are applied to video data before encoding, then encoding efficiency is improved and visible artifacts are reduced, but it becomes difficult to determine the optimal filter strength without creating new artifacts

Engineering Contradiction:
Improveencoding efficiencyVSAvoidartifact visibility
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs a first-pass encoding analysis before the actual encoding to calculate complexity measurements and determine optimal preprocessing parameters. This preliminary action allows the system to prepare appropriate filter strengths based on actual video content characteristics without knowing the outcome in advance, resolving the difficulty of determining optimal filter strength.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses complexity measurements derived from first-pass encoding statistics to feedback into preprocessing parameter selection. By analyzing encoding statistics (such as quantization parameters, motion complexity, and spatial frequency content) from the first pass, the system adapts filter strength to match the actual video content, preventing both under-filtering and over-filtering artifacts.

Inventive Principle:
Principle #23Feedback

2Reliability

If complex preprocessing analysis is performed to make informed decisions, then preprocessing effectiveness is improved, but system complexity and computational overhead increase

Engineering Contradiction:
Improvepreprocessing effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses the video data itself to determine preprocessing parameters by calculating complexity measurements from the video content during first-pass encoding. Instead of requiring external analysis or manual configuration, the system self-determines the appropriate preprocessing strength based on intrinsic video characteristics such as spatial complexity, temporal complexity, and perceptual importance.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes preprocessing parameters (filter strength, type, and application region) based on calculated complexity parameters. By dynamically adjusting these parameters according to local video content characteristics rather than using fixed parameters, the system achieves high preprocessing effectiveness without requiring overly complex manual configuration or analysis systems.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If multiple-pass encoding is implemented to calculate complexity parameters, then encoding precision is improved, but encoding time and processing duration increase

Engineering Contradiction:
Improveencoding precisionVSAvoidencoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The first-pass encoding performs preliminary analysis to calculate complexity measurements that are then used to guide the second-pass encoding. By performing the computationally intensive analysis work in the first pass, the second pass can focus on high-precision encoding with predetermined parameters, reducing its processing time while maintaining high overall precision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The encoding process is segmented into two distinct passes: a first pass for complexity analysis and parameter determination, and a second pass for high-precision encoding. This segmentation allows each pass to be optimized for its specific function, with the first pass being faster and less precise, and the second pass being slower but more precise, thereby reducing total encoding time compared to performing full precision analysis throughout.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8238424B2Complexity-based adaptive preprocessing for multiple-pass video compression
Publication Date: 2012.08.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8238424B2 patent drawing
  • US8238424B2 patent drawing
  • US8238424B2 patent drawing

AI summary

Multiple-pass video encoding systems and techniques are described which utilize statistics taken during a first-pass encoding to create complexity measurements for video data which is to be encoded. By analyzing these complexity measurements, preprocessing decisions, such as, for example, the determination of strength of denoise filters, can be made with greater accuracy. In one implementation, these complexity measurements take the form of calculation of temporal and spatial complexity parameters, which are then used to compute a unified complexity parameter for each group of pictures being encoded.