Minimizing Blocking Artifacts in Video Frames

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Block-based video compression techniques, such as MPEG-1, MPEG-2, and H.264, introduce blocking artifacts along block boundaries due to coarse quantization, which existing filtering methods struggle to eliminate without introducing blurring or wasting processing resources.

Innovation Solution

A blurring process that replaces pixels on blocking boundaries with randomly selected pixels within predefined regions, using a moving average process to smooth only pixels causing subjective perception of blocking artifacts, and implementing this as a post-processing step or in-loop deblocking in software or hardware.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If low pass filtering is applied to reduce blocking artifacts, then blocking artifacts are reduced, but blurring artifacts are introduced and processing resources are wasted

Engineering Contradiction:
Improveblocking artifactsVSAvoidblurring artifacts
Core Design Contradiction:
Object-affected harmful factorsVSObject-generated harmful factors

Solution Approach 1:

The patent applies different filtering strategies to different regions of the image. Specifically, it identifies block boundaries and applies localized filtering only at these boundaries rather than applying global low pass filtering. The method uses adaptive filtering that adjusts its behavior based on the local characteristics of the image, such as edge detection and region analysis, to reduce blocking artifacts only where present while preserving other areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the image into blocks and analyzes the characteristics of each block to determine where filtering is needed. It divides the processing into stages: identifying block boundaries, analyzing pixel differences across boundaries, and applying selective filtering only to regions with blocking artifacts. This segmentation approach allows the system to avoid unnecessary filtering in smooth regions while concentrating computational resources on problematic areas.

Inventive Principle:
Principle #1Segmentation

2Object-affected harmful factors

If standard blurring process is applied to remove image boundaries, then blocking artifacts are reduced, but the values of adjacent pixels do not change and the image boundary is not eliminated

Engineering Contradiction:
Improveimage boundaryVSAvoidpixel value precision
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The patent employs dynamic filtering that adapts its parameters based on the local image characteristics. Instead of applying a fixed blurring kernel, the system dynamically adjusts filtering strength and parameters based on detected block boundaries and pixel differences. This dynamic approach allows the filter to effectively remove boundaries where needed while maintaining precision in areas where boundaries are not present.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback mechanisms that continuously monitor pixel values and boundary characteristics during the filtering process. It uses the results of pixel difference analysis to adjust filtering parameters in real-time, ensuring that boundary removal is effective while maintaining pixel value precision. The feedback loop allows the system to learn from the effects of filtering and adjust subsequent operations accordingly.

Inventive Principle:
Principle #23Feedback

3Productivity

If compression ratio is increased, then data efficiency is improved, but blocking artifacts are created

Engineering Contradiction:
Improvedata efficiencyVSAvoidblocking artifacts
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies preliminary analysis of the compressed image to identify blocking artifacts before final processing. It performs preliminary block boundary detection and pixel difference analysis to determine where artifacts are present, then applies targeted filtering only to these identified regions. This preliminary action allows the system to prepare the image for efficient compression while planning compensatory filtering in advance.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8023559B2Minimizing blocking artifacts in videos
Publication Date: 2011.09.20 NBCUNIVERSAL MEDIA LLC
  • US8023559B2 patent drawing
  • US8023559B2 patent drawing
  • US8023559B2 patent drawing

AI summary

Techniques for minimizing blocking artifacts in video images or frames are disclosed. In general, these blocking artifacts are the result of block-based compression standards, such as MPEG-1, MPEG-2, MPEG-4, H.261, H.263, and H.264. According to one aspect of the present invention, a blurring process is configured to replace pixels on the blocking boundaries with randomly selected pixels within respective regions, each of the regions is predefined with respect to a pixel being replaced. In a certain perspective, a blocking boundary is diffused without introducing blurring to other than the blocking artifacts. According to another aspect to the present invention, pixels in an image or frame are sequentially processed by a moving average process that is configured to smooth only those pixels that may cause subjective perception of the blocking artifacts.