Video Preprocessing via Feature Extraction and Adaptive Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding technologies face a tradeoff between bit rate and quality, with a need for enhanced methods that can improve video quality or reduce bit rate without increasing processing overhead.

Innovation Solution

The proposed method involves preprocessing video signals before encoding by extracting important features, applying noise-removal filtering, and adaptively filtering based on feature activity to remove unnecessary information, thereby enhancing coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If noise-removal filtering is applied to the remaining video signal after feature extraction, then random noise is effectively removed without impacting important feature elements, but processing complexity increases

Engineering Contradiction:
Improverandom noiseVSAvoidprocessing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The video signal is segmented into two distinct components: extracted feature elements and remaining signal. Noise removal is applied selectively to the remaining signal portion, allowing aggressive filtering without affecting important features. This segmentation enables targeted noise reduction while maintaining feature integrity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing strategies are applied to different portions of the video signal. The extracted features receive preservation treatment while the remaining signal undergoes noise removal filtering. This local differentiation allows optimal processing for each component's specific requirements.

Inventive Principle:
Principle #3Local quality

2Productivity

If adaptive filtering with variable strength is applied based on feature activity levels, then coding efficiency is improved by removing unnecessary information, but processing overhead increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing overhead
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The filtering strength is made dynamic and adaptive based on the measured feature activity level. When feature activity is high, stronger filtering is applied to remove more unnecessary information; when activity is low, weaker filtering is used to preserve important details. This dynamic adjustment optimizes coding efficiency across varying video content.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The filtering parameters (strength, intensity) are changed adaptively based on the feature activity metric. By monitoring the activity level and adjusting filtering parameters accordingly, the system removes unnecessary information more effectively in high-activity regions while preserving quality in low-activity regions, improving overall coding efficiency.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If preprocessing is applied to remove unnecessary information before encoding, then video quality increases or bit rate decreases, but processing time increases

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Noise removal and feature processing are performed as preliminary actions before the main encoding process. By removing unnecessary information and noise in advance, the subsequent encoding operation works with cleaner, more compressed data, improving final video quality or reducing bit rate requirements.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Important feature elements are extracted and separated from the remaining signal. This extraction allows the encoding process to focus on preserving essential features while allowing more aggressive compression of the remaining signal, improving coding efficiency without sacrificing critical video information.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8792564B2Adaptive preprocessing method using feature-extracted video maps
Publication Date: 2014.07.29 SONY GROUP CORP
  • US8792564B2 patent drawing
  • US8792564B2 patent drawing
  • US8792564B2 patent drawing

AI summary

A method and apparatus for preprocessing a video signal prior to its being encoded. During preprocessing, features are extracted from the video signal into feature planes which are each adaptively filtered in response to estimations of feature activity. After feature extraction the signal which remains is referred to as a “remaining signal”, which is then noise filtered to remove a substantial portion of the noise. The feature planes and remaining signal are recombined into a preprocessed output signal configured for receipt and processing by a video encoder. A video encoder receiving the preprocessed video signal can generate higher quality and/or lower bit rate encoded video than one receiving the original source video. Preprocessing according to the invention is particularly well suited for use with encoders adapted to remove temporal and/or spatial redundancy, such as those implemented according to the MPEG2/4, or AVC/H.264 standards.