Integrated Temporal Filter for Video Encoder Bandwidth Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video encoding systems require high bandwidth due to the large volume of data from high-resolution frames, and existing temporal filtering configurations are not optimized for efficient noise removal and bandwidth reduction.

Innovation Solution

A video encoder with an integrated temporal filter that performs motion estimation, compensation, and blending to determine the need and strength of blending between current and reconstructed frames, reducing residual data and bandwidth requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional video encoding systems process high-resolution frames, then video quality is maintained, but bandwidth requirements increase significantly

Engineering Contradiction:
Improvevideo qualityVSAvoidbandwidth requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent merges the temporal filter functionality directly into the video encoder architecture, integrating it with the motion estimation and compensation modules. This consolidation allows the system to perform temporal filtering operations as part of the standard encoding process, reducing the need for separate filtering stages and thereby lowering bandwidth requirements while maintaining video quality through efficient noise removal and frame blending.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent employs temporal filtering techniques that dynamically adjust filtering parameters based on motion information and frame characteristics. By changing filtering strength and type according to the specific video content and motion vectors, the system optimizes the balance between noise reduction and detail preservation, achieving quality maintenance with reduced bandwidth consumption.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If temporal filtering is applied to remove noise and smooth transitions, then video quality improves, but processing complexity increases

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

By integrating the temporal filter into the encoder's motion processing pipeline, the patent combines multiple functions (motion estimation, motion compensation, and temporal filtering) into a unified processing architecture. This merging reduces overall system complexity compared to having separate filtering stages, as the temporal filter operates concurrently with motion processing rather than as an additional sequential step.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The temporal filter performs preliminary filtering operations on reference frames before they are used in motion estimation and compensation. This preliminary action prepares the frames in advance, reducing the computational burden during the main encoding process and simplifying the overall processing flow while still achieving noise removal and transition smoothing.

Inventive Principle:
Principle #10Preliminary action

3Object-affected harmful factors

If conventional temporal filter configurations are used, then noise removal is performed, but bandwidth reduction is not optimized

Engineering Contradiction:
Improvenoise removalVSAvoidbandwidth reduction
Core Design Contradiction:
Object-affected harmful factorsVSQuantity of substance

Solution Approach 1:

The patent dynamically adjusts temporal filter parameters such as filtering strength, range, and type based on motion vector magnitude and frame characteristics. This adaptive parameter adjustment allows the system to optimize noise removal effectiveness while minimizing bandwidth requirements by applying stronger filtering only where necessary and using weaker filtering where the video content already has low noise levels.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The temporal filter configuration is made dynamic rather than static, adapting to changing video conditions in real-time. The filter strength and characteristics are adjusted based on current motion information and frame quality, enabling optimized noise removal and bandwidth reduction that responds to the specific demands of each video sequence rather than using a fixed filtering approach.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9414091B2Video encoder with an integrated temporal filter
Publication Date: 2016.08.09 QUALCOMM INC
  • US9414091B2 patent drawing
  • US9414091B2 patent drawing
  • US9414091B2 patent drawing

AI summary

A video encoder with an integrated temporal filter, which has an output carrying a sequence of encoded frames, includes: an input receiving input frame data; a temporal filter receiving the input frame data from the input and producing filtered frame data; motion processing modules receiving reconstructed frames derived from the sequence of encoded frames and the filtered frame data from the temporal filter and producing a residual error signal output; and a coder module which receives the input frame data and the residual error signal and produces the sequence of encoded frames. A method of encoding video includes: receiving a current frame to be encoded into a motion estimator and a temporal filter substantially at one time; receiving a previously encoded reference frame; generating a reconstructed motion-compensated reference frame from the previously encoded reference frame; and determining from the motion-compensated reference frame and the current frame whether and how much blending to perform between the motion compensated reference frame and the current frame.