Drift-Free Video Tile Filtering for Parallel Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding and decoding technologies, such as H.265/HEVC, face challenges in efficiently supporting parallel processing capabilities, particularly when dividing videos into independent tiles or regions, leading to subjective artefacts and error propagation due to conventional boundary filtering limitations and inadequate handling of complex boundary geometries.

Innovation Solution

The implementation of a video encoder and decoder that employ drift-free filtering and adaptive boundary handling, where tiles are independently encoded and decoded, using a reference block that avoids contaminated samples affected by loop filtering, and employing modified filter kernel reaches based on tile boundaries to prevent error propagation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If tiles are independently encoded and decoded with conventional boundary filtering, then parallel processing efficiency is improved, but subjective artefacts and error propagation occur at tile boundaries

Engineering Contradiction:
Improveparallel processing efficiencyVSAvoidquality at tile boundaries
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The picture is divided into multiple independently encodable and decodable tiles, allowing parallel processing while maintaining independent error confinement. Each tile can be processed separately without affecting other tiles, thus improving productivity while managing reliability through proper boundary handling.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different filtering approaches are applied to different regions: conventional filtering within tiles and drift-free filtering at tile boundaries. This local differentiation ensures high quality at boundaries where error propagation is critical while maintaining efficiency in internal regions.

Inventive Principle:
Principle #3Local quality

2Reliability

If loop filtering is applied across tile boundaries, then boundary artefacts are reduced, but error propagation occurs between independently encoded tiles

Engineering Contradiction:
Improveboundary smoothnessVSAvoiderror propagation
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The harmful effect of error propagation is extracted and eliminated by using drift-free filtering at tile boundaries. This filtering method removes the dependency chain that causes errors to propagate between independently encoded tiles while preserving the boundary smoothness benefits of filtering.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Drift-free filtering is applied as a preliminary measure at tile boundaries to prevent error propagation before it can occur. By proactively using filtering methods that do not create drift or error dependencies, the system prevents the harmful effect from manifesting in the first place.

Inventive Principle:
Principle #9Preliminary anti-action

3Measurement precision

If reference blocks include samples affected by loop filtering, then decoding accuracy improves, but contamination from filtered samples degrades quality

Engineering Contradiction:
Improvedecoding accuracyVSAvoidsample contamination
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The contamination issue is converted into a benefit by using the filtered samples for their intended purpose (boundary smoothing) while excluding them from reference block calculations. This separates the beneficial filtering effect from the harmful contamination effect, allowing both to coexist without negative interaction.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The sample set is segmented into two groups: samples affected by loop filtering and samples not affected. Reference blocks are constructed using only the non-filtered samples to avoid contamination, while filtered samples are used separately for boundary filtering operations.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240406431A1Encoder and decoder, encoding method and decoding method for drift-free padding and hashing of independent coding regions
Publication Date: 2024.12.05 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US20240406431A1 patent drawing
  • US20240406431A1 patent drawing
  • US20240406431A1 patent drawing

AI summary

A video encoder according to embodiments is configured for encoding a plurality of pictures of a video by generating an encoded video signal, wherein each of the plurality of pictures includes original picture data. The video encoder includes a data encoder configured for generating the encoded video signal including encoded picture data, wherein the data encoder is configured to encode the plurality of pictures of the video into the encoded picture data. Moreover, the video encoder includes an output interface configured for outputting the encoded picture data of each of the plurality of pictures. Furthermore, a video decoders, systems, methods for encoding and decoding, computer programs and encoded video signals according to embodiments are provided.