Video Encoder-Decoders for Parallel Reference Picture Resampling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video codecs like HEVC lack efficient parallel processing capabilities for video encoding and decoding, particularly in handling reference picture resampling and region of interest encoding, leading to inefficiencies and increased implementation burdens.

Innovation Solution

Introduce dynamic sample aspect ratio signaling, restricted reference picture resampling, and flexible region-based referencing to enhance parallel processing and reduce implementation costs, allowing for more efficient video encoding and decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If reference picture resampling is implemented in existing video codecs, then video quality and rate adaptation are improved, but device complexity and implementation burden increase significantly

Engineering Contradiction:
Improvevideo quality adaptationVSAvoidimplementation burden
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the picture into multiple regions with different reference picture resampling configurations. Each region can independently specify whether reference picture resampling is enabled and which resampling mode to use, allowing selective application of the complex resampling functionality only where needed rather than uniformly across the entire picture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent enables different resampling modes (e.g., nearest neighbor, bilinear, bicubic) to be applied to different regions of the picture based on local requirements. This allows high-quality resampling to be used in critical regions while simpler methods are used in less critical areas, optimizing both quality and complexity.

Inventive Principle:
Principle #3Local quality

2Productivity

If parallel processing is enhanced for video encoding and decoding, then productivity is improved, but device complexity increases

Engineering Contradiction:
Improveparallel processing capabilityVSAvoidprocessing architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent enables parallel processing by dividing the picture into multiple regions that can be processed independently. Each region's encoding/decoding can be performed in parallel by separate processing units, improving productivity while keeping each individual processing unit relatively simple.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a spatial dimension for parallelization by dividing the picture into multiple regions. This allows parallel processing across different spatial locations rather than requiring complex temporal or functional parallelization, simplifying the processing architecture.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If dynamic sample aspect ratio signaling is implemented, then adaptability is improved, but device complexity increases

Engineering Contradiction:
Improveaspect ratio flexibilityVSAvoidsignaling complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies different sample aspect ratios to different regions of the picture rather than using a single aspect ratio for the entire picture. Each region can specify its own aspect ratio independently, providing local adaptability while keeping the overall system manageable through region-based control.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12483692B2Encoder and decoder, encoding method and decoding method for reference picture resampling extensions
Publication Date: 2025.11.25 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US12483692B2 patent drawing
  • US12483692B2 patent drawing
  • US12483692B2 patent drawing

AI summary

A video decoder (151) for decoding an encoded video signal comprising encoded picture data to reconstruct a plurality of pictures of a video sequence of a video. The video decoder (151) comprises an input interface (160) configured for receiving the encoded video signal comprising the encoded picture data. Moreover, the video decoder (151) comprises a data decoder (170) configured for reconstructing the plurality of pictures of the video sequence depending on the encoded picture data. Moreover, further video decoders, video encoders, systems, methods for encoding and decoding, computer programs and encoded video signals according to embodiments are provided.