Adaptive Resolution Management Signaling for Video Bitstream Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video compression technologies face inefficiencies in managing resolution, particularly in encoding and decoding processes, which lead to increased bitrate and reduced video quality due to the requirement of re-coding entire groups of pictures, including intra-frames that consume bulk bits.

Innovation Solution

Adaptive Resolution Management (ARM) allows for flexible resolution scaling by using reference frames of different resolutions, enabling downscaling or upscaling of video, thus reducing bitrate and improving playback characteristics, by signaling scaling factors within the bitstream and applying them on a block-level basis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If adaptive resolution management mode is used with block-level scaling, then bitrate is reduced and video quality is improved, but device complexity increases due to additional scaling factor signaling and processing

Engineering Contradiction:
ImprovebitrateVSAvoidencoding complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The video frame is divided into blocks, and scaling is applied independently to each block based on motion characteristics. This segmentation allows selective resolution management where only certain blocks require scaling operations, reducing overall bitrate while maintaining quality in important regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different scaling factors are applied to different blocks based on their local motion characteristics and importance. Blocks with high motion or high importance receive higher resolution treatment, while less important blocks use lower resolution, optimizing the balance between bitrate and quality locally.

Inventive Principle:
Principle #3Local quality

2Loss of energy

If adaptive resolution management mode is used with block-level scaling, then bitrate is reduced and video quality is improved, but device complexity increases due to additional scaling factor signaling and processing

Engineering Contradiction:
ImprovebitrateVSAvoiddecoding automation
Core Design Contradiction:
Loss of energyVSExtent of automation

Solution Approach 1:

Scaling factors are signaled in advance within the bitstream during encoding, allowing the decoder to prepare scaling operations beforehand. This preliminary action enables efficient decoding automation by providing all necessary parameters before the actual reconstruction process begins.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The scaling factors and resolution management parameters are copied into the bitstream as metadata, allowing the decoder to replicate the encoder's resolution management decisions without requiring complex real-time analysis, thus simplifying automated decoding.

Inventive Principle:
Principle #26Copying

3Device complexity

If traditional resolution management is used by re-coding entire groups of pictures, then device complexity is reduced, but bitrate increases and video quality deteriorates due to intra-frame overhead

Engineering Contradiction:
Improveencoding complexityVSAvoidbitrate
Core Design Contradiction:
Device complexityVSLoss of energy

Solution Approach 1:

The patent extracts the resolution management function from the traditional group-of-pictures re-coding approach. Instead of re-coding entire GOPs, only the necessary scaling factors for individual blocks are extracted and signaled, eliminating the overhead of intra-frames while maintaining encoding simplicity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of applying full re-coding to entire groups of pictures, the patent applies partial action by selectively scaling only the blocks that require resolution adjustment. This partial approach reduces bitrate and improves quality without the excessive complexity of complete re-coding.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240430467A1Encoder and bitstream for adaptive resolution management signaling
Publication Date: 2024.12.26 DOLBY INTERNATIONAL AB
  • US20240430467A1 patent drawing
  • US20240430467A1 patent drawing
  • US20240430467A1 patent drawing

AI summary

A video encoder includes circuitry to generate an encoded bitstream for decoding by a compliant decoder, the encoded bitstream including a first picture to be used as a reference picture, a current picture comprising a first coded block and a second coded block, a signal indicating that a block-based mode when a reference picture and a current picture have different resolutions is enabled, and information including an index useful for determining a scaling constant. The compliant decoder has circuitry configured to receive the bitstream; determine whether the block-based mode is enabled, and if enabled utilizing the mode to reconstruct the first block and reconstruct the second block without using the mode.