Video Subpicture Partitioning for Flexible Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding systems face challenges in efficiently partitioning and decoding video bitstreams into subpictures, particularly in Versatile Video Coding (VVC), which limits flexible extraction and merging of subpictures without compromising compression efficiency or requiring excessive computational resources.

Innovation Solution

The solution involves a method and apparatus for receiving an indication of supported subpictures, partitioning a bitstream into corresponding subpictures, generating an encoded bitstream, and delivering required parameter sets to enable efficient decoding and rendering of subpictures as individual or combined pictures, allowing for independent or dependent subpicture decoding and control of loop filtering across boundaries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If video bitstreams are partitioned into multiple subpictures for independent decoding, then decoding flexibility and low-latency delivery are improved, but device complexity and computational resources increase

Engineering Contradiction:
Improvedecoding flexibilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides a video picture into multiple independent subpictures, each with its own parameter sets and decoding instances. This segmentation allows receivers to decode only the required subpictures independently, improving decoding flexibility and enabling low-latency delivery without requiring the entire picture to be decoded. The subpictures can be extracted and decoded separately, reducing the computational burden on heterogeneous devices.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If multiple parameter sets are delivered for subpictures, then decoding precision and compression efficiency are improved, but data transmission overhead increases

Engineering Contradiction:
Improvedecoding precisionVSAvoiddata transmission overhead
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent assigns different parameter sets to different subpictures based on their specific decoding requirements. Each subpicture can have its own parameter set optimized for its characteristics, allowing for precise control over decoding quality and compression efficiency for each region. This local optimization enables the system to deliver only the necessary parameter information for each subpicture, reducing overall data transmission overhead while maintaining high decoding precision where needed.

Inventive Principle:
Principle #3Local quality

3Productivity

If subpictures are decoded at multiple decoding instances, then processing speed and parallelism are improved, but synchronization complexity increases

Engineering Contradiction:
Improveprocessing speedVSAvoidsynchronization complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent creates multiple independent decoding instances, each responsible for decoding a specific subpicture. This segmentation of the decoding process enables parallel processing of different subpictures, significantly improving processing speed and throughput. Each decoding instance operates independently with its own parameter set, which simplifies synchronization compared to traditional approaches where the entire picture must be decoded in sequence. The independent nature of subpicture decoding allows for easier coordination and reduced synchronization overhead.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20230061442A1Method, An Apparatus and A Computer Program Product for Video Encoding and Video Decoding
Publication Date: 2023.03.02 NOKIA TECHNOLOGIES OY
  • US20230061442A1 patent drawing
  • US20230061442A1 patent drawing
  • US20230061442A1 patent drawing

AI summary

The embodiments relate to a method at a sender device, the method including receiving, as a response to a delivered indication of a number of supported subpictures, from a receiver an indication on a number of subpictures allowed in an encoded image data; partitioning a bitstream representing an image data into subpictures, the amount of which corresponds to the indicated number of subpictures; generating an encoded bitstream including said subpictures; delivering the encoded bitstream to a receiver apparatus; and delivering required parameter sets for said subpictures to said receiver apparatus. The embodiments also concern a method at a receiver device, and corresponding devices.