Video Coding Spatial Subset Extraction for Scalable Bitstream Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding systems face challenges in efficiently encoding and decoding video data, particularly in scalable and multiview scenarios, where existing methods often discard essential information to reduce bitrate, leading to suboptimal performance in storage and transmission.
Innovation Solution
The method involves extracting spatial subsets from coded pictures to create parallel bitstreams, allowing for the removal of non-essential pictures and utilizing multiple decoder instances to manage decoding capacity, enabling efficient decoding of video data in scalable and multiview environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If pictures are discarded to reduce bitrate, then transmission efficiency is improved, but decoding quality deteriorates
Solution Approach 1:
The patent divides the video stream into multiple independent bitstreams, each containing a specific spatial subset (e.g., motion-constrained tile sets). This segmentation allows selective transmission and decoding of picture subsets, enabling the system to discard less essential pictures while preserving quality in critical regions, thus resolving the contradiction between transmission efficiency and decoding quality.
Solution Approach 2:
The patent applies different quality levels to different spatial regions by creating bitstreams with varying picture subsets. Motion-constrained tile sets and other spatial subsets allow certain regions to maintain higher quality while other regions use lower bitrate, optimizing the overall balance between transmission efficiency and perceived decoding quality.
2Adaptability or versatility
If multiple bitstreams are created for spatial subsets, then decoding flexibility is improved, but system complexity increases
Solution Approach 1:
The patent segments the video content into multiple bitstreams based on spatial subsets, where each bitstream can be independently decoded. This segmentation provides decoding flexibility by allowing selective playback of different spatial regions or quality levels, while the modular structure keeps system complexity manageable through standardized processing pipelines for each bitstream.
Solution Approach 2:
The patent designs the bitstream structure and decoding architecture to be universally applicable across different scenarios. The same decoding framework handles multiple bitstreams with different spatial subsets, making the system versatile for various applications (e.g., scalable video coding, multiview video coding) without requiring separate complex systems for each case.
3Productivity
If parallel decoding is implemented, then processing speed is improved, but resource requirements increase
Solution Approach 1:
The patent segments video content into parallel bitstreams that can be decoded simultaneously by multiple decoder instances. This segmentation enables processing speed improvement through parallel decoding, while resource requirements are optimized by allocating decoder instances only when needed and allowing shared resources for common operations like motion compensation and inverse transforms.
Solution Approach 2:
The patent implements partial parallel decoding by creating multiple bitstreams with different spatial subsets, where not all bitstreams need to be decoded simultaneously in all scenarios. This allows the system to use partial parallel processing (e.g., decoding only essential bitstreams) to achieve speed improvements while avoiding the full resource overhead of complete parallel decoding, thus resolving the contradiction between processing speed and resource requirements.
Data Source
AI summary
The invention relates to video coding and decoding. A method comprises extracting a first spatial subset from coded pictures of a first bitstream into a second bitstream; extracting a second spatial subset from the coded pictures of the first bitstream into a third bitstream; generating a fourth bitstream by selecting and removing a first set of pictures from the third bitstream, wherein the selection is performed in a manner that the first set of pictures is not required for decoding any pictures of the fourth bitstream; decoding the second bitstream; and decoding the fourth bitstream.