Video Coding Tile Set Bitstream Construction for Partial Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video coding methods require full decoding of coded pictures, even when only a partial picture is needed for display, leading to inefficient use of network resources and potential congestion in streaming environments like head-mounted displays, where only a subset of a 360-degree video is displayed.
Innovation Solution
A method to generate a video bitstream that includes a motion-constrained tile set, allowing for the construction of a full-picture-compliant tile set by adding a tile column and modifying slice segments, and providing instructions for decoding to exclude unnecessary tiles, thereby optimizing bitstream construction and decoding for partial picture display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If full picture decoding is performed, then complete picture quality is maintained, but network bandwidth is wasted on undisplayed areas
Solution Approach 1:
The picture is divided into multiple tiles, and only the necessary tiles corresponding to the display area are decoded and transmitted. This segmentation allows the system to avoid decoding undisplayed areas, thereby reducing network bandwidth consumption while maintaining picture quality for the displayed region.
Solution Approach 2:
The necessary tiles are extracted from the full picture bitstream and transmitted separately. By extracting only the required portions, the system eliminates waste of network resources on undisplayed areas while ensuring complete picture quality for the displayed content.
2Productivity
If motion-constrained tile set is used, then selective decoding is enabled, but bitstream structure complexity increases
Solution Approach 1:
The bitstream is segmented into multiple tiles with motion constraints, allowing independent decoding of each tile. This segmentation enables selective decoding of only the necessary tiles, improving decoding speed and productivity while the segmentation overhead is managed through efficient tile organization.
Solution Approach 2:
Instead of decoding the entire picture, only the partial set of tiles that correspond to the display area are decoded. This partial action approach significantly improves decoding speed by avoiding unnecessary decoding operations on undisplayed regions.
3Reliability
If tile column is added for conformance, then full-picture compliance is achieved, but bitrate increases
Solution Approach 1:
A tile column is copied and added to the motion-constrained tile set to achieve full-picture compliance. This copying approach allows the system to maintain compatibility with full-picture decoding requirements while keeping the additional bitrate overhead minimal, as the copied tiles can be efficiently encoded and transmitted.
Data Source
AI summary
A method comprising obtaining a full-picture track or bitstream including a motion-constrained tile set; and constructing a full-picture-compliant tile set track or bitstream on the basis of the motion-constrained tile set or generating instructions to construct a full-picture-compliant tile set track or bitstream on the basis of the motion-constrained tile set.