Tile-Based Video Decoding with Independent Motion Vector Derivation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video decoding systems require regenerating the entire video to decode a partial region or limited number of tiles, leading to reduced coding efficiency and increased processing demands, as they rely on information from neighboring tiles for spatial and temporal prediction.
Innovation Solution
A video encoding and decoding system that derives motion vectors for spatial-temporal prediction using neighboring blocks, determines the presence of reference pixels within a tile sequence, and derives pixel values based on pixel values within the tile sequence, allowing independent decoding of each tile without relying on external information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the entire video is regenerated to decode a partial region (tile), then decoding accuracy is maintained, but processing time and computational resources increase significantly
Solution Approach 1:
The video picture is divided into multiple independent tiles that can be decoded separately. Each tile contains all necessary prediction information (spatial and temporal) required for independent decoding, eliminating the need to process the entire video to decode a partial region. This segmentation enables parallel processing and reduces processing time while maintaining decoding accuracy.
2Productivity
If information from neighboring tiles is used for spatial and temporal prediction, then coding efficiency is improved, but device complexity increases due to additional information transmission and processing requirements
Solution Approach 1:
The video is segmented into independent tiles, each containing complete prediction information. This eliminates the need for complex inter-tile prediction mechanisms while maintaining coding efficiency through intra-tile prediction methods. The segmentation simplifies the decoding process by removing dependencies between tiles.
Solution Approach 2:
Each tile is designed to be self-contained with universal prediction capabilities using spatial and temporal prediction methods that work independently within the tile. This multi-functional approach allows each tile to perform complete prediction operations without requiring external tile information, reducing device complexity.
Data Source
AI summary
In a case of referring to information between pictures by means of inter prediction, the entire picture needs to be decoded even in a case of decoding a small region. In a case of referring to information within a picture by means of intra prediction, referring to information across a tile boundary is not possible. In a case that a pixel pointed by a sub-block level motion vector of a target block that is calculated by scaling based on an available motion vector acquired from a spatial neighboring block or a temporal neighboring block is not present within a tile sequence, a process of replacing the pixel value with a pixel value within the tile sequence is performed. In a case of referring to a pixel outside of a tile by means of intra prediction, a process of replacing the pixel value with that of a pixel within the tile is performed.