Temporal Scalability in Video Encoding via Access Picture Classification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding methods lack efficient mechanisms for temporal scalability, leading to increased complexity and reduced data compression efficiency when handling high-resolution images or large data amounts, as they fail to effectively utilize reference pictures and distinguish between decodable and undecodable temporal layers during layer switching.
Innovation Solution
The proposed solution involves splitting pictures into temporal sub-layers, classifying temporal layer access pictures based on their ability to reference previous pictures, and adding type syntax information to transmission unit data to differentiate between first and second temporal layer access pictures, allowing for optimized reference usage and resource management during decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If temporal layer switching is implemented without classification mechanisms, then temporal scalability is achieved, but video compression efficiency decreases and unnecessary decoding processes occur
Solution Approach 1:
The patent segments temporal layer access pictures into two distinct types: first temporal layer access pictures (which allow reference to previous pictures) and second temporal layer access pictures (which do not allow reference). This segmentation is achieved by introducing a classification mechanism that adds type syntax information to transmission unit data, enabling the decoder to distinguish between the two types and process them accordingly, thereby preventing unnecessary decoding operations and improving compression efficiency while maintaining temporal scalability
Solution Approach 2:
The patent applies local quality by treating different temporal layer access pictures with different reference permissions based on their specific characteristics. Instead of applying a uniform reference policy to all temporal layer access pictures, the system selectively enables or disables reference functionality for each picture type, optimizing the balance between compression efficiency and temporal scalability for each local case
2Reliability
If all temporal layer access pictures are treated as decodable, then temporal scalability is maintained, but hardware resources are wasted on decoding undecodable pictures
Solution Approach 1:
The patent implements preliminary action by classifying temporal layer access pictures into decodable and undecodable types before the decoding process begins. The type syntax information is added to transmission unit data in advance, allowing the decoder to identify undecodable pictures (second temporal layer access pictures) beforehand and skip their decoding, thus preventing waste of hardware resources while maintaining the reliability of temporal scalability for decodable pictures
3Ease of operation
If reference picture usage is not restricted during temporal layer switching, then decoding flexibility is improved, but data compression efficiency decreases
Solution Approach 1:
The patent applies dynamics by making the reference picture usage policy flexible and adaptive rather than static. The system dynamically adjusts reference permissions based on the type of temporal layer access picture being decoded: first temporal layer access pictures allow reference to previous pictures for better compression, while second temporal layer access pictures restrict reference usage to maintain decoding efficiency. This dynamic control is achieved through the type syntax information that guides the decoding process
Data Source
AI summary
Provided are a video encoding method and apparatus having temporal scalability, and a video decoding method and apparatus having temporal scalability. The video encoding method includes: splitting pictures included in a picture sequence into temporal sub-layers; classifying, as a first temporal layer access picture or a second temporal layer access picture, a temporal layer access picture based on whether a picture encoded after the temporal layer access picture is capable of referring to a picture encoded before the temporal layer access picture; and adding, to transmission unit data including the temporal layer access picture, type syntax information for identifying the first temporal layer access picture and the second temporal layer access picture, wherein the picture encoded after the temporal layer access picture belongs to a same temporal sub-layer as the temporal layer access picture or belongs to an upper temporal sub-layer to the temporal layer access picture.