Video Encoding Temporal Scalability B Picture Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Prior art methods for temporal scalable video bit streams fail to evenly distribute B pictures in time with respect to P pictures, leading to noticeable differences in spatial quality and potential jerkiness of motion, as they do not consider the combined viewing of base layer P pictures and enhancement layer B pictures as a single sequence.
Innovation Solution
A method that determines the temporal placement and bit allocation for B pictures in an enhancement layer based on the peak signal-to-noise ratios (PSNR) and bit allocation of base layer pictures, ensuring B pictures are evenly spaced and have similar PSNR to P pictures, thereby improving the subjective video quality by matching the bit allocation and positioning with the base layer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If B pictures are inserted in enhancement layers to increase frame rate, then temporal resolution is improved, but spatial quality becomes inconsistent compared to base layer P pictures
Solution Approach 1:
The patent applies parameter changes by dynamically adjusting the quantization parameter (QP) for B pictures based on the QP values of surrounding P pictures. The system calculates an average QP from neighboring P pictures and uses this to determine the optimal QP for B pictures, ensuring that spatial quality remains consistent across all picture types in the enhanced video stream.
2Adaptability or versatility
If more B pictures are encoded in enhancement layer, then temporal scalability is improved, but bit allocation becomes uneven leading to noticeable quality differences
Solution Approach 1:
The patent implements feedback mechanisms where the encoder continuously monitors the QP values of encoded P pictures and uses this information to adjust B picture QP assignments. This closed-loop approach ensures that bit allocation remains uniform across all pictures by adapting to the actual encoding characteristics of the video sequence.
Solution Approach 2:
The system dynamically modifies the quantization parameter for B pictures based on real-time analysis of surrounding P picture QP values. By calculating average QP from neighboring P pictures and adjusting B picture QP accordingly, the system achieves uniform bit allocation while maintaining temporal scalability.
3Speed
If B pictures are placed at specific temporal positions, then frame rate is increased, but motion smoothness deteriorates due to uneven distribution
Solution Approach 1:
The patent applies local quality by assigning different QP values to B pictures based on their specific temporal positions and the characteristics of surrounding P pictures. Each B picture receives a customized QP assignment that optimizes its contribution to motion smoothness, rather than using a uniform QP for all B pictures.
Solution Approach 2:
The system dynamically adjusts the quantization parameter for each B picture based on local analysis of surrounding P picture QP values. This localized parameter adjustment ensures that B pictures are distributed evenly in time while maintaining motion smoothness, as each picture's QP is optimized for its specific context.
Data Source
AI summary
A method of enchancing a video bit stream using temporal scalability, wherein the number of bits or a temporal position of a bidirectionally predicted picture in an enhancement layer is determined with reference to a corresponding characteristic of pictures in another layer of layers, such as a base layer, of the video bit stream and the peak signal to noise ration of the B picture is matched to that of the pictures in the layer below. By endeavouring to align the characteristics of the bidirectionally predicted picture or pictures with the existing picture or pictures in the lower layer or layers, and improved video sequence can be encoded and decoded for viewing by a user.