Jitter Buffer Video Frame Output Rate Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for controlling the output rate of video frames from a jitter buffer do not adequately account for the visual information content, leading to noticeable playback speed distortions and visual artefacts, such as fast or slow movements, which can distort the video signal.
Innovation Solution
A method and apparatus that analyze the visual information content of each frame to determine its sensitivity to variations in playback rate, allowing for controlled variations in output rate from the jitter buffer, with marks indicating sensitivity added to frames, enabling more perceptually pleasant playback by minimizing noticeable distortions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the output rate of video frames from the jitter buffer is varied to reduce jitter, then the jitter in received frames is reduced, but playback speed distortions and visual artefacts occur
Solution Approach 1:
The patent applies local quality by analyzing the visual information content of each frame and assigning different sensitivity marks to different frames based on their specific characteristics. Frames with low motion content receive higher sensitivity marks, allowing greater output rate variations, while frames with high motion content receive lower sensitivity marks, restricting output rate variations to avoid visible distortions.
Solution Approach 2:
The patent implements dynamics by making the output rate control adaptive and variable rather than fixed. The sensitivity marks dynamically adjust the permissible output rate variations based on the visual content of each frame, allowing the system to optimize jitter reduction while minimizing visible distortions according to the specific characteristics of each frame sequence.
2Object-affected harmful factors
If the jitter buffer output rate is strictly controlled to maintain constant playback speed, then visual artefacts are minimized, but jitter in the video signal increases
Solution Approach 1:
The patent changes the parameter of output rate control from a fixed constant to a variable controlled by sensitivity marks. By analyzing visual information content and assigning appropriate sensitivity levels, the system adjusts the output rate parameter dynamically, allowing greater flexibility in handling jitter while maintaining visual quality where possible.
Solution Approach 2:
The patent segments the video signal into individual frames with different sensitivity characteristics. Each frame is independently analyzed for its visual information content and assigned a specific sensitivity mark, allowing differentiated control strategies for different portions of the video signal rather than applying a uniform control approach.
3Object-affected harmful factors
If visual information content analysis is performed on each frame to determine sensitivity, then playback quality is improved, but processing complexity increases
Solution Approach 1:
The patent applies preliminary action by analyzing the visual information content and determining sensitivity marks in advance, before the frames are played out. This preprocessing approach allows the system to prepare appropriate sensitivity markings for each frame based on its visual content, enabling optimized output rate control during playback without adding real-time processing complexity.
Data Source
Figure 1
Figure 2~3
AI summary
Method, apparatus and computer program product for processing a video signal, the video signal comprising a plurality of frames, wherein the frames of the video signal are received at a jitter buffer, and the frames are output from the jitter buffer at a variable output rate to account for jitter in the received frames. Variations in the output rate are controlled in dependence upon the visual information content of the video signal, the visual information content of the video signal being the portion of the video signal that is to be displayed when the video signal is played out.