Blank Frame Extraction for Network Jitter Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Network time delay jitter affects the quality of real-time media services by causing distortion and interruptions in voice and video communications, as existing Time-scale anti-jitter technologies alter the sampling frequency, leading to voice speed changes and potential frame loss.
Innovation Solution
A method and device that determine network time delay changes and adjust the playback of media frames by extracting or inserting blank frames, which are identified by their information content, to maintain consistent playback without affecting the original sampling frequency, thereby reducing the impact of network time delay on real-time media services.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If Time-scale anti-jitter technology is used to adjust playback time of media frames, then the effect of network time delay jitter is reduced, but the original sampling frequency changes causing voice distortion and speed changes
Solution Approach 1:
The patent segments the media frames into different types (audio frames, video frames, blank frames) and applies different processing strategies to each segment. Specifically, it identifies and extracts blank frames from the media frame sequence, then inserts or extracts blank frames based on network time delay conditions, while leaving audio and video frames unchanged to preserve their original sampling frequency and content integrity.
Solution Approach 2:
The patent extracts blank frames from the media frame sequence as a separate element that can be manipulated independently. By extracting these low-information frames, the system can adjust playback timing without affecting the core audio-video content, thus resolving the contradiction between timing adjustment and sampling frequency preservation.
2Reliability
If time-domain tension or compression processing is performed on all voice frames, then playback time is adjusted to compensate for network jitter, but frame loss occurs due to buffer overflow
Solution Approach 1:
Instead of applying time-domain processing to all media frames (excessive action), the patent applies frame extraction/insertion operations only to blank frames (partial action). This selective approach provides sufficient timing adjustment to maintain playback continuity while avoiding over-processing that would cause buffer overflow and frame loss.
Solution Approach 2:
The patent uses blank frames as a cushioning mechanism to absorb timing variations. By inserting blank frames when network delay increases or extracting them when delay reduces, the system creates a buffer that compensates for jitter without requiring aggressive time-domain processing that would lead to frame loss.
3Duration of action of moving object
If all media frames undergo time-domain processing, then playback duration is adjusted, but the played media files generate distortion
Solution Approach 1:
The patent applies different quality levels of processing to different parts of the media stream. Blank frames undergo extraction/insertion operations that adjust timing, while audio and video frames are left completely unchanged to maintain their original quality. This local differentiation resolves the contradiction between duration adjustment and quality preservation.
Solution Approach 2:
The patent creates copies of blank frames to use for timing adjustment. These copied blank frames serve as placeholders that can be inserted or extracted without affecting the original audio-video content, thereby adjusting playback duration while preserving media file quality.
Data Source
AI summary
Embodiments of the present invention provide a method and device for processing network time delay characteristics. The method includes: determining whether network time delay changes; if the network time delay reduces, determining whether at least one blank frame is included in received but not played media frames of a real-time media service; if at least one blank frame is included in the received but not played media frames, extracting the blank frame from the received but not played media frames, the blank frame is a media frame, information amount of which is smaller than a preset first threshold, or difference between the information amount of which and the information amount of a previous media frame is smaller than a preset second threshold; if the network time delay increases, inserting the blank frame in the received but not played media frames. According to the embodiments of the present invention, when the network time delay changes, time for playing the received media frames may be adjusted by changing number of blank frames in the received but not played media frames, so as to reduce or eliminate the effect on the real-time media service generated by the network time delay characteristics.