Video-Audio Buffer Playback Control via Time Domain Stretching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing network communication technologies face issues with incontinuity and disconnection of video-audio data due to unpredictable data packet transmission rates over the Internet, leading to poor user experience.
Innovation Solution
A method and apparatus that perform time domain stretch or compacting processing on video-audio data in a buffer based on the time difference between data reception and playback duration, using algorithms like WSOLA for audio and repeat inserting frames for video, to adaptively control playback and mitigate incontinuity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a buffer is configured to store video-audio data, then playback continuity is improved, but the buffer capacity is limited and cannot solve the problem when data reception stops
Solution Approach 1:
The patent applies dynamic buffer management by adjusting the buffer threshold dynamically based on network conditions. When network reception is normal, the buffer threshold is set to a higher value to store more data. When reception stops or slows down, the threshold is adjusted to prevent overflow and maintain playback continuity, solving the contradiction between buffer capacity and playback reliability
Solution Approach 2:
The patent changes the parameter of buffer threshold dynamically. By monitoring network reception status and adjusting the buffer threshold parameter accordingly, the system can adapt to varying network conditions, ensuring continuous playback even when reception stops, thus resolving the limitation of fixed buffer capacity
2Reliability
If video-audio data is transmitted using TCP/IP protocol, then data transmission reliability is improved, but transmission rate cannot be controlled effectively leading to playback incontinuity
Solution Approach 1:
The patent implements a feedback mechanism by monitoring the buffer status and network reception conditions in real-time. Based on this feedback, the system dynamically adjusts the buffer threshold and playback parameters to maintain continuous playback, effectively compensating for the lack of transmission rate control in TCP/IP protocol while maintaining its reliability benefits
Solution Approach 2:
The patent performs preliminary actions by pre-storing video-audio data in the buffer before playback. By anticipating potential network interruptions and maintaining a sufficient buffer threshold, the system prepares in advance to handle reception failures, ensuring continuous playback without real-time transmission rate control
3Reliability
If the buffer does not receive subsequent video-audio data after buffer data is played, then incontinuity phenomena occur, but increasing buffer capacity is not feasible
Solution Approach 1:
The patent enables the buffer management system to serve itself by automatically monitoring network reception status and dynamically adjusting the buffer threshold without external intervention. The system self-adapts to network conditions, continuously receiving data when available and maintaining playback continuity when reception stops, reducing the need for complex external buffer management mechanisms
Data Source
AI summary
The embodiments of the present invention disclose a method for controlling video-audio data playing, which relates to the network communication field. The method includes: obtaining total duration of playing video-audio data in a buffer; calculating a time difference, the time difference being a difference between a current time point and a time point of receiving a latest video-audio data packet; and performing time domain stretch processing for video-audio data in the buffer when the total duration and the time difference satisfy a preset condition, and playing the processed video-audio data. The embodiments of the present invention also disclose an apparatus for controlling video-audio data playing. By using the method and apparatus, the incontinuity phenomena will be decreased when the video-audio data is played, so as to improve user experiences.