Low-Delay Audio-Video Transmission With Adaptive Frame Rate Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing educational interactive products fail to optimize complex network environments, affecting the timeliness and fluency of audio/video interactions, leading to poor user experience.
Innovation Solution
An audio/video interaction low-delay transmission method that adjusts video frame features based on network conditions, using TCP for long connection communication and UDP for frame transmission, and adjusts code rate levels to maintain optimal playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If simple streaming media transmission is used, then device complexity is reduced, but timeliness and fluency of audio/video interaction deteriorate in complex network environments
Solution Approach 1:
The patent implements dynamic adjustment of video frame rates based on real-time network conditions. The receiving end monitors network status and sends feedback to the sending end, which then adjusts the video encoding parameters dynamically. This allows the system to adapt to changing network conditions, maintaining audio/video fluency without requiring overly complex predetermined transmission systems.
Solution Approach 2:
The patent establishes a feedback mechanism where the receiving end monitors received video frames and network conditions, then sends feedback information back to the sending end. This feedback loop enables real-time adjustment of transmission parameters, improving audio/video timeliness and fluency in complex network environments without significantly increasing system complexity.
2Reliability
If video frame rate is increased to improve fluency, then audio/video fluency is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent dynamically adjusts video frame rates based on real-time network conditions. When network conditions are good, higher frame rates are used to improve fluency. When network conditions deteriorate, the frame rate is reduced to conserve bandwidth. This dynamic adjustment resolves the contradiction between maintaining fluency and managing bandwidth consumption.
Solution Approach 2:
The patent changes video encoding parameters (frame rate, resolution, code rate) based on network conditions. By adjusting these parameters dynamically, the system can optimize the balance between audio/video fluency and network bandwidth consumption, ensuring high quality transmission when possible and efficient transmission when bandwidth is limited.
3Reliability
If network optimization is implemented to improve timeliness, then audio/video timeliness is improved, but system complexity increases
Solution Approach 1:
The patent segments the network optimization function into separate modules: network condition monitoring at the receiving end, feedback transmission, and encoding adjustment at the sending end. This segmentation allows each component to focus on a specific task, improving timeliness without requiring a monolithic complex system.
Solution Approach 2:
The receiving end autonomously monitors network conditions and generates feedback without requiring complex centralized control. The sending end automatically adjusts encoding parameters based on received feedback. This self-service approach improves timeliness while keeping system complexity manageable through distributed decision-making.
Data Source
AI summary
An audio/video interaction low-delay transmission method includes the following steps: a driving receiving end maintaining long connection communication with a sending end by means of a TCP, and the receiving end sending a video frame feature to the sending end; sending, by the sending end to the receiving end, a video frame satisfying the video frame feature, and accumulating the number of video frames obtained by the receiving end within a plurality of continuous preset time periods; determining whether the number of video frames obtained within a preset number of preset time periods within the plurality of continuous preset time periods satisfies a preset range, so that a video code rate is adjusted in time to ensure real-time performance and fluency.