AV Data Processing Method Prioritizing Audio Over Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In audio and video data transmission scenarios, especially over BGP networks, high costs and poor network jitter performance lead to inefficient data delivery, causing delays and freezing issues due to the use of expensive BGP bandwidth and customized private protocols, which are not suitable for low-cost scenarios or poor network conditions.
Innovation Solution
Implementing an RTMP-based solution that replaces expensive BGP bandwidth with cheaper edge bandwidth and standard RTMP, allowing for real-time audio data transmission while temporarily discarding video data in the same GOP if the transmission rate is below a threshold, ensuring smooth audio delivery even in poor network conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If BGP bandwidth is used for audio and video data transmission, then transmission reliability is improved, but transmission cost increases
Solution Approach 1:
The patent changes the network parameter from expensive BGP bandwidth to cheaper edge bandwidth, accepting a trade-off in transmission reliability. This parameter substitution resolves the contradiction by finding an alternative transmission path that reduces cost while maintaining acceptable performance through compensatory mechanisms.
Solution Approach 2:
The patent segments audio and video data into separate processing streams with different priority levels. Audio data is transmitted with higher priority and preserved under bandwidth constraints, while video data is discarded when transmission rate falls below the threshold. This segmentation allows cost-effective transmission by allocating limited bandwidth resources optimally.
2Manufacturing precision
If customized private protocols are used for application layer, then transmission precision is improved, but device complexity increases
Solution Approach 1:
Instead of using customized private protocols to achieve transmission precision, the patent inverts the approach by using standard RTMP protocols and achieving precision through data prioritization and selective discarding mechanisms. This reduces protocol complexity while maintaining effective transmission quality.
Solution Approach 2:
The patent treats video data as disposable under bandwidth constraints, selectively discarding video frames when transmission rate is insufficient. This allows the use of simpler standard protocols while maintaining overall transmission effectiveness by preserving critical audio data and accepting temporary video quality degradation.
3Loss of information
If audio and video data are transmitted simultaneously, then information completeness is improved, but transmission speed decreases
Solution Approach 1:
The patent applies different quality requirements to different data types: audio data is transmitted with high priority and preserved under all conditions, while video data quality is dynamically adjusted based on available bandwidth. This local quality differentiation allows simultaneous transmission while maintaining acceptable speed by being selective about video data preservation.
Solution Approach 2:
The patent implements partial transmission action by selectively discarding video data when bandwidth is insufficient, rather than transmitting all data equally. This partial action on video data (discarding non-critical frames) maintains overall information completeness for critical audio while preserving transmission speed.
Data Source
AI summary
This application provides a data processing method and apparatus, a non-transitory computer-readable storage medium, and an electronic apparatus for AV data processing. The method includes: receiving stream control signaling transmitted by an interface machine, the interface machine being used to obtain, from the server, audio and video data to be transmitted to a client; determining, in response to the stream control signaling, a first rate from the server to the interface machine; and in response to the first rate being less than a first predetermined threshold: transmitting higher priority data in the AV data to the interface machine, and discarding lower priority data in the AV data.