Voice Activity Detection Audio Block Subsequence Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional voice communication systems face challenges in managing network jitter, leading to latency and degradation in voice quality due to uncertainty in packet arrival times, especially in real-time applications where delays are detrimental.
Innovation Solution
The system employs voice activity detection (VAD) to identify voice onset and non-voice periods, retrieving a subsequence of audio blocks preceding the current block to ensure accurate transmission and caching non-voice blocks, while using jitter buffers to manage packet timing and eliminate transmission jitters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a jitter buffer is introduced to manage network jitter, then packet loss is reduced, but latency increases
Solution Approach 1:
The system performs voice activity detection and retrieves subsequences of audio blocks in advance before transmission is needed. By preparing and caching audio blocks proactively during non-voice periods, the system reduces the need for large jitter buffers, thereby lowering latency while maintaining reliable packet delivery.
2Loss of energy
If voice activity detection is used to avoid transmitting silence packets, then network bandwidth is saved, but voice quality may degrade due to packet loss
Solution Approach 1:
The system retrieves and caches subsequences of audio blocks in advance during non-voice periods. When voice activity is detected, the cached blocks are immediately available for transmission, ensuring that voice packets are not lost due to network constraints while still avoiding transmission during silence periods.
Solution Approach 2:
The system introduces an intermediary caching mechanism that stores audio blocks between the voice activity detection stage and the transmission stage. This intermediary buffer ensures that when voice packets need to be transmitted, the necessary audio data is already prepared and available, preventing quality degradation while maintaining bandwidth efficiency.
3Reliability
If a subsequence of audio blocks is retrieved and transmitted, then voice quality is improved, but device complexity increases
Solution Approach 1:
The system performs the complex operation of retrieving and caching audio block subsequences in advance during non-voice periods. By completing this processing beforehand, the actual transmission phase becomes simpler and faster, as the data is already prepared and readily available when needed.
Data Source
AI summary
Voice communication method and apparatus and method and apparatus for operating jitter buffer are described. Audio blocks are acquired in sequence. Each of the audio blocks includes one or more audio frames. Voice activity detection is performed on the audio blocks. In response to deciding voice onset for a present one of the audio blocks, a subsequence of the sequence of the acquired audio blocks is retrieved. The subsequence precedes the present audio block immediately. The subsequence has a predetermined length and non-voice is decided for each audio block in the subsequence. The present audio block and the audio blocks in the subsequence are transmitted to a receiving party. The audio blocks in the subsequence are identified as reprocessed audio blocks. In response to deciding non-voice for the present audio block, the present audio block is cached.